Some Grafana Instances Unavailable
Aug 4, 19:11 UTCAug 5, 01:32 UTC
Duration
6h 21m
Impact
Critical
Root cause
Dependency
Grafana Labs, 90 days
74 incidents
Affected
GCP US Central - prod-us-central-0GCP US Central - prod-us-central-3GCP US Central - prod-us-central-4Grafana - GCP US Central - prod-us-central-0Grafana - GCP US Central - prod-us-central-3Grafana - GCP US Central - prod-us-central-4
Final update
We are observing a continued period of stability and at this point, we are marking the incident resolved.
Timeline
- Resolved · Aug 5, 01:32 UTC
We are observing a continued period of stability and at this point, we are marking the incident resolved.
- Monitoring · Aug 5, 00:54 UTC
We have rolled out a change to the affected regions to restore services.
- Investigating · Aug 4, 22:58 UTC
We have identified the cause: our cloud provider has exhausted compute capacity in the affected region. We are working directly with them and are moving affected workloads to alternative capacity to restore service.
- Investigating · Aug 4, 20:12 UTC
We are continuing to investigate this issue.
- Investigating · Aug 4, 19:11 UTC
We are currently investigating an issue that causing some Grafana deployments in prod-us-central-0 and prod-us-central-3 to become unavailable.
More from Grafana Labs
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 2221:27 UTC | Kubernetes Observability Billing & Usage Incorrect | minor | 16h 39m |
| Sep 2214:57 UTC | IRM Access Issues for a Small Group of Users | major | 20h 10m |
| Sep 2119:16 UTC | Mimir write request errors | none | 0m |
| Sep 1712:34 UTC | Elevated Latency Managing Cloud Provider Integrations in GCP US Central | minor | 0m |
| Sep 1510:00 UTC | Increased Execution Time for Browser Checks in Synthetic Monitoring | minor | 1h 17m |
| Sep 1507:49 UTC | Intermittent Metric Write Errors in GCP US Central (prod-us-central-0) | minor | 0m |
Also caused by third-party dependency
All| Started | Vendor | Incident | Impact | Duration |
|---|---|---|---|---|
| Sep 1609:48 UTC |  DigitalOcean | Support Portal Service DisruptionDigitalOcean | minor | 11h 21m |
| Sep 1608:31 UTC |  Cloudflare | Support Helpdesk Availability IssuesCloudflare | minor | 6h 27m |
| Sep 416:05 UTC |  Expo | Elevated Linux worker queue timesExpo | major | 15h 4m |
| Aug 3106:26 UTC |  Fly.io | Packet loss in ORDFly.io | minor | 1h 44m |
| Aug 2800:07 UTC |  Snowflake | INC20000150Snowflake | minor | Ongoing |
| Aug 2710:04 UTC |  GitHub | Incident with Copilot AI Model ProvidersGitHub | critical | 2h 8m |
From vendors' own status pages and disclosures. Times as reported. Logos via logo.dev; trademarks belong to their owners.