Workers KV storage failure cascades to Access, WARP and more
Jun 12, 17:52 UTCJun 12, 20:20 UTC
Duration
2h 28m
Impact
Critical
Root cause
Dependency
Cloudflare, 90 days
50 incidents
Affected
Workers KVWARPAccessGatewayTurnstileWorkers AIGlobal
Lesson: A shared internal primitive is a single point of failure for everything built on it; know which products have a hard dependency and give them a fallback.
What happened
A failure in the third-party storage infrastructure behind Workers KV took down many products that rely on KV for configuration, authentication and asset delivery. The outage lasted 2 hours and 28 minutes.
More from Cloudflare
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 2318:42 UTC | Network Performance Degradation , Asia-Pacific | minor | Ongoing |
| Sep 2315:54 UTC | Elevated Errors with any / all in http_response_cache_settings | minor | 2h 14m |
| Sep 2309:08 UTC | Intermittent authentication errors for API and R2 | minor | 11h 51m |
| Sep 2308:09 UTC | Increased Errors for Durable Objects | minor | 1h 51m |
| Sep 2304:08 UTC | Elevated number of R2 503 errors in Australian Eastern Coast region | minor | 17m |
| Sep 2300:42 UTC | Issues with 1.1.1.1 for Families | minor | 44m |
Also caused by third-party dependency
All| Started | Vendor | Incident | Impact | Duration |
|---|---|---|---|---|
| Sep 1609:48 UTC |  DigitalOcean | Support Portal Service DisruptionDigitalOcean | minor | 11h 21m |
| Sep 417:03 UTC |  Grafana Labs | Degradation of Hosted Grafana in US Central RegionGrafana Labs | major | 3h 39m |
| Sep 416:05 UTC |  Expo | Elevated Linux worker queue timesExpo | major | 15h 4m |
| Sep 115:25 UTC | Grafana Labs | Investigating issues in US Central (prod-us-central-0, prod-us-central-5)Grafana Labs | minor | 4h 54m |
| Aug 3106:26 UTC |  Fly.io | Packet loss in ORDFly.io | minor | 1h 44m |
| Aug 2800:07 UTC |  Snowflake | INC20000150Snowflake | minor | Ongoing |
From vendors' own status pages and disclosures. Times as reported. Logos via logo.dev; trademarks belong to their owners.