Build failures and delays due to upstream service disruption
Oct 20, 07:49 UTCOct 20, 22:15 UTC
Duration
14h 26m
Impact
Critical
Root cause
Dependency
CircleCI, 90 days
27 incidents
Affected
Not listed by the vendor.
Final update
This incident has been resolved. All job types are now operating normally with standard queue times. Linux machine and Remote Docker capacity has been fully restored following the AWS incident recovery. Thank you for your patience.
Timeline
- Resolved · Oct 20, 22:15 UTC
This incident has been resolved. All job types are now operating normally with standard queue times. Linux machine and Remote Docker capacity has been fully restored following the AWS incident recovery. Thank you for your patience.
More from CircleCI
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 2318:13 UTC | Delays in processing new signups and plan changes | none | 1h 53m |
| Sep 2116:22 UTC | Delays starting Linux Machine jobs | minor | 47m |
| Sep 1614:55 UTC | Customers may experience delays in UI updates | minor | 4h 35m |
| Sep 1514:42 UTC | Customers may experience delays in UI updates | minor | 2h 20m |
| Sep 1411:59 UTC | Increased wait times for macOS jobs | minor | 1h |
| Sep 1020:25 UTC | Issues loading pipelines for a small number of projects | minor | 1m |
Also caused by third-party dependency
All| Started | Vendor | Incident | Impact | Duration |
|---|---|---|---|---|
| Sep 1609:48 UTC |  DigitalOcean | Support Portal Service DisruptionDigitalOcean | minor | 11h 21m |
| Sep 1608:31 UTC |  Cloudflare | Support Helpdesk Availability IssuesCloudflare | minor | 6h 27m |
| Sep 417:03 UTC |  Grafana Labs | Degradation of Hosted Grafana in US Central RegionGrafana Labs | major | 3h 39m |
| Sep 416:05 UTC |  Expo | Elevated Linux worker queue timesExpo | major | 15h 4m |
| Sep 115:25 UTC | Grafana Labs | Investigating issues in US Central (prod-us-central-0, prod-us-central-5)Grafana Labs | minor | 4h 54m |
| Aug 3106:26 UTC |  Fly.io | Packet loss in ORDFly.io | minor | 1h 44m |
From vendors' own status pages and disclosures. Times as reported. Logos via logo.dev; trademarks belong to their owners.