Elevated Linux worker queue times
Sep 4, 16:05 UTCSep 5, 07:10 UTC
Duration
15h 4m
Impact
Major
Root cause
Dependency
Expo, 90 days
32 incidents
Affected
Not listed by the vendor.
Final update
This incident has been resolved.
Timeline
- Resolved · Sep 5, 07:10 UTC
This incident has been resolved.
- Monitoring · Sep 4, 20:38 UTC
The upstream issue with creating VM's has been resolved by GCP, Linux worker queues are draining, and queue times are returning to expected levels.
- Identified · Sep 4, 17:06 UTC
Queue times for Android builds and other Linux workflows are currently elevated due to upstream provider issues affecting the provisioning of VM's. GCP has confirmed the issue and is working on resolving.
- Identified · Sep 4, 16:05 UTC
Queue times for Android builds and other Linux workflows are currently elevated due to GCP regional capacity constraints. We are currently enabling capacity in additional regions. Jobs in queue are continuing to progress.
More from Expo
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 2323:37 UTC | EAS Update cache issue for rollout updates | minor | 3h 34m |
| Sep 2121:18 UTC | Elevated rate of failed iOS submissions | major | 9h 24m |
| Sep 2120:26 UTC | Elevated rate of failed iOS submissions | major | 14m |
| Sep 1812:43 UTC | Elevated queue times for Android Builds, Submissions, and Workflows | minor | 2h 48m |
| Sep 814:42 UTC | iOS push notification degraded performance | minor | 4h 41m |
| Sep 515:38 UTC | Delayed iOS push notification delivery | minor | 1h 1m |
Also caused by third-party dependency
All| Started | Vendor | Incident | Impact | Duration |
|---|---|---|---|---|
| Sep 1609:48 UTC |  DigitalOcean | Support Portal Service DisruptionDigitalOcean | minor | 11h 21m |
| Sep 1608:31 UTC |  Cloudflare | Support Helpdesk Availability IssuesCloudflare | minor | 6h 27m |
| Sep 417:03 UTC |  Grafana Labs | Degradation of Hosted Grafana in US Central RegionGrafana Labs | major | 3h 39m |
| Sep 115:25 UTC | Grafana Labs | Investigating issues in US Central (prod-us-central-0, prod-us-central-5)Grafana Labs | minor | 4h 54m |
| Aug 3106:26 UTC |  Fly.io | Packet loss in ORDFly.io | minor | 1h 44m |
| Aug 2800:07 UTC |  Snowflake | INC20000150Snowflake | minor | Ongoing |
From vendors' own status pages and disclosures. Times as reported. Logos via logo.dev; trademarks belong to their owners.