Elevated Linux worker queue times
Sep 2, 21:44 UTCSep 2, 22:05 UTC
Duration
21m
Impact
Minor
Root cause
Capacity
Expo, 90 days
32 incidents
Affected
EAS BuildEAS WorkflowsExpo Application Services - EAS BuildExpo Application Services - EAS Workflows
Final update
A fix was deployed at 2:50pm PT/5:50pm ET. The job queue has been running as expected. The root cause of this incident is that a new version of a cache needed more vCPUs than it was given, and we have increased the CPU count as the immediate fix along with additional monitoring for CPU usage on these cache instances.
Timeline
- Resolved · Sep 2, 22:05 UTC
A fix was deployed at 2:50pm PT/5:50pm ET. The job queue has been running as expected. The root cause of this incident is that a new version of a cache needed more vCPUs than it was given, and we have increased the CPU count as the immediate fix along with additional monitoring for CPU usage on these cache instances.
- Identified · Sep 2, 21:52 UTC
We have determined that some of our package caches are under high load, and this is causing elevated build times and in turn causing higher Linux worker queue times. We are currently working on a fix. In-progress builds are continuing to complete and enqueued builds are continuing to be processed.
- Investigating · Sep 2, 21:44 UTC
Queue times are elevated for Linux workers for EAS Build and Workflows. Android build jobs may be delayed. We are currently investigating the issue.
More from Expo
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 2323:37 UTC | EAS Update cache issue for rollout updates | minor | 3h 34m |
| Sep 2121:18 UTC | Elevated rate of failed iOS submissions | major | 9h 24m |
| Sep 2120:26 UTC | Elevated rate of failed iOS submissions | major | 14m |
| Sep 1812:43 UTC | Elevated queue times for Android Builds, Submissions, and Workflows | minor | 2h 48m |
| Sep 814:42 UTC | iOS push notification degraded performance | minor | 4h 41m |
| Sep 515:38 UTC | Delayed iOS push notification delivery | minor | 1h 1m |
Also caused by capacity and load
All| Started | Vendor | Incident | Impact | Duration |
|---|---|---|---|---|
| Sep 2213:19 UTC | We are investigating an issue with CH servers in Azure germanywestcentral region | minor | 5h 6m | |
| Sep 1607:20 UTC | Degradation with Gemini 3.8 Flash | major | 10h 28m | |
| Sep 1509:47 UTC | Disruption with some GitHub services | minor | 1h 30m | |
| Sep 422:02 UTC | Degradation in repos contents API | minor | 21m | |
| Sep 115:00 UTC | Delays in commit processing | minor | 1h 1m | |
| Aug 2615:11 UTC | Incident with Actions | critical | 2h 50m |
From vendors' own status pages and disclosures. Times as reported. Logos via logo.dev; trademarks belong to their owners.