Secrets service outage
Aug 14, 19:30 UTCAug 14, 20:33 UTC
Duration
1h 3m
Impact
Major
Root cause
Not disclosed
Fly.io, 90 days
51 incidents
Affected
Machines API
Final update
This incident has been resolved.
Timeline
- Resolved · Aug 14, 20:33 UTC
This incident has been resolved.
- Monitoring · Aug 14, 20:08 UTC
We have failed over the secrets database to a replica, and the Machines API appears healthy now. We are monitoring for any further issues.
- Identified · Aug 14, 19:30 UTC
We are working to recover our secrets service after a failed deployment. Apps continue to run, but it is not possible to create new apps or update secrets at this time.
More from Fly.io
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 2318:44 UTC | Partial Sprites outage | major | 7h 28m |
| Sep 2314:47 UTC | Elevated private networking errors | major | 36m |
| Sep 2312:42 UTC | Upstash unavailability in FRA region | major | 1h 22m |
| Sep 2306:18 UTC | IPv6 Networking Issues in DFW | major | 5h 57m |
| Sep 1504:08 UTC | Depot builder failures | minor | 1h 25m |
| Sep 1221:22 UTC | Network issues in US West Coast | minor | 50m |
From vendors' own status pages and disclosures. Times as reported. Logos via logo.dev; trademarks belong to their owners.