Ohio Services with Disks, Data Persistence failing
Mar 3, 00:41 UTCMar 3, 01:00 UTC
Duration
20m
Impact
Major
Root cause
Database
Render, 90 days
14 incidents
Affected
Web ServicesBackground WorkersPostgreSQLRedisOhio - Web ServicesOhio - Background WorkersOhio - PostgreSQLOhio - Redis
Final update
All affected services have been migrated to new hosts and are running at this time. This incident has been resolved.
Timeline
- Resolved · Mar 3, 01:00 UTC
All affected services have been migrated to new hosts and are running at this time. This incident has been resolved.
- Identified · Mar 3, 00:59 UTC
Many services have recovered with healthy disks on new hosts, however this issue remains open as some services are still impaired.
- Identified · Mar 3, 00:41 UTC
Services located in Ohio, both application types (Web Service, Private Service, etc.) and data types (Postgres, Key Value with persistence) are failing due to disk errors. We are working on mitigations.
More from Render
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 921:26 UTC | Elevated Build and Deploy Times in the Oregon Region | minor | 12m |
| Sep 217:19 UTC | Degraded builds/deploys | major | 21m |
| Aug 3120:24 UTC | Some Web services in Oregon unavailable | minor | 0m |
| Aug 3115:47 UTC | Service instability in Singapore | major | 2h 22m |
| Aug 2015:47 UTC | Deployment Issues | major | 3h 53m |
| Jul 2714:43 UTC | Degraded dashboard performance | minor | 28h 52m |
Also caused by database
All| Started | Vendor | Incident | Impact | Duration |
|---|---|---|---|---|
| Sep 1309:16 UTC |  GitHub | Incident with several GitHub ServicesGitHub | critical | 1h 29m |
| Sep 921:53 UTC |  Snowflake | INC20000211Snowflake | critical | 1h 58m |
| Aug 2616:17 UTC |  Sentry | Issues performance is degraded in the USSentry | minor | 4h 19m |
| Aug 1216:16 UTC | GitHub | Incident with Pull Requests and IssuesGitHub | minor | 25m |
| Aug 818:57 UTC |  DigitalOcean | Account Registration, Droplets, and Related ServicesDigitalOcean | minor | 6h 3m |
| Jul 2817:41 UTC |  HubSpot | Event ingestion and retrieval delays for some North America customersHubSpot | none | 2h |
From vendors' own status pages and disclosures. Times as reported. Logos via logo.dev; trademarks belong to their owners.