Upstash Redis: GCP Global Connectivity Problems
Mar 27, 17:05 UTCMar 27, 15:30 UTC
Duration
0m
Impact
Informational
Root cause
DNS
Upstash, 90 days
5 incidents
Affected
Not listed by the vendor.
Final update
Due to a race condition in a process that attaches static IPs to nodes, some of the IPs in the dns were detached from the nodes, causing timeouts.
Timeline
- Resolved · Mar 27, 15:30 UTC
Due to a race condition in a process that attaches static IPs to nodes, some of the IPs in the dns were detached from the nodes, causing timeouts.
More from Upstash
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 913:00 UTC | Intermittent DNS Resolution Errors for Upstash Vector in US East (us-east-1) | minor | 0m |
| Sep 308:29 UTC | Upstash Console login issue | none | 0m |
| Aug 2822:56 UTC | Message Persistence Issue , QStash us-east-1 | major | 0m |
| Jul 2208:50 UTC | Fly.io infrastructure disruption affecting some Upstash Redis databases on Fly.io DFW Region | none | 1h 15m |
| Jul 1608:35 UTC | QStash us-east-1 - URL Publish Errors | none | 0m |
| Jun 2515:23 UTC | Upstash Redis Partial Service Disruption | major | 1h 12m |
Also caused by dns
All| Started | Vendor | Incident | Impact | Duration |
|---|---|---|---|---|
| Jul 2720:34 UTC | Delays in creation of DNS records | minor | 2h 2m | |
| Jun 2301:05 UTC | INC20000046 | major | 1h 30m | |
| Jun 410:12 UTC | DNS API Service | minor | 1h 35m | |
| May 1413:57 UTC | DNS service, Certificates and Managed MongoDB | minor | 6h 49m | |
| May 715:17 UTC | AWS Cluster DNS Changes Degraded Performance | major | 6h 58m | |
| Apr 2903:23 UTC | Azure - UK South (London): INC0156355 | critical | 1h 21m |
From vendors' own status pages and disclosures. Times as reported. Logos via logo.dev; trademarks belong to their owners.