QStash: Degraded performance
Apr 18, 12:36 UTCApr 18, 13:18 UTC
Duration
42m
Impact
Minor
Root cause
Not disclosed
Upstash, 90 days
5 incidents
Affected
EU-CENTRAL-1QStash
Final update
An internal cleanup task for QStash events, coinciding with disc layer compaction task has caused performance degradation to some users. Mitigation: Team has mitigated the event by pausing some of these tasks and monitored the status for a while. Fixes: Improvements are being applied to these tasks to use resources more gracefully. Disk resources are increased to be able to handle a bigger burst of load.
Timeline
- Postmortem · Apr 18, 13:19 UTC
An internal cleanup task for QStash events, coinciding with disc layer compaction task has caused performance degradation to some users. Mitigation: Team has mitigated the event by pausing some of these tasks and monitored the status for a while. Fixes: Improvements are being applied to these tasks to use resources more gracefully. Disk resources are increased to be able to handle a bigger burst of load.
- Resolved · Apr 18, 13:18 UTC
This incident has been resolved.
- Monitoring · Apr 18, 12:46 UTC
A fix has been implemented and we are monitoring the results.
- Investigating · Apr 18, 12:36 UTC
We are continuing to investigate this issue.
- Investigating · Apr 18, 12:36 UTC
We are currently investigating this issue.
More from Upstash
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 913:00 UTC | Intermittent DNS Resolution Errors for Upstash Vector in US East (us-east-1) | minor | 0m |
| Sep 308:29 UTC | Upstash Console login issue | none | 0m |
| Aug 2822:56 UTC | Message Persistence Issue , QStash us-east-1 | major | 0m |
| Jul 2208:50 UTC | Fly.io infrastructure disruption affecting some Upstash Redis databases on Fly.io DFW Region | none | 1h 15m |
| Jul 1608:35 UTC | QStash us-east-1 - URL Publish Errors | none | 0m |
| Jun 2515:23 UTC | Upstash Redis Partial Service Disruption | major | 1h 12m |
From vendors' own status pages and disclosures. Times as reported. Logos via logo.dev; trademarks belong to their owners.