Span & Transaction ingestion delayed in DE
Aug 13, 17:47 UTCAug 13, 22:27 UTC
Duration
4h 40m
Impact
Major
Root cause
Not disclosed
Sentry, 90 days
30 incidents
Affected
US Ingestion - US Span IngestionAlerting - US Transactions AlertingAlerting - US Spans AlertingUS Ingestion - US Error IngestionUS Ingestion - US Transaction IngestionAlerting - US Errors AlertingAlerting - EU Errors AlertingAlerting - EU Transactions AlertingAlerting - EU Spans AlertingEU Ingestion - EU Transaction IngestionEU Ingestion - EU Span Ingestion
Final update
All backlogs have been processed.
Timeline
- Resolved · Aug 13, 22:27 UTC
All backlogs have been processed.
- Monitoring · Aug 13, 22:13 UTC
We continue to make progress on the spans backlog with an estimated completion time of 15 minutes.
- Monitoring · Aug 13, 21:22 UTC
We're continuing to make progress on the span ingestion backlog in US.
- Monitoring · Aug 13, 20:32 UTC
We've recovered all ingestion latency in DE. In US, errors have processed their backlog and we continue to make progress on spans in US.
- Monitoring · Aug 13, 19:53 UTC
The problematic change has been reverted and we're processing backlogs.
- Monitoring · Aug 13, 19:34 UTC
The problematic change has been reverted and we're processing backlogs.
- Identified · Aug 13, 18:35 UTC
We've identified the source of latency and are reverting that change.
- Investigating · Aug 13, 18:07 UTC
We are currently investigating ingestion delays for spans, transactions and alerts in DE and US
- Investigating · Aug 13, 17:59 UTC
We are currently investigating ingestion delays for spans and transactions in DE and US
- Investigating · Aug 13, 17:47 UTC
We are currently investigating ingestion delays for spans and transactions in DE
More from Sentry
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 1810:17 UTC | Delays in spans ingestion | major | 41m |
| Sep 1808:36 UTC | Delayed ingestion of errors in EU | critical | 3h 20m |
| Sep 1016:13 UTC | Ingestion is delayed in US | minor | 57m |
| Sep 1015:25 UTC | Sentry.io elevated number of 500 errors | major | 1h 1m |
| Sep 114:16 UTC | Span ingestion is degraded in US | minor | 6h 14m |
| Sep 108:01 UTC | Sentry requests timing out / 504's | major | 3h 20m |
From vendors' own status pages and disclosures. Times as reported. Logos via logo.dev; trademarks belong to their owners.