Delayed Logs in EU Region
Nov 28, 08:28 UTCNov 28, 19:14 UTC
Duration
10h 46m
Impact
Minor
Root cause
Storage
Mailgun, 90 days
11 incidents
Affected
Events & LogsEmail Services - Events & Logs
Final update
All systems are operating normally.
Timeline
- Resolved · Nov 28, 19:14 UTC
All systems are operating normally.
- Monitoring · Nov 28, 18:54 UTC
Events are processing normally without delay. We will continue to monitor the performance of the logging system.
- Monitoring · Nov 28, 18:26 UTC
Logs are currently delayed by 20 minutes due to elevated sending volumes. Outbound sending, inbound messages, and webhooks are not impacted.
- Monitoring · Nov 28, 17:56 UTC
Logs are currently delayed by 15 minutes due to elevated sending volumes.
- Monitoring · Nov 28, 17:19 UTC
Events are processing normally, we continue to monitor as we see elevated send volumes.
- Monitoring · Nov 28, 16:32 UTC
Events are processing normally, we continue to monitor as we see elevated send volumes.
- Monitoring · Nov 28, 15:45 UTC
Event processing has caught up and delays have resolved. We continue to monitor all operations.
- Identified · Nov 28, 15:34 UTC
We continue to see logging event delays of up to 5 minutes.
- Identified · Nov 28, 15:19 UTC
We continue to see logging event delays of up to 10 minutes.
- Identified · Nov 28, 15:09 UTC
We continue to see logging event delays of up to 20 minutes.
- Identified · Nov 28, 14:59 UTC
We continue to see logging event delays of up to 30 minutes.
- Identified · Nov 28, 14:50 UTC
We continue to see logging event delays of up to 35 minutes.
- Identified · Nov 28, 14:40 UTC
We continue to see logging event delays of up to 45 minutes.
- Identified · Nov 28, 14:32 UTC
We continue to see logging event delays of up to 50 minutes.
- Identified · Nov 28, 14:27 UTC
We continue to see logging event delays of up to 55 minutes.
- Identified · Nov 28, 13:55 UTC
We continue to see logging event delays of up to 60 minutes.
More from Mailgun
Full history| Started | Incident | Impact | Duration |
|---|---|---|---|
| Sep 1409:15 UTC | Route delays in EU Region | minor | 58m |
| Sep 414:16 UTC | EU Messaging Outage | critical | 17m |
| Sep 412:20 UTC | Microsoft Incident Resulting in Delivery Issues to M365 | none | 34m |
| Aug 3114:47 UTC | Event Log Delays in US Region | minor | 7h 14m |
| Aug 2720:38 UTC | EU Messaging Outage | critical | 37m |
| Aug 2016:19 UTC | GCP Reporting Multi Service Outage in US-West1 | minor | 1h 12m |
Also caused by storage
All| Started | Vendor | Incident | Impact | Duration |
|---|---|---|---|---|
| Sep 1715:50 UTC | AutoOps node metrics temporarily unavailable in some regions | major | 41m | |
| Sep 1015:26 UTC | Unresponsive Projects | major | 27h 40m | |
| Aug 2623:37 UTC | Disruption with GitHub Billing | minor | 20h 7m | |
| Aug 2413:56 UTC | Actions delays in starting runs | minor | 38m | |
| Aug 1316:21 UTC | Disruption with GHEC Team Sync | minor | 2h 6m | |
| Jul 1909:51 UTC | Block Storage Volume NYC1, NYC3, SGP1, SYD1 and BLR1 | minor | 5h 41m |
From vendors' own status pages and disclosures. Times as reported. Logos via logo.dev; trademarks belong to their owners.