SIP call failures

Final update

After our recent mitigation steps, our engineers have traced SIP call failure rate as it has returned to baseline. We will publish a complete root cause analysis shortly.

1. Resolved · Jul 31, 19:00 UTC
   After our recent mitigation steps, our engineers have traced SIP call failure rate as it has returned to baseline. We will publish a complete root cause analysis shortly.
2. Identified · Jul 31, 18:02 UTC
   Our engineers are putting together a targeted fix to resolve the remaining SIP failures in the US region.
3. Identified · Jul 31, 14:33 UTC
   We have identified the root cause of the failed SIP calls and prepared a fix.
4. Identified · Jul 31, 13:01 UTC
   Our team is still actively working to restore all calls and phone numbers to their normal working state.
5. Identified · Jul 31, 11:12 UTC
   Calls should be back to normal for the EU and India residencies. The US residency may still experience some downtime, but our team is working to resolve the issue. In the meantime, the immediate workaround is to remove the affected number and re-add it, if possible.
6. Identified · Jul 31, 09:06 UTC
   Our team has identified a potential cause of the call outages and is currently validating a fix. We will share further updates as soon as we have more information.
7. Investigating · Jul 31, 06:18 UTC
   Following the earlier fix, we're seeing renewed inbound call routing failures for a portion of phone numbers. We're currently investigating.
8. Resolved · Jul 31, 05:29 UTC
   The issue has been resolved. Call routing is now fully restored, and we're assessing follow-ups to improve proactive alerting and prevent recurrence.
9. Identified · Jul 31, 04:00 UTC
   We've identified a likely contributing factor related to infrastructure resource constraints affecting SIP call routing. We're currently validating a fix.
10. Investigating · Jul 31, 03:08 UTC
    Starting at ~1:00 UTC, calls to a portion of phone numbers imported into the ElevenLabs Agent Platform are failing. We are currently working to isolate the root cause and restore full functionality.