Issues with network routing for Mac jobs

Final update

We are concluding this incident based on a confirmed fix with our infrastructure provider and successful tests. For any customers seeing failed runs, please run again for a successful connection.

1. Resolved · Jun 25, 03:06 UTC
   We are concluding this incident based on a confirmed fix with our infrastructure provider and successful tests. For any customers seeing failed runs, please run again for a successful connection.
2. Monitoring · Jun 25, 02:58 UTC
   A fix has been implemented and we are monitoring the results.
3. Investigating · Jun 25, 02:54 UTC
   Due to continued reports of intermittent failures and a lack of sustained improvement while in monitoring status, this incident is elevated back to investigating to escalate with our infrastructure provider.
4. Monitoring · Jun 25, 02:20 UTC
   We are continuing to monitor. We still observe a low percentage of intermittent failures. The failure rate is trending down as we continue to monitor. We advise customers to contact CircleCI Support if they see a change in degraded services and increased failure rate.
5. Monitoring · Jun 25, 01:22 UTC
   We are continuing to monitor for any further issues.
6. Monitoring · Jun 25, 01:13 UTC
   Our team is moving this incident to Monitoring status based on significant improvement seen in our tests and low error rate. We are seeing improvement in network routing for Mac jobs and are actively engaged with our infrastructure provider. If your Mac jobs experience network-related failures or degraded service please reach out to CircleCI support.
7. Identified · Jun 25, 00:39 UTC
   We are seeing improvement in Mac job network routing. We will continue to monitor for signs of recovery.
8. Identified · Jun 24, 23:56 UTC
   Mac jobs are still seeing intermittent failures with network routing. We are working with our infrastructure provider to address the networking issues.
9. Identified · Jun 24, 23:33 UTC
   We have implemented a change to address the routing issues and are monitoring the results.
10. Investigating · Jun 24, 23:13 UTC
    What's happening Our engineers are investigating network routing issues for some Mac jobs. What's impacted Mac jobs that make outbound requests, including checking out from GitHub.