Resolved -
From Nov 18, 2025 20:30 UTC to Nov 18, 2025 21:34 UTC we experienced failures on all Git operations, including both SSH and HTTP Git client interactions, as well as raw file access. These failures also impacted products that rely on Git operations.
The root cause was an expired TLS certificate used for internal service-to-service communication. We mitigated the incident by replacing the expired certificate and restarting impacted services. Once those services were restarted we saw a full recovery.
We have updated our alerting to cover the expired certificate and are performing an audit of other certificates in this area to ensure they also have the proper alerting and automation before expiration. In parallel, we are accelerating efforts to eliminate our remaining manually managed certificates, ensuring all service-to-service communication is fully automated and aligned with modern security practices.
Nov 18, 21:59 UTC
Update -
Git Operations is operating normally.
Nov 18, 21:56 UTC
Update -
We are seeing full recovery after rolling out the fix and all services are operational.
Nov 18, 21:55 UTC
Update -
Codespaces is operating normally.
Nov 18, 21:55 UTC
Update -
We have shipped a fix and are seeing recovery in some areas and will continue to provide updates.
Nov 18, 21:36 UTC
Update -
We have identified the likely cause of the incident and are working on a fix. We will provide another update as we get closer to deploying the fix.
Nov 18, 21:27 UTC
Update -
Codespaces is experiencing degraded availability. We are continuing to investigate.
Nov 18, 21:25 UTC
Update -
We are currently investigating failures on all Git operations, including both SSH and HTTP.
Nov 18, 21:11 UTC
Update -
We are seeing failures for some git http operations and are investigating
Nov 18, 20:52 UTC
Update -
Git Operations is experiencing degraded availability. We are continuing to investigate.
Nov 18, 20:39 UTC
Investigating -
We are currently investigating this issue.
Nov 18, 20:39 UTC