GitHub header

Degraded performance for various services

Incident Report for GitHub

Resolved

On March 13, 2026, between 13:35 UTC and 16:02 UTC, a configuration change to an internal authorization service reduced its processing capacity below what was needed during peak traffic. This caused intermittent timeouts when other GitHub services checked user permissions, resulting in four to five waves of errors over roughly two hours and forty minutes. In total, 0.4% of users were denied access to actions they were authorized to perform.

The root cause was a resource right-sizing change deployed to the authorization service the previous day. It reduced CPU allocation below what was required at peak, causing the service's network gateway to throttle under load. Because the change was deployed after peak traffic on March 12, the reduced capacity wasn't surfaced until the next day's peak.

The incident was mitigated by manually scaling up the authorization service and reverting the configuration change.


To prevent recurrence, we are adding further resource utilization monitors across our entire stack to detect throttling and improving error handling so transient infrastructure timeouts are distinguished from authorization failures, enabling quicker detection of the root issue.
Posted Mar 13, 2026 - 16:15 UTC

Update

We have deployed mitigations and are actively monitoring for recovery. We'll post another update by 17:00 UTC.
Posted Mar 13, 2026 - 16:02 UTC

Update

We are investigating intermittent performance degradation affecting Actions, Feeds, Issues, Package Registry, Profiles, Registry Metadata, Star, and User Dashboard. Users may experience elevated error rates and slower response times when accessing these services. We have identified a potential cause and are implementing mitigations to restore normal service. We'll post another update by 16:15 UTC.
Posted Mar 13, 2026 - 15:47 UTC

Update

Packages is experiencing degraded performance. We are continuing to investigate.
Posted Mar 13, 2026 - 15:20 UTC

Update

We are investigating reports of issues with service(s): Actions, Feeds, Issues, Profiles, Registry Metadata, Star, User Dashboard. We will continue to keep users updated on progress towards mitigation.
Posted Mar 13, 2026 - 15:14 UTC

Investigating

We are investigating reports of degraded performance for Actions and Issues
Posted Mar 13, 2026 - 15:12 UTC
This incident affected: Issues, Actions, and Packages.