On October 7, 2025, between 7:48 PM UTC and October 8, 12:05 AM UTC (approximately 4 hours and 17 minutes), the audit log service was degraded, creating a backlog and delaying availability of new audit log events. The issue originated in a third-party dependency.
We mitigated the incident by working with the vendor to identify and resolve the issue. Write operations recovered first, followed by the processing of the accumulated backlog of audit log events.
We are working to improve our monitoring and alerting for audit log ingestion delays and strengthen our incident response procedures to reduce our time to detection and mitigation of issues like this one in the future.
Posted Oct 08, 2025 - 00:05 UTC
Update
We are seeing recovery of audit log ingestion and continue to monitor recovery.
Posted Oct 07, 2025 - 22:45 UTC
Update
We are seeing recovery of audit log ingestion and continue to monitor recovery.
Posted Oct 07, 2025 - 21:51 UTC
Update
We continue to apply mitigations and monitor for recovery.
Posted Oct 07, 2025 - 21:17 UTC
Update
We have identified an issue causing delayed audit log event ingestion and are working on a mitigation.