If the current log emission was bumped back to WARNING (thus sent to logstash), any infinite loops could cause downtime (as before), flooding logstash and saturating networks enough to effect other requests. While some fixes were made, I've identified a few infinite loop scenarios that need to be fixed. Even if the statslib data shows few spikes, it only takes one to cause a lot of trouble, so I'd be hesitant to re-enable logging without those fixes being merged *and* the statslib counter showing no spikes.

Thu, Apr 24, 6:36 PM · MW-Interfaces-Team (MW-Sprint-9 (2025-05-07 to 2025-05-20)), MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), Patch-For-Review, MW-1.42-notes, MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), MediaWiki-libs-Rdbms, Observability-Logging

gerritbot added a project to T391364: [SPIKE] Add a statslib counter for the LoadBalancer::runPrimaryTransactionIdleCallbacks errors: Patch-For-Review.

Thu, Apr 24, 6:23 PM · MW-Interfaces-Team (MW-Sprint-9 (2025-05-07 to 2025-05-20)), MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), Patch-For-Review, MW-1.42-notes, MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), MediaWiki-libs-Rdbms, Observability-Logging

gerritbot added a comment to T391364: [SPIKE] Add a statslib counter for the LoadBalancer::runPrimaryTransactionIdleCallbacks errors.

Change #1137040 had a related patch set uploaded (by Aaron Schulz; author: Aaron Schulz):

[mediawiki/core@master] rdbms: add StatsLib counter for danging writes during post-transaction callbacks

https://gerrit.wikimedia.org/r/1137040

Thu, Apr 24, 6:22 PM · MW-Interfaces-Team (MW-Sprint-9 (2025-05-07 to 2025-05-20)), MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), Patch-For-Review, MW-1.42-notes, MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), MediaWiki-libs-Rdbms, Observability-Logging

Wed, Apr 23

HCoplin-WMF edited projects for T391364: [SPIKE] Add a statslib counter for the LoadBalancer::runPrimaryTransactionIdleCallbacks errors, added: MW-Interfaces-Team (MW-Sprint-8 (2025-04-23 to 2025-05-06)); removed MW-Interfaces-Team (MWI-Sprint-7 (2025-04-08 to 2025-04-22)).

Wed, Apr 23, 4:16 PM · MW-Interfaces-Team (MW-Sprint-9 (2025-05-07 to 2025-05-20)), MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), Patch-For-Review, MW-1.42-notes, MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), MediaWiki-libs-Rdbms, Observability-Logging

HCoplin-WMF updated the task description for T391364: [SPIKE] Add a statslib counter for the LoadBalancer::runPrimaryTransactionIdleCallbacks errors.

Wed, Apr 23, 4:09 PM · MW-Interfaces-Team (MW-Sprint-9 (2025-05-07 to 2025-05-20)), MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), Patch-For-Review, MW-1.42-notes, MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), MediaWiki-libs-Rdbms, Observability-Logging

Mon, Apr 21

matmarex closed T373719: Use MessageSerializationTestTrait to test Message serialization as Resolved.

Mon, Apr 21, 3:13 PM · MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), MediaWiki-Platform-Team (Radar), Wikimedia-Performance-recommendation, Developer Productivity, Test-Coverage, MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), MediaWiki-Internationalization

Apr 18 2025

Maintenance_bot removed a project from T373719: Use MessageSerializationTestTrait to test Message serialization: Patch-For-Review.

Apr 18 2025, 3:29 PM · MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), MediaWiki-Platform-Team (Radar), Wikimedia-Performance-recommendation, Developer Productivity, Test-Coverage, MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), MediaWiki-Internationalization

ReleaseTaggerBot edited projects for T373719: Use MessageSerializationTestTrait to test Message serialization, added: MW-1.44-notes (1.44.0-wmf.27; 2025-04-29); removed MW-1.44-notes (1.44.0-wmf.20; 2025-03-11).

Apr 18 2025, 3:00 PM · MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), MediaWiki-Platform-Team (Radar), Wikimedia-Performance-recommendation, Developer Productivity, Test-Coverage, MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), MediaWiki-Internationalization

gerritbot added a comment to T373719: Use MessageSerializationTestTrait to test Message serialization.

Change #1068290 merged by jenkins-bot:

[mediawiki/core@master] Message: Add more tests using SerializationTestTrait

https://gerrit.wikimedia.org/r/1068290

Apr 18 2025, 2:38 PM · MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), MediaWiki-Platform-Team (Radar), Wikimedia-Performance-recommendation, Developer Productivity, Test-Coverage, MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), MediaWiki-Internationalization

Apr 16 2025

gerritbot added a comment to T368289: Incredible amount of logs from Wikimedia\Rdbms\LoadBalancer::runPrimaryTransactionIdleCallbacks.

Change #1137040 had a related patch set uploaded (by Aaron Schulz; author: Aaron Schulz):

[mediawiki/core@master] rdbms: add StatsLib counter for danging writes during post-transaction callbacks

https://gerrit.wikimedia.org/r/1137040

Apr 16 2025, 4:58 PM · MW-Interfaces-Team, MW-1.42-notes, MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), Patch-For-Review, MediaWiki-libs-Rdbms, Observability-Logging

Apr 15 2025

cscott reopened T354908: evaluate and migrate in-use parsoid metrics to statslib, a subtask of T350592: EPIC: migrate in use metrics and dashboards to statslib, as Open.

Apr 15 2025, 7:47 PM · SRE Observability (FY2024/2025-Q4), MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), Epic, MW-1.42-notes (1.42.0-wmf.15; 2024-01-23), MediaWiki-Platform-Team (Radar), Observability-Metrics

Apr 14 2025

MSantos moved T373480: Display categories in sorted order by default from Backlog to To Verify on the Content-Transform-Team (Work In Progress) board.

Apr 14 2025, 12:11 PM · Content-Transform-Team (Work In Progress), MediaWiki-Categories, MediaWiki-User-Interface, Parsoid-Read-Views (Phase 1 - DiscussionTools support), MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), User-notice

MSantos edited projects for T373480: Display categories in sorted order by default, added: Content-Transform-Team (Work In Progress); removed Content-Transform-Team-WIP.

karapayneWMDE closed T359386: (Analytics?) Migrate MediaWiki.articleplaceholder to statslib, a subtask of T350592: EPIC: migrate in use metrics and dashboards to statslib, as Resolved.

Apr 14 2025, 9:25 AM · SRE Observability (FY2024/2025-Q4), MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), Epic, MW-1.42-notes (1.42.0-wmf.15; 2024-01-23), MediaWiki-Platform-Team (Radar), Observability-Metrics

karapayneWMDE closed T359249: [GRAFMIGR] Migrate MediaWiki.wikibase.lexeme.special.NewLexeme to statslib, a subtask of T350592: EPIC: migrate in use metrics and dashboards to statslib, as Resolved.

Apr 14 2025, 9:24 AM · SRE Observability (FY2024/2025-Q4), MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), Epic, MW-1.42-notes (1.42.0-wmf.15; 2024-01-23), MediaWiki-Platform-Team (Radar), Observability-Metrics

karapayneWMDE closed T359341: (mw.track) Migrate MediaWiki.AdvancedSearch.event.* to statslib, a subtask of T350592: EPIC: migrate in use metrics and dashboards to statslib, as Resolved.

Apr 14 2025, 9:21 AM · SRE Observability (FY2024/2025-Q4), MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), Epic, MW-1.42-notes (1.42.0-wmf.15; 2024-01-23), MediaWiki-Platform-Team (Radar), Observability-Metrics

Apr 11 2025

Aklapper changed the status of T356814: Migrate MediaWiki.errors.fatal to statslib, a subtask of T350592: EPIC: migrate in use metrics and dashboards to statslib, from In Progress to Open.

Apr 11 2025, 10:20 PM · SRE Observability (FY2024/2025-Q4), MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), Epic, MW-1.42-notes (1.42.0-wmf.15; 2024-01-23), MediaWiki-Platform-Team (Radar), Observability-Metrics

aaron renamed T391364: [SPIKE] Add a statslib counter for the LoadBalancer::runPrimaryTransactionIdleCallbacks errors from [SPIKE] Add a statslib counter for the incredible amount of logs to [SPIKE] Add a statslib counter for the LoadBalancer::runPrimaryTransactionIdleCallbacks errors.

Apr 11 2025, 6:10 PM · MW-Interfaces-Team (MW-Sprint-9 (2025-05-07 to 2025-05-20)), MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), Patch-For-Review, MW-1.42-notes, MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), MediaWiki-libs-Rdbms, Observability-Logging

ssastry assigned T373480: Display categories in sorted order by default to cscott.

Apr 11 2025, 5:43 PM · Content-Transform-Team (Work In Progress), MediaWiki-Categories, MediaWiki-User-Interface, Parsoid-Read-Views (Phase 1 - DiscussionTools support), MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), User-notice

Jdforrester-WMF closed T389450: Upgrade from Sinon 1.x to Sinon 18, a subtask of T250045: Clean up QUnit test runner for MW (2020), as Resolved.

Apr 11 2025, 12:37 PM · MW-1.44-notes (1.44.0-wmf.23; 2025-04-01), MW-1.43-notes (1.43.0-wmf.21; 2024-09-03), MediaWiki-Platform-Team (Radar), Patch-For-Review, Developer Productivity, JavaScript, MediaWiki-Core-Tests