The Observability team proposes a "value-first" approach for the migration process. This means we will prioritize migrating "high value" targets first, covering the most frequently used metrics and dashboards before moving on to less commonly used ones. However, before proceeding with the migration, we need to have an initial snapshot of what this approach entails as of 2024-01-08

Please note the following steps to follow roughly per every conversion:

1. Identify the metric (or group of metrics) that will be to be converted.
2. Create/assign a Phabricator subtask linked to this task (with granularity of individual metric or group of metrics) and update task description to reflect which task(s) have been created for which metric(s).
3. Follow the migration process as outlined below.
4. Secure/Conduct code review(s).
5. Deploy the changes to production via the train (https://wikitech.wikimedia.org/wiki/Deployments/Train).
6. Verify that the changes have been successfully implemented.
7. Place the metrics subtask in a 2-3 week waiting period to allow prometheus time to establish 2-3 weeks of metric history
8. After 2-3 week waiting period is complete, update the dashboard:
   • Save a copy of the dashboard using legacy metrics as-is into the Legacy grafana dashboard folder
   • Replace the old Graphite metric(s) with the new Prometheus metric(s) and save/update the live dashboard

Please follow the guidelines and standards outlined in the provided documentation:

• https://www.mediawiki.org/wiki/Manual:Stats for detailed guidance on the conversion process.
• https://drive.google.com/file/d/12yQEuOapkML1vb9MgCaX1QzbLBdXE6X2/view for a video tutorial on the conversion process.
• https://docs.google.com/presentation/d/1SZWf_D3mWNX-XHN8PHYI84LDZr6GUQC2AMhZ9mQXCI0/edit#slide=id.g2795460c956_0_23 for slides on the best practices for converting metrics to statslib.

Full List of MediaWiki Metrics used in Grafana Dashboards as of 2023-01-08: P54551

Overall Grafana Graphite datasource utilization, count by usage in queries P54396

--Migration Progress Dashboard --- Dashboards using Graphite--

Metrics to Migrate

Below is a full list of graphite metrics to be migrated, grouped by component. Please claim the task for ongoing work or any metrics/components under your care and proceed with the migration; if you need help, please contact SRE Observability.

Please use this template when creating metric migration subtasks

Core:

• T354905: migrate MediaWiki.timing.editResponseTime to statslib
• T359236: Migrate MediaWiki.timing.login.ui.$authAction.sample_rate to statslib
• T356812: Migrate MediaWiki.edit.failures.* to statslib
• T356814: Migrate MediaWiki.errors.fatal to statslib
• T356815: Migrate MediaWiki.stable_pcache to statslib
• T359240: Migrate MediaWiki.diff_cache.* to statslib
• T359241: Migrate MediaWiki.diff_time.* to statslib
• T359242: Migrate MediaWiki.rollbackconfirmation.event.load.sum to statslib
• T359243: Migrate MediaWiki.site.*.count to statslib

Performance:

• T356817: Migrate mw.performance.save* to statslib

ContentTranslation:

• T359237: (mw.track) Migrate MediaWiki.cx.campaign.*.accept to statslib
• T359238: Migrate MediaWiki.cx.publish.highmt.*.sum to statslib
• T359239: (mw.track) Migrate MediaWiki.cx.publish.*.sum to statslib

Collection:

• T359235: Migrate MediaWiki.collection.renderingpage.finished.sum to statslib

RevisionSlider:

• T354907: (mw.track) migrate MediaWiki.RevisionSlider.timing.init to statslib
• T359245: Migrate daily.revslider.userprops.disables to statslib
• T359244: (mw.track) Migrate MediaWiki.RevisionSlider.* to statslib

Wikibase:

• T354909: migrate MediaWiki.wikibase.quality.constraints.type.php.success.entities to statslib
• T359247: [GRAFMIGR] Migrate MediaWiki.wikibase.articleplaceholder.button.create*.count to statslib
• T359246: [GRAFMIGR] Migrate MediaWiki.wikibase.quality.constraints.* to statslib
• T359248: [GRAFMIGR] Migrate MediaWiki.wikibase.client.pageupdates.* to statslib
• T359249: [GRAFMIGR] Migrate MediaWiki.wikibase.lexeme.special.NewLexeme to statslib
• T359250: [GRAFMIGR] Migrate MediaWiki.wikibase.query_contexts.* to statslib
• T359251: [REPO][SW][GRAFMIGR] (mw.track) Migrate MediaWiki.wikibase.repo.* to statslib
• T359252: [GRAFMIGR] Migrate MediaWiki.wikibase.view.* to statslib
• T359253: [CLIENT][SW][GRAFMIGR] Migrate MediaWiki.$prefix.wikibase.client.scribunto.* to statslib
• T359254: Migrate MediaWiki.wikidatawiki.wikibase.repo.* to statslib

Parsoid:

• T354908: evaluate and migrate in-use parsoid metrics to statslib
• T359453: Migrate MediaWiki.Parsoid.html2wt to statslib
• T359454: Migrate MediaWiki.Parsoid.entry.html2wt to statslib
• T359455: Migrate MediaWiki.Parsoid.entry.wt2html to statslib
• T359457: Migrate MediaWiki.Parsoid.extension.* to statslib
• T359402: Migrate MediaWiki.parsoidhelper.stashing to statslib
• T359395: Migrate MediaWiki.Parsoid.html2wt to statslib
• T359394: Migrate MediaWiki.parsoidhtmlhelper. to statslib
• T359393: Migrate MediaWiki.Parsoid.langconv to statslib
• T359392: Migrate MediaWiki.Parsoid.linting to statslib
• T359391: Migrate MediaWiki.ParsoidOutputAccess.Cache to statslib
• T359390: Migrate MediaWiki.parsoid_pcache.*.reason.*.rate to statslib
• T359389: Migrate MediaWiki.parsoid.*.reason.*.rate to statslib
• T359388: Migrate MediaWiki.Parsoid.wt2html.* to statslib

Resourceloader:

• T355960: Migrate MediaWiki.resourceloader* metrics to statslib
• T359396: Migrate MediaWiki.resourceloader_build to statslib
• T359397: Migrate MediaWiki.resourceloader_module_decodedsize_bytes to statslib
• T359398: Migrate MediaWiki.resourceloader_startup_bytes to statslib

TwoColConflict:

• T359261: mw.track() Migrate MediaWiki.TwoColConflict.* to statslib
• T359262: Migrate daily.twocolconflict.userprops.* to statslib

Centralauth:

• T359263: Migrate MediaWiki.centralauth.* to statslib

Authmanager

• T359264: Migrate MediaWiki.authmanager.* to statslib

Betafeatures:

• T359339: Migrate daily.betafeatures.* to statslib

CirrusSearch:

• T359033: EPIC: Convert CirrusSearch metrics to statslib

AdvancedSearch:

• T359342: Migrate daily.advancedsearch.userprops.disables to statslib
• T359341: (mw.track) Migrate MediaWiki.AdvancedSearch.event.* to statslib

Media:

• T359344: Migrate MediaWiki.media.thumbnail.* to statslib
• T359345: (mw.track) Migrate media.thumbnail.client.* to statslib

Echo:

• T359346: Migrate daily.echo.mentionStatus.global_user_counts.totals.* to statslib
• T359347: (mw.track) Migrate MediaWiki.echo.* to statslib

Catwatch:

• T359349: Migrate daily.catwatch.* to statslib
• T359350: Migrate MediaWiki.$type.* to statslib

GrowthExperiments:

• T359351: Migrate MediaWiki.$wiki.GrowthExperiments to statslib
• T359352: Migrate GrowthExperiments Extension to statslib
• T359353: Migrate MediaWiki.*.growthexperiments.* to statslib
• T359354: Migrate MediaWiki.*.GrowthExperiments.AddLink.growthexperiments_addlink_notinstore.count to statslib
• T359355: Migrate MediaWiki.GrowthExperiments to statslib
• T359356: Migrate MediaWiki.timing.growthExperiments.* to statslib

MediaModeration:

• T359357: Migrate MediaModeration Extension to statslib

Abusefilter:

• T359359: Migrate AbuseFilter Extension to statslib
• T359360: Migrate MediaWiki.abusefilter.check_stash to statslib
• T359361: Migrate MediaWiki.abusefilter.runtime_profile to statslib
• T359362: Migrate MediaWiki.action to statslib

AdvancedSearch:

• T359363: Migrate MediaWiki.AdvancedSearch.event to statslib

API:

• T359383: Migrate MediaWiki.api to statslib

Arclamp:

• T359385: Migrate MediaWiki.arclamp to statslib

Articleplaceholder:

• T359386: (Analytics?) Migrate MediaWiki.articleplaceholder to statslib

BlockNotices:

• T359458: Create Prometheus-backed dashboard for BlockNotices

Bouncehandler:

• T359459: Migrate MediaWiki.bouncehandler to statslib

Chrome:

• T359460: Migrate MediaWiki.chrome.100.browsertime.statistics to statslib

CodeMirror:

• T359461: (Analytics?) Migrate MediaWiki.CodeMirror to statslib

Cognate:

• T359462: Migrate MediaWiki.Cognate.Repo to statslib

Discussiontools:

• T359463: Migrate MediaWiki.discussiontools.addReplyLinks to statslib

Editor:

• T359464: Migrate MediaWiki.editor.milestones.timing.1.median to statslib

Editstash:

• T359465: Migrate MediaWiki.editstash to statslib

Electronpdf:

• T359466: Migrate MediaWiki.electronpdf to statslib
• T359467: (mw.track) Migrate MediaWiki.EntitySchema to statslib
• T359468: Migrate MediaWiki.errors.fatal.rate to statslib
• T359470: Migrate MediaWiki.extdist to statslib

PageTriage:

• T359471: Migrate MediaWiki.extension.PageTriage to statslib

Phonos:

• T359485: Migrate MediaWiki.extension.Phonos to statslib

ExternalGuidance:

• T359484: Migrate MediaWiki.ExternalGuidance to statslib

FileImporter:

• T359481: Migrate MediaWiki.FileImporter to statslib

Firefox:

• T359482: Migrate MediaWiki.firefox.100.browsertime.statistics to statslib

Global_Blocking:

• T359480: Migrate MediaWiki.global_blocking to statslib

Globalwatchlist:

• T359479: Migrate MediaWiki.globalwatchlist to statslib
• T359478: Migrate MediaWiki.hooks.*.count to statslib

Html2wt:

• T359477: Migrate MediaWiki.html2wt to statslib

Html:

• T359475: Migrate MediaWiki.html_input_transform.original_html to statslib
• T359476: Migrate MediaWiki.htmloutputrendererhelper to statslib

ipinfo:

• T359474: Migrate MediaWiki.ipinfo_address_copy to statslib

Jobexecutor:

• T359473: Migrate MediaWiki.jobexecutor.*.exec to statslib

Jobqueue:

• T359472: Migrate MediaWiki.jobqueue to statslib

Loadbalancer:

• T359382: Migrate MediaWiki.loadbalancer.lag to statslib

Loginnotify:

• T359381: Migrate MediaWiki.loginnotify.* to statslib

Mediamoderation:

• T359380: Migrate MediaWiki.mediamoderation.photodna.* to statslib

Media:

• T359379: Migrate MediaWiki.media.thumbnail to statslib

Minerva:

• T359377: Migrate MediaWiki.minerva.WebClientError.count to statslib

Mobile:

• T359378: Remove MediaWiki.mobile.* metrics

Objectcache:

• T359376: Migrate MediaWiki.objectcache.* to statslib

Pagedtiffhandler:

• T359373: Migrate MediaWiki.pagedtiffhandler.shell.retrieve_meta_data.rate to statslib

PageStore:

• T359374: Migrate MediaWiki.PageStore.LinkCache to statslib

ParserOutput:

• T359372: Migrate MediaWiki.ParserOutputAccess.* to statslib

Pcache:

• T359368: Migrate MediaWiki.pcache.* to statslib
• T359370: Migrate MediaWiki.pdfhandler.shell.retrieve_meta_data.rate to statslib

RateLimiter:

• T359367: Migrate MediaWiki.RateLimiter to statslib

Rdbms_trxprofiler:

• T359366: Migrate MediaWiki.rdbms_trxprofiler_warnings to statslib

Refreshlinks:

• T359365: Migrate RefreshLinksJob to statslib

Rest_api:

• T359364: Migrate MediaWiki.rest_api to statslib

RevisionOutputCache:

• T359278: Migrate MediaWiki.RevisionOutputCache.* to statslib

RevisionSlider:

• T359277: (mw.track) Migrate MediaWiki.RevisionSlider to statslib

Score:

• T359276: Migrate MediaWiki.score* to statslib

Scribunto:

• T359275: Migrate MediaWiki.scribunto.traces.* to statslib

Setup_load_schema:

• T359274: Delete dashboards referencing MediaWiki.setup_load_schema_count

Spamblock:

• T359273: Migrate MediaWiki.spamblacklist.check_stash.* to statslib

Stable_pcache:

• T359272: Migrate MediaWiki.stable_pcache to statslib

Syntashilight:

• T359270: Migrate MediaWiki.syntaxhighlight_shell.*.rate to statslib

TemplateData:

• T359271: (Analytics?) Migrate MediaWiki.TemplateData to statslib

TemplateWizard:

• T359269: (Analytics?) Migrate MediaWiki.TemplateWizard to statslib

Timeline_error:

• T359268: Migrate MediaWiki.timeline_* to statslib

Timing:

• T359267: Migrate MediaWiki.timing to statslib

Tmp_settings_load:

• T359266: Migrate MediaWiki.tmp_settings_load.* to statslib

Translate:

• T359265: Migrate MediaWiki.translate.slow_translatable_page_check.* to statslib

TTFE:

• T359260: Migrate MediaWiki.ttfe.median to statslib

VisualEditor:

• T359259: Migrate MediaWiki.VE.ApiVisualEditor.ParsoidClient.* to statslib
• T359258: (Analytics?) Migrate MediaWiki.VisualEditor.* to statslib

Wanobjectcache:

• T359257: Migrate MediaWiki.wanobjectcache. to statslib

WatchedItemStore:

• T359256: Migrate MediaWiki.WatchedItemStore.* to statslib

Wmfstatic

• T359255: Migrate MediaWiki.wmfstatic.* to statslib