Change 767266 had a related patch set uploaded (by Samwilson; author: Samwilson):

[mediawiki/extensions/WikiEditor@master] Allow tool.element to be a function

https://gerrit.wikimedia.org/r/767266

Grafana graphs at https://grafana-labs.wikimedia.org/d/toolforge-k8s-namespace-resources/kubernetes-namespace-resources?orgId=1&var-namespace=tool-pageviews&refresh=5m&from=1644293615666&to=1644898415666 but I can't make much inference aside from where I added the two additional k8s pod replicas.

As far as I can tell, the issue with unavailable sockets / not enough ports seems to have gone away or is no longer appearing error.log, but I'm still seeing a lot of failed requests in the UI. I do see we're exceeding our connection quota for the replicas at times:

2022-02-15 03:37:06: (mod_fastcgi.c.421) FastCGI-stderr: PHP Warning:  mysqli::__construct(): (HY000/1226): User 's52877' has exceeded the 'max_user_connections' resource (current value: 10) in /data/project/pageviews/public_html/pageviews/api.php on line 56

but this is not as frequent as the requests I see timing out in the network log, so I don't think that's it. (It's not unusual to occasionally hit the max_user_connections error).

So, Pageviews Analysis is mostly written in JavaScript, and makes API requests to a PHP script to query the replicas and get editing data. It seems presumably due to increased traffic, we're running out of local ports to serve:

As critical maintenance I'm filing this under Community-Tech. Investigation in progress.

Change 761867 merged by jenkins-bot:

[mediawiki/extensions/WikiEditor@master] Check for disabled button in click handler

https://gerrit.wikimedia.org/r/761867

Change 761873 merged by jenkins-bot:

[mediawiki/extensions/WikiEditor@master] Remove out of date invalid link alert

https://gerrit.wikimedia.org/r/761873

Change 761873 had a related patch set uploaded (by Samwilson; author: Samwilson):

[mediawiki/extensions/WikiEditor@master] Remove out of date invalid link alert

https://gerrit.wikimedia.org/r/761873

Thanks for finding this @dom_walden. There was me thinking that a disabled button would be protected against being clicked, but no!

Change 761867 had a related patch set uploaded (by Samwilson; author: Samwilson):

[mediawiki/extensions/WikiEditor@master] Check for disabled button in click handler

https://gerrit.wikimedia.org/r/761867

@Samwilson I am finding that when I open the "Insert link" dialog and press enter, it inserts an empty link ([[]]). Both on beta and my local docker.

Change 752597 merged by jenkins-bot:

[mediawiki/extensions/WikiEditor@master] Properly disable insert-link button

https://gerrit.wikimedia.org/r/752597

We still need to confirm the behaviour of the multiple different vertical resizing systems: at the moment, the core text area has one (via CSS resize), MediaWiki-extensions-CodeMirror has one (via jQuery UI resizable), and we're introducing a third. Do we want to have a vertical-resize bar always present, even before realtime preview is open? This would make it simpler and reduce the number of different UI elements, and (my favourite reason) it means we can get rid of one more small bit of jQuery UI (from CodeMirror).

woooohooot for cross team magics! resolved!

thanks for your help and input and @Jessamyn and thanks for solutioning @Samwilson

Since this ticket has helped us scope out more specific work in the tickets @Samwilson has cut, we are resolving this one and using the others as more detailed work.