Mailing List Archive

Production Excellence #24: September 2020
???? Read on Phabricator at
https://phabricator.wikimedia.org/phame/post/view/205/
-------

How’d we do in our strive for operational excellence last month? Read on to
find out!

???? *Incidents*

5 documented incidents. [1] Historically, that's right on average for the
time of year. [3]

For more about recent incidents see Incident documentation
<https://wikitech.wikimedia.org/wiki/Incident_documentation> on Wikitech,
or Preventive measures
<https://phabricator.wikimedia.org/project/view/4758/> in Phabricator.

-------

???? * Trends*

For month-over-month plots, see this spreadsheet
<https://docs.google.com/spreadsheets/d/1tRCh8aB0UYyLlhftvcHvhWH4-e7cF5V01XvRObTVgUI/edit?usp=sharing>.
[5]

-------

???? * Outstanding errors*

Take a look at the workboard and look for tasks that could use your help.
? https://phabricator.wikimedia.org/tag/wikimedia-production-error/

Summary over recent months:

- ?? July 2019 (4 of 18 tasks left): *no change*.
- ?? August 2019 (1 of 14 tasks left): *no change*.
- ?? September 2019 (3 of 12 tasks left): *no change*.
- ?? October (6 of 12 tasks left), *no change*.
- November (3 of 5 tasks left): *no change*.
- December (3 of 9 tasks left), *no change*.
- January 2020 (4 of 7 tasks left), One task closed.
- February (2 of 7 tasks left), *no change*.
- March (2 of 2 tasks left), *no change*.
- April (10 of 14 tasks left): *no change*.
- May (7 of 14 tasks left): *no change*.
- June (7 of 14 tasks left): Three tasks closed.
- July 2020 (10 of 24 new tasks
<https://phabricator.wikimedia.org/maniphest/query/s__D8Kd0xuQH/#R>):
Three tasks closed.
- August 2020 (31 of 53 new tasks
<https://phabricator.wikimedia.org/maniphest/query/hu1yhWu4sXkP/#R>):
Six tasks closed.
- *September 2020*: 17 of 33 new tasks
<https://phabricator.wikimedia.org/maniphest/query/CGFQViLShnOY/#R>
survived the month of September and remain open today.

Recent tally:
106 as of Excellence #23
<https://phabricator.wikimedia.org/phame/post/view/204/production_excellence_23_july_august_2020/>
(Sep 23rd).
-13 closed of the 106 recent tasks.
+17 survived September 2020.
110 as of today, Oct 23rd.

Previously
<https://phabricator.wikimedia.org/phame/post/view/204/production_excellence_23_july_august_2020/>,
we had 106 unresolved production errors from the recent months up to
August. Since then, 13 of those were closed. But, the 18 errors surviving
September raise our recent tally to 110.

The workboard overall (including errors from 2019 and earlier) holds 343
open tasks in total, an increase of +47 compared to the 296 total on Sept
23rd.

-------
???? *Thanks! *

Thank you to everyone else who helped by reporting, investigating, or
resolving problems in Wikimedia production. Thanks!

Until next time,

– Timo Tijhof
-------

Footnotes:

[1] Incidents. –
https://wikitech.wikimedia.org/wiki/Incident_documentation#2020
[2] Open tasks. –
https://phabricator.wikimedia.org/maniphest/query/Fw3RdXt1Sdxp/#R
[3] Wikimedia incident stats. – https://codepen.io/Krinkle/full/wbYMZK
[4] Month-over-month plots. –
https://docs.google.com/spreadsheets/d/1tRCh8aB0UYyLlhftvcHvhWH4-e7cF5V01XvRObTVgUI/edit?usp=sharing