Mailing List Archive

Help evaluating "statement issue detection" system
Help us evaluate[0] our "problematic statement detection" system on
English Wikipedia. We hope to deploy this to help editors.

We are developing an AI to automatically detect issues in articles
related to: NPOV[1], Clarifications[2] and Citations[3]. We need help
evaluating how well the model is working. We are asking for a group of
volunteers to evaluate a set of sentences that are flagged by the AI.
This page[0] has a small set of examples for each issue. We have
included sub-pages that include more examples (e.g. More POV
examples[4]). If you want to help, please assess as many example
statements[0] as you can. The more assessments we get, the better we
can judge our model and make improvements. A brief description of our
research project[5] is on meta.

-With Warm Regards
Sumit Asthana,
PhD Student,
University of Michigan,
Ann Arbor

[0] - https://en.wikipedia.org/wiki/User:Sumit.iitp/Statement_issues
[1] - https://en.wikipedia.org/wiki/Wikipedia:Neutral_point_of_view
[2] - https://en.wikipedia.org/wiki/Wikipedia:Please_clarify
[3] - https://en.wikipedia.org/wiki/Wikipedia:CITE
[4] - https://en.wikipedia.org/wiki/User:Sumit.iitp/Statement_issues/POV
[5] - https://meta.wikimedia.org/wiki/Research:Automatically_labeling_low_quality_content

_______________________________________________
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l