40 likes | 119 Views
QuWi A Framework for Quality Control in Wikipedia. Karen Uttecht Internet & Web Systems II, 91.514. Background / Related Work. 2005 Study published in Nature showed Wikipedia to have similar quality to the Encyclopedia Britannica for the scientific terms evaluated
E N D
QuWiA Framework for Quality Control in Wikipedia Karen UttechtInternet & Web Systems II, 91.514
Background / Related Work • 2005 Study published in Nature showed Wikipedia to have similar quality to the Encyclopedia Britannica for the scientific terms evaluated • Mizzaro’s Model for scholarly papers • Three Scores: Paper, Author and Reader • Paper – scored based on feedback from the reader • Author – scored based on the score of the papers they have authored • Reader – scores based on how high quality their judgments about papers are (how far from average) • Steadiness value measures how much scores change over time
QuWi – Applying Mizzaro’s Modelto the Wikipedia • Implicit Judgments instead of explicit judgments • Edits = Negative Judgment on Author, Document • Large, sweeping edits are a strongly negative judgment against the whole document • Small edits are a negative judgment against the edited portion of the document, but positive for the rest of the document that was left alone. • Proximity is taken into account, pieces far away from the edited portion do not get as much of a positive judgment as those closer. • Reversion = Positive for original piece, negative for editor
Does it work? • Tested their system against the history (6 major checkpoints) of the Italian Wikipedia • Found the system was consistent with human judgment • In this case the ‘featured articles’ were consistent with highly rated articles • Articles proposed for deletion were low rated articles • Outliers tended to be controversial topics, like ‘Suicide’ and ‘Abortion’