310 likes | 406 Views
Can we rely on text originality check systems?.
E N D
TOCS limited ability to detect plagiarism means that we cannot wholly rely on a technical system to detect plagiarism and cheating. Instead, additional strategies against plagiarism and cheating are needed. Examples of such strategies are the use of recurrent drafts, peer reviews, portfolio methods and new exam designs.
Canwerely on text originalitycheck systems?Evaluationofthree systems used in highereducation and suggestion of a new methodological testapproachFrey Appelgren Heyman, Mattias Olofsson, Henrik Hansson, Jan Moberg, Ulf Olsson
To whichdegreedoesoriginality check systems detectplagiarism? Whichoriginality check system is best suited for a universitylecturer’sneeds?
The studywasconducted in conjunctionwith the procurementof the new national agreementfor originality check systems at Swedish Universities and Stockholm University'sown tests. • Three systems weresubmittedfor tenders in the national procurement in 2011 and thereforeselected in thisstudy.
GenuineText- Developer: Knownet AB Turnitin- Developer: iParadigms Urkund – Developer: Prio Infocenter AB
The followingaspectswereevaluated: • 1. Time for searching • 2. Identificationofplagiarised text • 3. The design of the originalityreport
The followingaspectswere not evaluated: • Howthe systems handletables, images or source code • Easytouse as standalone • Howto save the reportwithcomments for storing in anothersystem • EasytouseintegratedwithLMS • Howtointegratewith LMS
To assess the effectivenessof the text matching systems toidentifyplagiarisedreferences, we: usedpiecesof text from longer texts wehave chosen. The extractswerecombined in sevendocumentsand thensubmitted.
The selectionofthe test texts (references) wasmadeusingfour different selectionmethods: • Selectionfrom the University librarycollectionsincludingdatabases by librarians • Randomselectionof texts • Selectionofdisciplinespecific texts obtained from different universitydepartments • Selectionof relevant material from websites
Conclusion 1Data suggestTurnitin as the best suitedoriginality check system for the needsofuniversitylecturers. This system wassuperior in terms of all three major areas evaluated: a) timefor searching, b) identificationofplagiarised text, and c) the design of the originalityreport.
Conclusion 2The systems canonlyfindsomeof the plagiarised texts thatwere in the test documents. 20 (12%), 63 (38%) and 84 (50%) identifiedplagiarised texts of 167 possiblemeansthatthese systems cannot be consideredreliablesearchengines.If this is a big problem or not depends on whetherlecturersexpectthat the systems willfindmorethanwhattheyareactuallydoing.
Conclusion3Originality check systems limitedabilitytodetectplagiarismmeansthatwecannotwhollyrely on a technical system todetectplagiarism and cheating. Instead, additionalstrategiesagainstplagiarism and cheatingareneeded. Examplesofsuchstrategiesare the useofrecurrent drafts, peerreviews, portfolio methods and new exam designs.
NextstudyOriginality check system as oneofseveral softwares to support the academicwriting process