120 likes | 304 Views
Are we ready for large scale use of plagiarism detection tools?. Ruth Barrett, James Malcolm, Caroline Lyon, Univ. of Hertfordshire. Plagiarism detection. Four stages Collection Analysis Verification Investigation (Culwin & Lancaster www.ilt.co.uk). Plagiarism detection tools used… .
E N D
Are we ready for large scale use of plagiarism detection tools? Ruth Barrett, James Malcolm, Caroline Lyon, Univ. of Hertfordshire
Plagiarism detection Four stages • Collection • Analysis • Verification • Investigation (Culwin & Lancaster www.ilt.co.uk) Ruth Barrett LTSN-ICS conference August 2003
Plagiarism detection tools used… • to help with verification of plagiarism • to analyse ALL texts for potential plagiarism • to treat students consistently • to deter students • to value students’ work • to help students • because we can? Ruth Barrett LTSN-ICS conference August 2003
J reduced clerical procedures files more portable convenient for students L problems with file formats restrictive way of marking IT skills required Electronic submission Ruth Barrett LTSN-ICS conference August 2003
Turnitin Submission to turnitin by • students • individual lecturer or administrator • batch processing Batch is time consuming and error prone Ruth Barrett LTSN-ICS conference August 2003
Turnitin class inbox Ruth Barrett LTSN-ICS conference August 2003
Turnitin originality report Ruth Barrett LTSN-ICS conference August 2003
Ferret • files in a folder on own PC • each file compared with every other file • produces a set of common 3 word phrases (trigrams) for each file pair • displays table of file matches • also displays file-pairs side-by-side • lecturer looks for blocks of blue text Ruth Barrett LTSN-ICS conference August 2003
Turnitin file116 97% match 1 www file72 30% match 114,14% 88 file30 27% match with 43 file130 19% match 15 www file114 29% match with 72 file 25 3% match with 11 Ferret file-pair 114 & 72 0.213 file-pair 30 & 43 0.144 file-pair 72 & 88 0.127 file-pair 30 & 65 0.100 file-pair 114 & 88 0.060 file-pair 114 & 115 0.051 file-pair 47 & 72 0.049 file-pair 47 & 61 0.048 file-pair 114 & 47 0.038 file-pair 12 & 47 0.036 Plagiarism analysis Ruth Barrett LTSN-ICS conference August 2003
Are we ready for large scale use of plagiarism detection tools? not quite! • technically possible • can students follow instructions? • do staff have the time/motivation? • the real work comes in investigation! Ruth Barrett LTSN-ICS conference August 2003