210 likes | 224 Views
FIFTY Shades of Training Proctors and Invigilators for Standardized Test Administration. Granit ZELA Albanian Test Team Head. STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017. Agenda. Standardized test administration validity Invigilator training goals, role, aids/activities
E N D
FIFTY Shades of Training Proctors and Invigilators for Standardized Test Administration Granit ZELA Albanian Test Team Head STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017
Agenda • Standardized test administration validity • Invigilator training goals, role, aids/activities • Invigilator responsibilities: prior, during, at end of the test 4. Test cheating: test theft, test cheating methods STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017
Standardized Test Administration Validity Test Administration in the Garden of Eden The cheating “Crib Garment” STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 3 3 3
Standardized Test Administration Validity • Test administration according to standardized procedures: uniform testing conditions - uniform test administration 1. The invigilator at one test centre who shows students to their seats is rude and aggressive. 2. Five venues are selected for a speaking test during the summer. One of these is next to a major road where extensive road works have just begun. STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017
Training goals • Fully comprehend what is expected of them for the test administration • Be confident in roles and responsibilities as invigilators • Understand regulations for running tests • Be able to act appropriately in any given circumstances STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 5 5
Invigilator Training • Invigilation training must be mandatory • Tools, knowledge and experience to successfully invigilate • Introduces invigilation practices to perform to the highest level • Addresses trainees concerns • Provides tips and insights STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 6
Invigilator Training aids Power point slides/DVD Links to resources Discussion activities Training notes Information sheets Quizzes Videos Test fraud scenarios Invigilator Handbook STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 7
Prior to testing • Appropriate signage • Acoustic conditions, heating, lighting, ventilation • A quiet testing environment • Clock placed in prominent position • Candidate warning posters • A room seating plan • A Test Checklist of testees • Stationery equipment distributed • Right question papers and candidate materials • Know to operate the equipment • A tested method of calling for assistance STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 8
Prior to testing • Test is in progress as soon as candidates enter the room. • Check the identification of each candidate. • Ensure all mobile phones and electronic devices are handed in • Remove any unauthorised materials from candidates and place • Make sure candidates are seated according to your seating plan. • Check that they have the items they need for the exam. • Distribute test materials • Give clear instructions about the test completion, time limits • State clearly the policy on cheating and theft. • Know procedure for late arrivals STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017
During the testing • Observe candidates all the time • Move around the room • Respond when a candidate asks for help • No advice about the content of the test paper • Look out for any malpractice or candidates looking unwell • Be vigilant for use of hidden electronic communication • If a candidate is disruptive remove them from the room while you resolve the issue. • Maintain the required number of invigilators. • . STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 10
Ending the exam • Inform candidates of the remaining time • Tell candidates to stop writing. • Collection of all materials • Complete relevant documentation • Be committed to test material security • Do not read or allow anyone else to read any of the scripts • Collect any unused stationery or equipment. • Hand the scripts and attendance register • Emergency situations • Leave the scripts and question papers in the exam room • Evacuate the room STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 11 11 11
Traditional malpractice examples • Notes hidden • calculator back • the pencil case • inside Juice box • under the patch • under the sleeves • at a headscarf • in the back of the tie • in the back of the shoe • water bottle label cover • in a tampon • in fingernails • inside the breast • on the thighs • Sneaking into hall before exam and attaching notes below desk • Developing “Mors code”, coughing, tapping desk etc. STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017
High tech examples of malpractice • Concealed ear-phones • Glasses (Small cameras installed) • Smart watches that look like digital watches • Using ultra violet pens and invisible ink pens • Hollowing out pens to write secret notes • Mobile phones • Calculators with memory functions used to hide answers STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 13
Cheating Test Ads and sites in Internet STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017 14
Train invigilators or… STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017
Good invigilators are the solution • Dress smartly, wear the invigilator badge • Be aware of aware of emerging situations • Remain calm, vigilant, professional • Keep a written record of any relevant circumstances – who/what/when • An air of authority, yet relate with test-takers and staff • Maintain confidentiality • Provide a supportive atmosphere Prepare! - Test Invigilators never make assumptions STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017
Conclusion 1. Tests administration is of much more important than it is afforded in language testing literature 2. Practical matters of test administration are critical to test validity - raise validity questions pertaining to fairness, ethics, law and how different cultures view testing and test takers 3. Training Proctors and Invigilators is indispensable in order to ensure a standardized test administration STANAG 6001 Testing Workshop Skopje 5-7 Sept 2017