240 likes | 843 Views
E-assessment and E-marking 18 May 2006 What’s this all about? Building and maintaining public confidence Creating a positive learner experience E-marking: Student with pen and question/answer book Marker has streamlined admin, less checking E-assessment On screen Taken when ready
E N D
E-assessment and E-marking 18 May 2006
What’s this all about? • Building and maintaining public confidence • Creating a positive learner experience
E-marking: • Student with pen and question/answer book • Marker has streamlined admin, less checking
E-assessment • On screen • Taken when ready • Possibly adaptive tests • Workflow and Workload changes
E-marking: Workflow • Sit exam as normal • Scripts scanned • Scanned images divided and “banked” • Images are marked on screen. Marks automatically collated/checked • Marker performance and progress monitored
Question types: • Auto marking: (OMR or keyed responses) • Multiple Choice • General marking: Short responses, narrow range of answers • Expert marking: Extended responses with need for in-depth subject expertise
Question examples: • Write 6 million in figures? • What colour do leaves turn in Autumn? • Why do leaves change colour in Autumn?
E-marking process provides: • Speed and tracking • Stability of Examiner performance • Built in Quality Assurance – mark scheme, admin, etc. • Item level feedback to test authors • Item level feedback to schools/teachers
Benefits: • Examiner: • Focused use of skills through specialisation • Much less admin • No postal delays or missing scripts • Candidates/Teachers: • Confidence in results • Greater access to detail
E-assessment: A possible scenario • Items authored, validated and “banked” • Test created from banked items following psychometric rules • Test published electronically and distributed to candidates for specific time slot • Centres (or Candidates) receive a mark shortly after completing the test
Students say “The On screen experience is different”: • Easier to respond (neater, hand doesn’t ache, spell check) • Like computers (fun, novelty, like a game, modern) • Pictures, colour • Easier to change answers
But students also see disadvantages… • Typing skills…Quicker to write • Computer crash/breakdown/Viruses • Eye strain • Hacking…Cheating? • Harder to revise answers • Need paper and pencil as well • Too informal
E-Assessment: We must ensure… • Fairness: Different tests on different days • Validity: Testing the right attributes • Relevance to the learner
Assessment: What’s important? • Public confidence • Learner experience • Relevance for Next Career step
E-Assessment: • Beginning of understanding • Wide opportunities
E-Assessment: • Beginning of understanding • Wide opportunities • Build Confidence • Manage pace Technology improving assessment