200 likes | 339 Views
Future Perspectives in assessment in vocational training. Dr Justin Allen. Do we know where we are going?. Mark Twain. MMC UPDATE. “I’m all for progress, it’s change I can’t cope with”. Is this a problem?. Poor data MCQ, essay and / or oral Examination based on curriculum
E N D
Future Perspectives in assessment in vocational training Dr Justin Allen
Mark Twain MMC UPDATE “I’m all for progress, it’s change I can’t cope with”
Is this a problem? • Poor data • MCQ, essay and / or oral • Examination based on curriculum • Examination set by GPs • GP examiners
Is this a problem? • Poor data • MCQ, essay and / or oral • Examination based on curriculum • Examination set by GPs • GP examiners
Domains to be assessed • Knowledge • Skills • Attitudes • Competence • Performance
Performance Shows how Competence Knows how Knows Does
Performance = Competence + Attributes (Fabb)
DOES – performance – workplace assessment SHOWS HOW – competence – video, simulated patient encounters, skills lab. KNOWS HOW – applies knowledge – extended MCQ, essays, oral examination KNOWS – knowledge tests – MCQ, essays
Traditional Assessment Methods • MCQ • MEQ • Essay • Orals
Performance Shows how Competence Knows how MCQ, MEQ, essay, orals Knows MCQ, MEQ, essay, orals Does
Assessment methods (1) • Evaluation by tutor • Report by tutor • Discussion with work-based teacher • Tutor assessment over time • Observation of consultation • Observation of a simulated consultation
Assessment methods (2) • Assessment in a group • Peer assessment • Patient feedback • Reflective portfolio
Teacher role • Work based • Longitudinal continuity • Observe real performance • Feedback • Judge • Need training
New developments - Foundation • Multi-source feedback • Mini-CEX (Clinical evaluation exercise) • Case based discussion (CBD) • Direct observation of procedural skills (DOPS)
New developments – Foundation (2) • Learner driven • Continuous • Formative and summative (feedback) • Contribute to learning portfolio
New developments – specialty training • MRCGP examination • Knowledge test • Clinical skills assessment • Work-based assessment
Useful websites www.mmc.nhs.uk www.rcgp.org.uk
Future issues • Reliability and validity of patients’ viewpoints • Incorporating patient views into assessment procedures • Feedback and assessment • Society’s expectations of professionals • Critical evaluation • Methods and constructs. • Outcome data • Appraisal of systems