420 likes | 433 Views
ASME SELECTION April 28 th 2010. MTAS. ASME SELECTION SOME CURRENT PROBLEMS. Scant recognition of performance . MARKS IN MRCP. MARKS. Medical Schools. McManus BMC Med 2008;6:5. ASME SELECTION SOME CURRENT PROBLEMS. Scant recognition of performance White space boxes
E N D
ASME SELECTIONSOME CURRENT PROBLEMS • Scant recognition of performance
MARKS IN MRCP MARKS Medical Schools McManus BMC Med 2008;6:5
ASME SELECTION SOME CURRENT PROBLEMS • Scant recognition of performance • White space boxes • Non-discriminating
ASME SELECTION SOME CURRENT PROBLEMS • Scant recognition of performance • White space boxes • Non-discriminating • Plagiarism
ASME SELECTION SOME CURRENT PROBLEMS • Scant recognition of performance • White space boxes • Non-discriminating • Plagiarism • Tedious + expensive to mark
ASME SELECTION SOME CURRENT PROBLEMS • Scant recognition of performance • White space boxes • Interviews
ASME SELECTION SOME CURRENT PROBLEMS • Scant recognition of performance • White space boxes • Interviews • Single station OSCEs
ASME SELECTION SOME CURRENT PROBLEMS • Scant recognition of performance • White space boxes • Interviews • Single station OSCEs • Different marks system by deanery
ASME SELECTION SOME CURRENT PROBLEMS • Scant recognition of performance • White space boxes • Interviews • Single station OSCEs • Different marks system by deanery • Stick or twist on offers
ASME SELECTION SOME CURRENT PROBLEMS • Scant recognition of performance • White space boxes • Interviews • Single station OSCEs • Different marks system by deanery • Stick or twist on offers • “Commitment to specialty”
IDEAL SELECTION SYSTEM • Transparent • Fair • Objectively chooses best
IDEAL SELECTION SYSTEM • Transparent • Fair • Objectively chooses best • Simple – uses existing data if possible • Cost effective • Avoids cheating / plagiarism • Avoids stick or twist • Consistent (+ Regulated)
FUTURE DIRECTIONS?Foundation • National applied knowledge test • as a component
FUTURE DIRECTIONS?Foundation • National applied knowledge test • as a component • Patient safety requires a knowledgeable doctor
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting • Interview everyone if low numbers?
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting • Interview everyone or • Computer based CPS/SJT to weed out the very poor
MARKS IN MRCP MARKS Medical Schools McManus BMC Med 2008;6:5
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting • Interview everyone or • Computer based CPS/SJT • Available for weeks
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting • Interview everyone or • Computer based CPS/SJT • Available for weeks • Changing equated questions
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting • Interview everyone or • Computer based CPS/SJT • Available for weeks • Changing equated questions • Single broad SJT
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting • Interview everyone or • Computer based CPS/SJT • Available for weeks • Changing equated questions • Single broad SJT – use specialty relevant questions
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting? • Selection centre – marks for communication and desired skills -eg • Working under pressure • Organisation
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting? • Selection centre – marks for communication and desired skills -eg • Working under pressure • Organisation • Add % for knowledge from CPS/SJT
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting? • Selection centre – marks for communication and desired skills -eg • Working under pressure • Organisation • Add % for knowledge from CPS/SJT • TOTAL SCORE
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting? • Selection centre • Single national process
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting? • Selection centre • Single national process • OR IF marking criterion referenced and reproducible
FUTURE DIRECTIONS?ST1/CT1 • ALL SUBJECT TO PILOTING • Shortlisting? • Selection centre • Single national process • OR IF marking criterion referenced and reproducible, regional selection centres can cascade unsuccessful candidates’ marks to other regions
FUTURE DIRECTIONS?ST3/4 • Feasible to interview all in more specialties as smaller numbers
FUTURE DIRECTIONS?ST3/4 • Feasible to interview all in more specialties • Develop objective marker of progress • NOT WORKPLACE ASSESSMENT
FUTURE DIRECTIONS?ST3/4 • Feasible to interview all in more specialties • Develop objective marker of progress • NOT WORKPLACE ASSESSMENT • ? Summative assessment • ? College exams • ??
FUTURE DIRECTIONS?ST3/4 • Feasible to interview all in more specialties • Develop objective marker of progress • Detailed selection centre
OTHER REQUIREMENTS • Much better career guidance
OTHER REQUIREMENTS • Much better career guidance • Robust advice from Yr 1- inc CRs • “50% will be GPs”
OTHER REQUIREMENTS • Much better career guidance • Offers period
OTHER REQUIREMENTS • Much better career guidance • Offers period • Computer matching/cascade system • within and across specialties
OTHER REQUIREMENTS • Much better career guidance • Offers period • Computer matching/cascade system • within and across specialties • Matching CT with ST3 numbers
OTHER REQUIREMENTS • Much better career guidance • Offers period • Computer matching/cascade system • within and across specialties • Matching CT with ST3 numbers • Willingness to accept doctors with experience into different specialty
OTHER REQUIREMENTS • Much better career guidance • Offers period • Computer matching/cascade system • within and across specialties • Matching CT with ST3 numbers • Willingness to accept doctors with experience into different specialty • English language ability