130 likes | 293 Views
Getting the right students to use self-assessments. Nancy Curtin. Photo by Pradeep Luther. Self-tests for Yr1 & 2 of our 6-yr Medical Course. Some facts about Yr1: Student intake of ~ 300
E N D
Getting the right studentsto use self-assessments Nancy Curtin Photo by Pradeep Luther
Self-tests for Yr1 & 2 of our 6-yr Medical Course Some facts about Yr1: Student intake of ~ 300 Teaching content : 22 courses (cardiovascular system, etc) arranged under 4 Themes (must-pass all exams) 141 different lecturers
LAPT content available via http://www.ucl.ac.uk/lapt/ Self-tests for Yr1 & 2 of our 6-yr Medical Course history: LAPT used at Charing Cross &Westminster Med School, pre-1998 merge with Imperial & evolving since. Yr1 Med Imperial Self-tests In current form: personal laptops & College Runs in LAPT Entered via Blackboard password access, most available all year
A key feature of LAPT: Certainty-based marking Particularly important in medicine: You must recognize when you are sure enough to act, and when you are only guessing and need more info or help. Guessing can be fatal for your patients. Certainty-based marking: you enter your answer and also a number (1, 2 or 3) indicating how sure you are about the answer. Mark depends of whether answer is correct or not, and also on your certainty...
Self-tests for Yr1 & 2 of our 6-yr Medical Course Yr1 Content: 41 exercises matching courses, at least 1 exercise per course 1,405 Questions Aim is that Self-test content maps onto Course content Single-best-answer (most) Extended matching T/F Used in Summative exams
Self-tests for Yr1 & 2 of our 6-yr Medical Course The 41 Exercises: Assembled over several years Mostly drafted by students, then... Content revised by relevant teacher (some) Individual Qs revised in response to LAPT “comments” Occasional weed-out/additions by student group to match Q’s with teaching (me & student union reps organize this)
Cumulative use Number of student sessions 40,000 20,000 0 Sept Jan May Sept *Self-test are used by students: meet their express desire for practice questions.
Number of student sessions 40,000 Jan Formative 20,000 LSS, LCRS, FCP Summative 0 Sept Jan May Sept MCD Summative *Self-test are used by students: meet their express desire for practice questions. *Pattern is similar every year: pre-exam revision, but high for several weeks before Summatives.
Number of student sessions 40,000 Jan Formative 20,000 LSS, LCRS, FCP Summative 0 Sept Jan May Sept MCD Summative *Self-test are used by students: meet their express desire for practice questions. *Pattern is similar every year: pre-exam revision, but high for several weeks before Summatives.
Performance in January Formative: first on-paper test in Med Sch Results for Jan2012 Students who did NOT do Self-tests are about twice as likely to fail as students who did Self tests. Pattern similar every year: Use is a good predictor of Formative performance
Number of student sessions 40,000 Jan Formative 20,000 LSS, LCRS, FCP Summative 0 Sept Jan May Sept MCD Summative *Self-test are used by students: meet their express desire for practice questions. *Pattern is similar every year: pre-exam revision, but high for several weeks before Summatives.
LSS MCD LCRS FCP Results for 2009-2010 For all the exams fail rate more than 2 times higher for students who did not do Self-tests
Self-tests at Imperial: using LAPT & certainty-based-marking A good student-driven learning pattern Students contribute questions High level of student use Use correlates with exam performance But, puzzling lack of use by poorly performing students