1 / 17

Blueprint analysis and feedback based on the Progress Test

Blueprint analysis and feedback based on the Progress Test. Lee Coombes Jeff Stratford. Progress Test. 125 MCQ items, 4 times a year Don’t Know option (negative marking) 1 formative test, 19 summative All students take the same test Set at the level of a newly qualified doctor.

nathan
Download Presentation

Blueprint analysis and feedback based on the Progress Test

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Blueprint analysis and feedback based on the Progress Test Lee Coombes Jeff Stratford

  2. Progress Test • 125 MCQ items, 4 times a year • Don’t Know option (negative marking) • 1 formative test, 19 summative • All students take the same test • Set at the level of a newly qualified doctor

  3. Progress Test

  4. Student Feedback

  5. Blueprinting • Based on the GMC PLAB blueprint • 17 domains, 17 Skills • Classified by main question theme • Some areas have more questions than others • Aim has been to provide detailed feedback on each area for students • Both single test and aggregated yearly average

  6. Student Feedback • ATLAS

  7. Questions • How can we use the information? • Provides valuable feedback • Differences in gender/ethnic groups? • We’ve previously seen gender and ethnicity differences in the data • Are these general, or specific to certain areas?

  8. Methods • Tests covering 7 year period • 2006/07 to 2012/13 • Examining the 20 tests students take • Different tests are grouped together • No adjustment for test difficulty • # items varies in each test/skill/domain

  9. PCMD Progress Test

  10. Gender

  11. Gender Domain: Neurological Skill: Pathology

  12. Gender Domain: Women's Health Skill: Diagnosis

  13. Ethnicity

  14. Ethnicity Domain: Neurological Domain: Digestive

  15. Ethnicity Skill: Management Plan Skill: Diagnosis

  16. Conclusions • Gender differences are skill/domain specific • Ethnic difference appears more general • Caused by the test, or is the test accurately measuring pre-existing differences? • Evidence of similar differences elsewhere • What role do other demographics play? • Home\EU\Other • Entry Type (Graduate\Adult)

  17. Thank You Lee Coombes Jeff Stratford

More Related