1 / 9

UK Council problems with OSCE assessment Jonathan Silverman 2012

UK Council problems with OSCE assessment Jonathan Silverman 2012. Sacrificed validity for reliability ?. Reliable?. Valid ?. Are the stations apples and pears?. Is it a glorified knowledge test?. Timing of stations compromises validity?. What is the educational impact of all this?.

fgomez
Download Presentation

UK Council problems with OSCE assessment Jonathan Silverman 2012

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. UK Council problems with OSCE assessmentJonathan Silverman 2012

  2. Sacrificed validity for reliability? Reliable? Valid? Are the stations apples and pears? Is it a glorified knowledge test? Timing of stations compromises validity? What is the educational impact of all this? You can never get it right Are you disadvantaging the thoughtful shy student? Has integration compromised the exam? Standard setting and how easy to get it wrong? Integrated but with what? Examiner training effective?

  3. Utility function U = wrR x wvV x weE x waA x wcC • U = Utility • R = Reliability • V = Validity • E = Educational impact • A = Acceptability • C = Cost • W = Weight

  4. Domain based marking The problem of atomised communication The concept of professional judgement and flexibility and contextualisation Internalised grids Why this might not work in communication The problem of too few domains

  5. Process Marking in information gathering stations:7 overall scores • Initiating the Session • Problem Identification • Problem Exploration • Patient’s Perspective • Non-verbal Communication • Developing Rapport • Providing Structure

  6. Individual areas for guidance: overall areas marked only

  7. Content marking

  8. Plus structured oral - 5 minutes

More Related