1 / 24

Xerte Standard Setting in Psychiatry Undergraduate OSCE

Develop a comprehensive Xerte package to train examiners, standardize marking schemes, and improve OSCE assessment in psychiatry. The package includes scenario scripts, ratings templates, and video examples for efficient and standardized evaluation. Analysis of results showed increased examiner access and improved assessment consistency. Limitations like Flash Player issues and slow internet connections were noted but addressed. Xerte's user-friendly interface allows quick creation and distribution of multimedia packages. Future plans include improving IT access, bitrate reduction, and expanding standardized formative assessments for students.

menendezj
Download Presentation

Xerte Standard Setting in Psychiatry Undergraduate OSCE

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. XerteStandard SettinginPsychiatry Undergraduate OSCE Dr Ben di Mambro Clinical Lecturer in Psychiatry

  2. Psychiatry Examination • 80 EMIs • 1 hour 15 minutes • Standard set • 2 OSCE stations • Each station 10 minutes • 3 tasks based on competencies • % given for each task

  3. May OSCE

  4. Psychiatry OSCE • Changes to the OSCE • Criterion marking scheme • Global clinical assessment • Honours • Pass • Borderline • Fail • 2 examiners were placed in each room • Standard set pass mark for each task

  5. Task Develop CAL package: • Train the examiners in the new marking scheme • Standardise marking scheme • To allow for multiple sites to accommodate increasing numbers of students • Improve inter-rater reliability

  6. Development of Package • Scripted 10x 2-3 minute OSCE scenarios • Borderline/Pass • Pass/Honours • 2 hours filming in my office • 2 lecturers • 1 bullied student

  7. Creation of Media • wmv files converted to flv using Flash Macromedia • Images created utilising Flash Macromedia • MP3 creation using Audacity

  8. Xerte • Template ‘ratings’ created by Julian Tenney • Media was imported into Xerte through the Wizard

  9. The Package • An introduction to the new marking scheme • Example mark sheets • Video of example students • Rated on criteria • Global impression given • User then offered feedback

  10. Using the Wizard • Once Wizard create – efficient method of presenting content • Define scenario • Define marking sheet, including number of criteria • Define fail/borderline/pass/honours • Import media

  11. Sample of Package

  12. Distribution of Package • Letters and emails were sent to all examining consultants with following link www.nottingham.ac.uk/~mczbjd/OSCE.htm • Package ran for ~20 minutes

  13. Result of Package Introduction • 30% examiners accessed the package prior to the OSCE • Remainder underwent abridged version before the OSCE

  14. Analysis • ANOVAs undertaken on awarded scores by the different examiners on the same station

  15. December OSCE

  16. **p<0.001 *p<0.05

  17. Variation

  18. Limitations • Flash Player 7 not installed as standard on healthcare trusts’ computers • Minor problems with Xerte - since resolved • Delay on slow broadband connections • ?Representative videos • Any improvement likely to be due to the new marking scheme

  19. Xerte Once familiar: • Easy to use • Multimedia packages can be create in minutes • Easily distributed • Much more complicated to create bespoke packages

  20. Future • Improve IT access in the healthcare trusts • Reduce bitrate • Produce improved examples of borderline students • Extend the package to attempt to standardise the Formative assessments • ?Make available to students

More Related