1 / 22

CBEI Mid-Year Update

CBEI Mid-Year Update. Prepared by: Evaluation Division, OME. Student Groups. Overall N = 321 Two groups. Overall Performance. Overall PWD = met criteria in all 3 performance domains. *p < 0.005. Overall Performance By Clerkship. Patient Care. R Reporter I Interpreter M Manager

cais
Download Presentation

CBEI Mid-Year Update

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CBEI Mid-Year Update Prepared by: Evaluation Division, OME

  2. Student Groups • Overall N = 321 • Two groups

  3. Overall Performance • Overall PWD = met criteria in all 3 performance domains *p < 0.005

  4. Overall Performance By Clerkship

  5. Patient Care R Reporter I Interpreter M Manager E Educator PASS: Performance mostly at the Interpreter level PWD: Performance at the Manager level

  6. Patient Care: RIME *p < 0.01

  7. Patient Care By Clerkship

  8. Professionalism and Interpersonal Communication • PASS • No significant or consistent concerns • PWD • No concerns • Consistent evidence of exceptional Professionalism/IPC • Multisource feedback requested from 1 non-MD staff member, 1 patient, 1 peer

  9. Professionalism and Interpersonal Communication *p < 0.001

  10. Professionalism and Interpersonal Communication by Clerkship

  11. Multisource Feedback *p < 0.001

  12. Multisource Feedback by Clerkship

  13. Exam • Threshold for PWD set by each clerkship to fall between 75th-80th percentile nationally, in clerkships using the NBME Subject Exam • Thresholds in other clerkships set by director and/or evaluation team, based on past student performance, when available

  14. Shelf exams: NBME subject exams • Mean shelf exam scores • Scores above the PWD threshold p = 0.144

  15. Final exam by clerkship

  16. Overall Performance: “PASS” in detail • PWD: Overall Pass with Distinction • All but exam: Met all criteria for PWD except exam score • All but MSF: Met all criteria for PWD except requesting multisource feedback.

  17. “All But Exam”: Detail • Met all criteria except exam score • Within 5 PTS: final exam score was within 5 points of the PWD threshold • Lower: final exam score was lower than the threshold by more than 5 points

  18. End of clerkship data • Mid-clerkship feedback • Direct observation

  19. Student reports from end-of-clerkship evaluations: Received Formal Mid-Clerkship Feedback

  20. Student report from end-of-clerkship evaluations: Direct Observation of Clinical Skills

  21. Summary of Key Findings • 23% of all students in required clerkships earned an overall PWD. • For the CBEI start group • 29% Overall • 66% Patient Care • 80% Professionalism and Interpersonal Communication • 97% MSF • 31% Exam

  22. Ongoing Program Evaluation • Residency Program Directors’ survey • Interview success rates • Wellness Survey

More Related