1 / 11

Rater Feedback Training

Engage in CCC quality improvement by educating faculty on grading tendencies, milestone understanding, and variability impact on data. Organize, analyze, and review faculty grading data. Train faculty for improved grading accuracy and consistency.

mhelga
Download Presentation

Rater Feedback Training

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Rater Feedback Training

  2. Learning Objectives • Describe the variability of faculty graders and the impact on data compiled by the CCC • Become engaged in the process of CCC quality improvement • Employ a brief teaching tool to instruct colleagues on personal improvement and understanding of the milestones

  3. How To Organize the Data • Faculty grades of residents organized by PGY level to determine class averages • Downloaded individual evaluations of each faculty member by PGY level from New Innovations and placed into an excel spreadsheet • Results totaled and averaged for each faculty member • Faculty grading averages were then compared to the total average of each PGY class • Determined standard deviation • Further breakdown of faculty with overall scores > 7 or < 5.5 • Greater than one standard deviation from the mean further reviewed

  4. Example of Faculty Average Scoring

  5. Example of Faculty Grading Distribution

  6. Now the Important Part • You have each been assigned to meet with faculty members to engage and educate them on their grading tendencies compared to their peers • And to re-educate on milestones • You will be given a packet with personal and confidential information similar to the slides that follow • You will contact your assigned faculty members and request a brief ten minute meeting to review with them personally

  7. Sample Letter Given to Selected Faculty

  8. Sample of Faculty Grading Report

  9. Documents Included in Packet Given to CCC Members for One-on-One Training

  10. Documents Included in Packet Given to CCC Members for One-on-One Training

More Related