Evaluation and Promotions: Introduction for PGY1s

1. Thomas Maniatis, MD, CM, MSc (Bioethics), FACP, FRCPC Chair, Faculty Postgraduate Promotions Committee July 30, 2014 Evaluation and Promotions: Introduction for PGY1s

2. Conflict of interest None to declare

4. CanMEDS framework • Medical Expert: knowledge, skills, judgment • Communicator: patients, colleagues • Collaborator: team-work • Manager: computer skills, time management, leadership • Health Advocate: standing up for patients • Scholar: reading around cases, bringing the evidence to the bedside, teaching

5. CanMEDS framework • Professional: ethics, integrity, honesty • may be addressed both in rotations and outside of rotations

6. Principles of evaluation • Feedback: communication to another person which gives information about how he/she affects and is perceived by others… • Evaluation: rating an individual’s performance based on predetermined expectations

7. The Role of Feedback in Evaluation A B Formative Feedback SummativeEvaluation

8. Formative vs. Summative • Formative feedback: done with the intent of providing ongoing information for individual modification • Summative evaluation: done at the end of a course or program to determine whether the individual has met a set of predetermined expectations

9. Good feedback is… • Based on a common understanding of expectations • goals and objectives, level-specific • Based on observations and not inferences • Specific • Descriptive

10. Good feedback is… • Timely • Constructive

11. Bad feedback is… • Based on a subjective set of expectations • Based on inferences and assumptions • Very general or vague • “you’re doing fine…” “keep reading…” • Delayed • Destructive

12. Resident’s role in feedback • Ask for it if not volunteered • every 2 weeks or at change of shifts • chance to improve • Think about how you did ahead of time • see if your perceptions are aligned with how others see you • Ask for specific things to work on to improve • Listen!

13. Resident’s role in feedback • If you’re not sure you agree, ask for specific examples to better understand • Think about it afterwards • reflection is the most important part of integrating feedback • avoid quickly brushing off feedback • recognize the difference between “personality” and “behaviours” • the first is relatively fixed and the other is changeable

14. Resident’s role in evaluation • Look in one45 regularly • Must evaluate rotation and teachers before looking at own evaluations • Professional responsibility to look at and think about evaluations received • logs in one45 • acknowledge seeing them by “clicking” on the button

15. Resident’s role in evaluation • Recognize the importance of multiple independent observations • should be taken seriously

16. Evaluations and Promotions • McGill has a set of rules guiding evaluation and promotion of residents • Doing OK overall • Satisfactory…meets or sometimes exceeds…average or above average…80% of residents/rotations/grades • Superior…consistently exceeds…excellent…10% residents/rotations/grades

17. Evaluations and Promotions • Weaknesses identified • Borderline…some weaknesses identified • Unsatisfactory…falls short of expectations

18. Evaluations and Promotions • It’s usually okay to have some borderline elements in the occasional evaluation • Overall borderline or unsatisfactory • equivalent to “failed” rotation • specific requirements as per Promotions Rules • meet with Program Director to discuss

19. Who sees your evaluations? • First and foremost, you! • Program Director • delegate (Site Director, Evaluation Director) • Program Admin. • PGME

20. Who sees your evaluations? • Formal meeting with PD q6month to review evals and overall progress • PD and you are the only people who have a bigger perspective on your progress • generally speaking, no forward feeding at McGill

21. Program Promotions Committee (PPC) • Monitors progress of residents in program • Promotes residents each year to next level, if appropriate • Identifies residents in academic difficulty and monitors progress • Applies McGill’s Promotions rules if remediation or other actions are needed

22. Faculty Postgraduate Promotions Committee (FPPC) • Monitors and ratifies decisions of PPC • Ensures McGill’s Promotions rules are applied fairly • Monitors residents in academic difficulty

23. What if I don’t agree? • First, discuss it with your Program Director and/or rotation supervisor • Appeals are an option… • please see “Evaluation and Promotions in Postgraduate Training Programs” (updated for July 1, 2014 academic year)

24. McGill’s “75% rule” • McGill Promotions rule states that a residents must complete at least 75% of a given rotation for it to be considered complete • Otherwise, the evaluator may enter it as “incomplete” • “repeat” rotation needed • Be careful with time off and potential tensions with this rule!

25. Summary • CanMEDS is the basic framework guiding all evaluations during your residency • Feedback and evaluation are part of the day-to-day fabric of being a resident • McGill’s has a well structured process for evaluations and promotions