Rater Training for Clinical Skills Verification Module 5 Performance Standards

1. Rater Training for Clinical Skills VerificationModule 5Performance Standards Michael Jibson, M.D., Ph.D. Jeffrey Hunt, M.D. David Kaye, M.D. Richard Summers, M.D.

2. Pre-testModule 5 • The Clinical Skills Verification Examination requires that residents demonstrate competency all of the following areas except: a. conduct of the interview b. doctor-patient relationship and rapport development c. case formulation d. case presentation

3. Pre-testModule 5 2. The Clinical Skills Verification Examination defines competency: a) based on a developmental sequence of skills over the four years of the adult psychiatry residency b) based on the expected competency of PGY2 psychiatry residents c) based on the expected skills of a competent general psychiatrist in the community d) based on the standards of the live patient ABPN examination

4. Pre-testModule 5 3. Residents must: a) pass all items on the CSV forms in order to pass the assessment b) pass all three sections in order to pass the assessment c) pass the majority of items on the CSV form in order to pass the assessment d) Have a global passing grade on the examination if they have failed one section in order to pass the assessment

5. Pre-testModule 5 4. Which of the following statements is true about the anchor points on the CSV form? a) the anchor points have been validated using standardized patient interviews b) the anchor points assist in the process of developing inter-rater reliability c) the anchor points assist in the process of developing test validity d) the anchor points are derived from ACGME competencies

6. CSV Form 3 Major items Physician-patient relationship Conduct of the interview Case presentation 10 Subscores with anchors Must score >5 of 8 on each major item

7. CSV Form 3 major item scores are global impressions They are informed by subscores They need not be an average of the subscores Subscores may be given different weights depending on the clinical situation

8. CSV Form Subscore anchors for a score of 5-6 define the minimum expectations in each category Anchors assist with inter-rater reliability Major items, subscores, and anchors have not yet been validated

9. CSV Standards A score of 5 represents: the minimum acceptable standard for a general psychiatrist practicing in the community

10. CSV Standards Scoring should NOT: be adjusted to the resident’s level of training require excellent or outstanding performance expect performance at the level of a subspecialist

11. Videos All videos include actual patients All patients and residents have consented to the use of these videos for educational purposes Your responses will be saved for quality assurance assessment It is possible that these data will eventually be used for a research study, but no IRB proposal has been submitted

12. Videos • The videos have been edited. Rate the residents performance on what you see • If the resident presents material in the case presentation, assume it was obtained during the patient interview • The videos are found in the accompanying slide set

13. Post-TestModule 5 • The Clinical Skills Verification Examination requires that residents demonstrate competency all of the following areas except: a. conduct of the interview b. doctor-patient relationship and rapport development c. case formulation d. case presentation

14. Post-TestModule 5 • The Clinical Skills Verification Examination requires that residents demonstrate competency all of the following areas except: c. case formulation The CSV exam requires competency in establishing a Doctor-Patient Relationship, Conduct of interview and Case Presentation.

15. Post-TestModule 5 2. The Clinical Skills Verification Examination defines competency: a) based on a developmental sequence of skills over the four years of the adult psychiatry residency b) based on the expected competency of PGY2 psychiatry residents c) based on the expected skills of a competent general psychiatrist in the community d) based on the standards of the live patient ABPN examination

16. Post-TestModule 5 2. The Clinical Skills Verification Examination defines competency: c) based on the expected skills of a competent general psychiatrist in the community

17. Post-TestModule 5 3. Residents must: b) pass all three sections in order to pass the assessment Residents must demonstrate competence on the global ratings of Doctor-Patient Relationship, Conduct of the interview and Case presentation. They do not have to pass each individual anchor under these categories.

18. Post-TestModule 5 4. Which of the following statements is true about the anchor points on the CSV form? a) the anchor points have been validated using standardized patient interviews b) the anchor points assist in the process of developing inter-rater reliability c) the anchor points assist in the process of developing test validity d) the anchor points are derived from ACGME competencies

19. Post-TestModule 5 4. Which of the following statements is true about the anchor points on the CSV form? b) the anchor points assist in the process of developing inter-rater reliability