1 / 14

Vicki R LeBlanc, Roger Kneebone, Diana Tabak Debra Nestel, Helen MacRae, Carol-anne Moulton

Integrated Assessment of Technical and Communication Skills. Validating an. Vicki R LeBlanc, Roger Kneebone, Diana Tabak Debra Nestel, Helen MacRae, Carol-anne Moulton University of Toronto & Imperial College London. Formal Assessment. Communication skills. Technical skills.

shae
Download Presentation

Vicki R LeBlanc, Roger Kneebone, Diana Tabak Debra Nestel, Helen MacRae, Carol-anne Moulton

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Integrated Assessment of Technical and Communication Skills Validating an Vicki R LeBlanc, Roger Kneebone, Diana Tabak Debra Nestel, Helen MacRae, Carol-anne Moulton University of Toronto & Imperial College London

  2. Formal Assessment Communication skills Technical skills

  3. Clinical Setting Communication skills Technical skills

  4. Integrated Procedural Performance Instrument (IPPI) Integrated Clinical Scenarios for Education and Evaluation Kneebone et al., 2006

  5. Psychometric Properties Interrater Reliability Internal Consistency Construct ValidityDiscrimination between different levels of trainees

  6. Study Design 4th Year Medical Students N = 16 Volar Cast Irritated Wound Closure Drunk and Angry Urinary Catheterization Uncomfortable PG1Surgery Residents N = 16 Skin Lesion Blind and Afraid

  7. Outcome Measures 2 Blinded Examiners • Checklist scale of technical skills • Global Rating Scale of performance • Communication Scaleoverall, empathy, cohesion, verbal, non-verbal

  8. Interrater Reliability GRS = .76 Checklist = .73 Communication = .61

  9. Internal Consistency 4 stations GRS: α = .75 Communication: α = .81

  10. Internal Consistency Checklist: α = .65 Spearman-Brown prediction formula:6 scenarios: α = .748 scenarios: α = .78

  11. Construct Validity Residents Medical Students %

  12. Communication Skills Residents Medical Students %

  13. Conclusions 6-8 stations Discrimination on technical components Gap in curriculum: communication skills

  14. Questions: vicki.leblanc@utoronto.ca

More Related