1 / 12

OTOLARYNGOLOGY TRAINING EXAMINATION

OTOLARYNGOLOGY TRAINING EXAMINATION. Robert H Miller, MD. PURPOSE OF OTE. Educational instrument to assist individuals and programs to evaluate their educational strengths and weaknesses

harken
Download Presentation

OTOLARYNGOLOGY TRAINING EXAMINATION

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OTOLARYNGOLOGY TRAINING EXAMINATION Robert H Miller, MD

  2. PURPOSE OF OTE • Educational instrument to assist individuals and programs to evaluate their educational strengths and weaknesses • “It is inappropriate for program directors to use this measure of resident performance as the sole form of assessment when evaluating residents for advancement.”

  3. REPORTING CATEGORIES • Prior reporting categories • General • Allergy • Laryngology • Pediatric otolaryngology • Rhinology • Sleep medicine • Head & Neck • Otology/Audiology • Plastic & Reconstructive

  4. REPORTING CATEGORIES • 2010 reporting categories • Allergy • Head & Neck • Laryngology • Otology/Audiology • Pediatric otolaryngology • Plastic & Reconstructive • Rhinology • Sleep medicine

  5. STANINES

  6. OTE • OTE designed to provide normative informative concerning a resident’s relative standing in the current year’s peer groups • Not adjusted for year-to-year variation in exam severity • Certifying exams are criterion based • Any other interpretation has no data to support their use • “Probation” has real and life-long consequences • “Resident would likely win legal case against program” – Everett Smith, PhD

  7. SCORE DISTRIBUTION 5% 50%

  8. PERCENTILE • Percentiles are group dependent • If you are ‘unlucky’ enough to take the OTE with a really bright group of peers, you may have a low percentile rank. • However that same level of performance could translate into a 50th percentile is you took the OTE with a less able group of peers. • These scores do not indicate anything about what a resident knows, only their relative standing in the current years peer group. • Percentile ranks very dependent on number of items in a given area • If few questions, one missed question could result in a large percentile variation • Reports are now by stanine, not percentile

  9. STANINE • Standard score of nine categories • 9-point scale with a mean of 5 and a standard deviation of 2 • Each stanine has a width of .5 standard deviations, except for the 1st and 9th stanines • Range: 1 (lowest performing group) to 9 (highest performing group)

  10. OTE SCORE REPORT

  11. PGY-1 SCORES • Not all PGY-1 residents take OTE • 15 PGY-1s took 2011 OTE • 145 PGY-1s signed up for 2012 OTE • Wide variability in ENT exposure during PGY-1 • 0 to 3 months • ABOto reports only on PGY-1 comparison to other PGY-1s • National statistics report does not include PGY-1 scores

  12. VOLUNTEERS FOR NEW WEBSITE REVIEW • Website will undergo major revision • Seeking user input on how to improve website • Would like small group of PDs for input

More Related