1 / 37

American Academy of Neurology Clinical Skills Examination Training Program

American Academy of Neurology Clinical Skills Examination Training Program. (date) (speaker) (association). Goals of this session.

lewis-whitehead
Download Presentation

American Academy of Neurology Clinical Skills Examination Training Program

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. American Academy of NeurologyClinical Skills ExaminationTraining Program (date) (speaker) (association)

  2. Goals of this session • Understand the American Board of Psychiatry and Neurology (ABPN) performance requirements for the five Clinical Skills Evaluations (NEX) neurology residents must pass to achieve board certification. • Appreciate the difference between a grade of ACCEPTABLE and BORDERLINE BUT UNACCEPTABLE. • Improve the inter-rater reliability of faculty evaluators for acceptable versus unacceptable distinctions.

  3. What is your role within your department? • Department chair • Residency program director • Adult neurology faculty • Child neurology faculty • Resident • Fellow • Other

  4. For how many years have you been practicing as a neurologist? (Only faculty with a clinical appointment should answer.) • 0-4 • 5-9 • 10-14 • 15-19 • 20-24 • 25 or more

  5. Have you ever served as an ABPN oral board examiner?(Only faculty with a clinical appointment should answer.) • Yes • No

  6. For how many NEX examinations have you served as a faculty evaluator? (Only faculty with a clinical appointment should answer.) • 0 • 1-4 • 5-9 • 10-14 • 15-19 • 20 or more

  7. How confident are you that you understand the ABPN criteria for determining whether a resident's performance on an NEX merits a passing grade? • 1 – Not at all confident • 2 • 3 • 4 • 5 • 6 • 7 • 8 • 9 • 10 - Extremely confident

  8. Neurology Clinical Evaluation Exercise (NEX) • Every resident must pass an examination in each of 5 categories during residency to sit for the neurology written board exam. • Ambulatory • Critical care • Neuromuscular • Neurodegenerative • Child neurology (for adult neuro residents) or adult neurology (for child neuro residents)

  9. Why train faculty evaluators? • ABPN oral board examiners underwent training • Poor inter-rater reliability between former ABPN oral board examiners and local faculty. (Schuh, et al 2009)

  10. What constitutes a pass or fail? 5 (marginal pass) • Deficiencies or errors in history or exam, but enough information is obtained to formulate the case. 4 (marginal fail) • Deficiencies or errors in history or exam, which result in the resident not being able to successfully formulate the case.

  11. Clinical Skills Examination Training (CSET) Program • Designed by a workgroup through the Consortium of Neurology Program Directors. • Objectives: • Create a simple NEX training program that can be utilized by faculty at neurology training programs • Focus on pass-fail distinction

  12. Clinical Skills Examination Training Program - Instructions • We will review a series of 9 brief vignettes. For each, there will be an example of an omission on the part of the resident. • Assume that the resident has performed a basic history and physical examination that is otherwise adequate • Select PASS or FAIL based on whether the omission is egregious enough to warrant an overall failing grade. • Review audience votes, as well as the voting results and talking points from previous participants. • Open discussion (Up to 1 minute for each side.) • Re-vote

  13. Objectives • Distinguish between those mistakes and omissions that interfere with the formulation of the case. • Training through reflection and discussion • Data gathering

  14. Criteria for assigning a failing grade • Deficiencies or errors in history or exam which result in the resident not being able to successfully formulate the case.

  15. Critical Care Scenario: (PRE)A 55 year old woman with known myasthenia gravis is admitted to the intensive care unit with a chief complaint of shortness of breath and generalized weakness.Omission:The resident does not check neck flexion strength. • Pass • Fail Historical Pass Rate: 76.2% (n=101) Talking points: Pass: Helpful, but not crucial. Respiratory parameters are crucial. Fail: Might help me determine whether or not to intubate.

  16. Critical Care Scenario: (POST)A 55 year old woman with known myasthenia gravis is admitted to the intensive care unit with a chief complaint of shortness of breath and generalized weakness.Omission:The resident does not check neck flexion strength. • Pass • Fail Historical Pass Rate: 76.2% (n=101) Talking points: Pass: Helpful, but not crucial. Respiratory parameters are crucial. Fail: Might help me determine whether or not to intubate.

  17. Pediatrics Scenario: (PRE)A 6 year old boy with normal birth and development develops progressive difficulty walking and climbing stairs. His calves are large.Omission:The resident does not ask about family history. • Pass • Fail Historical Pass Rate: 7.7% (n=104) Talking points: Pass: Won’t affect workup. Fail: Family history can direct DNA testing

  18. Pediatrics Scenario: (POST)A 6 year old boy with normal birth and development develops progressive difficulty walking and climbing stairs. His calves are large.Omission:The resident does not ask about family history. • Pass • Fail Historical Pass Rate: 7.7% (n=104) Talking points: Pass: Won’t affect workup. Fail: Family history can direct DNA testing

  19. Neuromuscular Scenario: (PRE)A 37 year old woman, previously healthy, presents to your office complaining of progressive muscle weakness and intermittent double vision.Omission:The resident does not stabilize the elbow joint when checking triceps strength. • Pass • Fail Historical Pass Rate: 96.2% (n=104) Talking points: Pass: This is a good teaching point, but doesn’t affect formulation. Fail: Poor exam suggests resident would not be able to properly assess in the future.

  20. Neuromuscular Scenario: (POST)A 37 year old woman, previously healthy, presents to your office complaining of progressive muscle weakness and intermittent double vision.Omission:The resident does not stabilize the elbow joint when checking triceps strength. • Pass • Fail Historical Pass Rate: 96.2% (n=104) Talking points: Pass: This is a good teaching point, but doesn’t affect formulation. Fail: Poor exam suggests resident would not be able to properly assess in the future.

  21. Neurodegenerative Scenario: (PRE)A 75 year old woman is brought to your office by her daughter for evaluation of mild memory loss.Omission:The resident does not ask about educational background. • Pass • Fail Historical Pass Rate: 75.7% (n=103) Talking points: Pass: If cognitive function is declining, level of education doesn’t matter. Fail: This is important to give the physician a frame of reference.

  22. Neurodegenerative Scenario: (POST)A 75 year old woman is brought to your office by her daughter for evaluation of mild memory loss.Omission:The resident does not ask about educational background. • Pass • Fail Historical Pass Rate: 75.7% (n=103) Talking points: Pass: If cognitive function is declining, level of education doesn’t matter. Fail: This is important to give the physician a frame of reference.

  23. Ambulatory Scenario: (PRE)A 26 year old pregnant woman presents with a 3 week history of bilateral hand paresthesias.Omission:The resident does not check lower extremity reflexes. • Pass • Fail Historical Pass Rate: 15.8% (n=101) Talking points: Pass: This is probably carpal tunnel syndrome. Fail: Although unlikely, a cervical myelopathy needs to be excluded.

  24. Ambulatory Scenario: (POST)A 26 year old pregnant woman presents with a 3 week history of bilateral hand paresthesias.Omission:The resident does not check lower extremity reflexes. • Pass • Fail Historical Pass Rate: 15.8% (n=101) Talking points: Pass: This is probably carpal tunnel syndrome. Fail: Although unlikely, a cervical myelopathy needs to be excluded.

  25. Critical Care Scenario: (PRE)A 75 year old woman presents to the emergency department with sudden onset of right sided weakness and slurred speech.Omission:The resident does not check for a Babinski sign. • Pass • Fail Historical Pass Rate: 85.9% (n=78) Talking points: Pass: Not part of the NIH stroke scale. Fail: This is necessary to localize the lesion.

  26. Critical Care Scenario: (POST)A 75 year old woman presents to the emergency department with sudden onset of right sided weakness and slurred speech.Omission:The resident does not check for a Babinski sign. • Pass • Fail Historical Pass Rate: 85.9% (n=78) Talking points: Pass: Not part of the NIH stroke scale. Fail: This is necessary to localize the lesion.

  27. Neuromuscular Scenario: (PRE)Hospital consultation to see a 21 year old man with a history of progressive ascending weakness.Omission:The resident does not ask about recent vaccinations. • Pass • Fail Historical Pass Rate: 87.2% (n=78) Talking points: Pass: Wouldn’t affect diagnosis or management. Fail: A recent vaccine could be an immunologic trigger for this.

  28. Neuromuscular Scenario: (POST)Hospital consultation to see a 21 year old man with a history of progressive ascending weakness.Omission:The resident does not ask about recent vaccinations. • Pass • Fail Historical Pass Rate: 87.2% (n=78) Talking points: Pass: Wouldn’t affect diagnosis or management. Fail: A recent vaccine could be an immunologic trigger for this.

  29. Pediatrics Scenario: (PRE)A 12 year old boy presents with repetitive movements of one hand.Omission: The resident does not take a medication history. • Pass • Fail Historical Pass Rate: 8.1% (n=74) Talking points: Pass: Not likely to be relevant in a child. Fail: Medication-induced movement disorder is on the differential.

  30. Pediatrics Scenario: (POST)A 12 year old boy presents with repetitive movements of one hand.Omission: The resident does not take a medication history. • Pass • Fail Historical Pass Rate: 8.1% (n=74) Talking points: Pass: Not likely to be relevant in a child. Fail: Medication-induced movement disorder is on the differential.

  31. Ambulatory Scenario: (PRE)A patient presents with chronic, episodic vertigo.Omission:The resident does not ask about hearing loss. • Pass • Fail Historical Pass Rate: 18.2% (n=77) Talking points: Pass: Wouldn’t affect work up or treatment. Fail: Vestibular tumor or Ménière’s disease are considerations

  32. Ambulatory Scenario: (POST)A patient presents with chronic, episodic vertigo.Omission:The resident does not ask about hearing loss. • Pass • Fail Historical Pass Rate: 18.2% (n=77) Talking points: Pass: Wouldn’t affect work up or treatment. Fail: Vestibular tumor or Ménière’s disease are considerations

  33. Session complete

  34. How confident are you that you understand the ABPN criteria for determining whether a resident's performance on an NEX merits a passing grade? • 1 – not at all confident • 2 • 3 • 4 • 5 • 6 • 7 • 8 • 9 • 10 – Extremely confident

  35. Developed by the AAN Clinical Skills Examination Training Workgroup Zach London, MD Joe Kass, MD Vicki Shanker, MD Sonja Potrebic, MD, PhD Yousef Mohammed, MD Gauri Pawar, MD Rachel Ditrapani, MD Ryan Walsh, MD

More Related