1 / 9

Aviad Haramati, PhD Peggy A. Weissinger, EdD Georgetown University School of Medicine

Georgetown University. Center for New Designs in Learning & Scholarship and Office of Faculty and Academic Affairs Writing Multiple Choice Questions. Aviad Haramati, PhD Peggy A. Weissinger, EdD Georgetown University School of Medicine. Congruence!. Objectives. Activities. Assessment.

aldan
Download Presentation

Aviad Haramati, PhD Peggy A. Weissinger, EdD Georgetown University School of Medicine

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Georgetown University Center for New Designs in Learning & Scholarship and Office of Faculty and Academic AffairsWriting Multiple Choice Questions Aviad Haramati, PhD Peggy A. Weissinger, EdD Georgetown University School of Medicine CNDLS & OFAA Georgetown University

  2. Congruence! Objectives Activities Assessment Adapted from Felder & Brent ( 1991)

  3. What am I testing? Core Principles: • Decide exactly what you want to test. • Eliminate as many ambiguities as possible. • Create distractors based firmly on what you want to test. • After it is over, use it as a learning opportunity! • Give feedbackfor your distracters which explains why they’re wrong. • Give feedback for the correct answer explaining why it’s right. Adapted from http://hotpot.uvia.ca/howto/mcquestion.htm TLISI - Georgetown University

  4. Technical Flaws Issues Related to Irrelevant Difficulty • Options long, complicated, or double • Numeric data not stated consistently • Terms in options are vague • Language in options not parallel • Options in non-logical order • Stems are tricky or unnecessarily complicated Reference: Case & Swanson (NBME) Constructing Written Test Questions TLISI - Georgetown University

  5. Item Shape Appropriately Shaped Item Long Stem a. b. c. d. e. Poorly Shaped Item Short Stem a. b. c. d. TLISI - Georgetown University e.

  6. When Writing Options... …make sure that they are: • Homogenous in content • Incorrect or inferior to the correct answer • Plausible and attractive to the uninformed • Similar to the correct answer in construction • Grammatically consistent and logically compatible with the stem Reference: Case & Swanson (NBME) Constructing Written Test Questions TLISI - Georgetown University

  7. General Guidelines • Bulk of question in the stem. • Try “cover-the-options” test. • Avoid superfluous information. • Avoid “tricky” and overly complex items. • Write grammatically consistent options. • Avoid absolutes! (e.g. always, never, all) And most important: Focus on important concepts. Don’t waste time testing trivial facts. Reference: Case & Swanson (NBME) Constructing Written Test Questions TLISI - Georgetown University

  8. Pulling it together! Summary: • Decide what you want to test. • Well-written objectives make the job easier. • Use guidelines for writing quality MCQ. • Local resources here to help!

  9. Contact information Peg Weissinger paw33@georgetown.edu 202-687-4556 Aviad Haramati haramati@georgetown.edu 202-687-1021 CNDLS & OFAA Georgetown University

More Related