1 / 28

Dr. Shama Mashhood

Dr. Shama Mashhood. Medical Educationist & Coordinator Question Review Committee. “Multiple Choice Questions- One best type”. Overview of the Presentation. Strengths and Limitations of one best type MCQs.

december
Download Presentation

Dr. Shama Mashhood

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Dr. Shama Mashhood Medical Educationist & Coordinator Question Review Committee

  2. “Multiple Choice Questions- One best type”

  3. Overview of the Presentation • Strengths and Limitations of one best type MCQs. • Characteristics of good MCQs Items. • Checklist for review of MCQs.

  4. STRENGTH OF MCQs • Valid • Reliable • Standardized • Objective • Sample broad content • Easy to score & analyze. • Item analysis, difficulty & discrimination • Can test various levels of cognition

  5. LIMTATIONS OF MCQs • Difficult to prepare . • Time consuming. • Assess recall (If carefully not constructed)

  6. Higher order problem solving and decision making ability • Scoring can be affected by reading ability. • Difficult to determine why candidate select wrong response

  7. Components Question Stem A 68 years old man presents with colicky abdominal pain. Within three days of admission to the hospital, he becomes jaundiced and develops high-grade fluctuating pyrexia. The most likely diagnosis in this patient is A. infective hepatitis B. cirrhosis of liver C. a stone impacted in the common bile duct D. carcinoma of the head of pancreas E. an intra hepatic abscess KEY: C Lead in statement Option

  8. Item Shape? Long stem with all essential information Short Option Short Option Short Option Short Option Short Option

  9. Item Shape? Short item stem Long Option Long Option Long Option Long Option

  10. Item Shape? Item Stem Uneven option Uneven option Uneven option Uneven option

  11. Characteristics of good Item • Identify Objectives, level and domain of learning • Formation of table of specification. • Simple recall to problem solving questions.

  12. GOOD ITEM STEM • 1.Must be clear, concise, straightforward and a complete question. E.g. Multiple choice question is • Valid • Reliable • Objective • Feasible

  13. Recall Item: e.g. What area is supplied with blood by the posterior inferior cerebellar artery? e.g. Which of the following presents as Chronic (longer than 3 months) airspace disease on a chest radiograph? • Streptococcal pneumonia • Adult respiratory distress syndrome • Pulmonary edema • Pulmonary alveolar proteinosis

  14. Item with a vignette/case/scenario measuring application of knowledge e.g. A 35 year woman presented with a 4 month history of dysnea, low grade fever, cough and fatigue. Given the following chest radiograph, what is the most likely diagnosis? Streptococcal pneumonia • Adult respiratory distress syndrome • Pulmonary edema • Pulmonary alveolar proteinosis • Streptococcal pneumonia

  15. 3. Worded positively. e.g. Which of the following best distinguishes small airway disease from interstitial lung disease on chest CT?

  16. 4. No negative phrasing b/c negative stem less effective and difficult to understand. e.g. “Which is not true" or “all of the following except” e.g. Which of the following is NOT a characteristic CT finding of small airway disease?

  17. 6. Must have a central idea which fits grammaticallywith the option. e.g. If the stem is in past tense ,all options should be in past tense. If answer demands for plural, then all options should be in plural.

  18. Avoid 7. Absolute terms e.g. ‘Always’, ‘Never’, ‘all’, ‘none’ b/c few ideas or situations are absolute or universally true. 8. Terms cues for test wise examinees e.g. ‘may’, ‘could’, ‘can’. (b/c anything is possible) 9. ‘Seldom’, ‘rarely’, ‘occasionally’, ‘sometimes’, ‘few’,& ‘many'. (not uniformly understood) 10. Excessive verbiage 11. Pronoun ‘it, he, she & you’.

  19. GOOD LEAD IN • Focus on one aspect of the disease of the condition. e.g. Diagnosis, Management

  20. GOOD OPTIONS • Grammatically consistent with stem • Similar to correct answer in construction and length • Homogenous in content e.g. all diagnosis, test, treatments. • Avoid ‘none of the above’ or ‘all of the above’.

  21. Keep options in logical order e.g. numerical,chronological,alphabetical, ascending order. • Change position of key responses. • Keep options independent and not overlapping.

  22. Check list Reviewing multiple choice items

  23. Is this the most appropriate type of item to use? • Does each item stem present a meaningful problem? • Are the item stems free of irrelevant material? • Are the item stems stated in positive term (if possible)?

  24. 5.If used has the negative wording been given special emphasis (e.g. capitalized) 6.Are the alternatives grammatically consistent with the item stem? 7.Are the alternative answers brief and free of unnecessary words? 8.Are the alternatives similar in length and form?

  25. 9.Is there only one correct or clearly best answer? 10.Are the distracters plausible to low achievers? 11.Are the items free of verbal clues to the answer? 12.Are the verbal alternatives in alphabetical order?

  26. 13.Are numerical alternatives in numerical order? 14.Have none of the above and all of the above been avoided (or used sparingly and appropriately)? 15.If revised, are the items still relevant to the intended learning outcomes? 16.Have the items been set aside for a time before reviewing them?

  27. QUESTIONS?

More Related