1 / 19

Developing Multiple Choice Questions

Developing Multiple Choice Questions. Shari Alexander Barren County Schools Summer PD Academy. Comparing KCCT Items for State Assessment and Classroom Use. Classroom. State. Encourage higher-level thinking and application of content (OR).

ryo
Download Presentation

Developing Multiple Choice Questions

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Developing Multiple Choice Questions Shari Alexander Barren County Schools Summer PD Academy

  2. Comparing KCCT Items for State Assessment and Classroom Use Classroom State • Encourage higher-level thinking and application of content (OR) • Address state expectations (Academic Expectations and Core Content for Assessment) • Annual measurement • Results measure school performance • Apply statewide sensitivity guidelines • Evaluate long-term learning • Address unit and lesson objectives • Ongoing measurement • Results inform instructional planning/practice • Show awareness of local sensitivity issues • Embed into curriculum and instruction • Develop in classroom context • Allow response flexibility (OR) • Engage student interest (OR) • Align with Academic Expectations • Align with Core Content for Assessment • Instructions are • age appropriate • clear in language and graphics • achievable and scoreable Multiple Choice and Open Response Items

  3. Guidelines for the Development of KCCT-like Multiple-Choice Items

  4. Advantages of Multiple-Choice Items… • Can be used to measure a wide variety of learning • Are reliable and time-efficient to score • Can provide useful diagnostic information about the learning of individual students or groups of students

  5. Disadvantages of Multiple-Choice Items… • Difficult to write. • Not well suited for measuring certain types of skills (e.g., the ability to organize and express ideas in writing). • Performance can be influenced by student characteristics unrelated to the subject of measurement, such as reading ability and “test-wiseness.”

  6. Guidelines for Writing KCCT-like Multiple-Choice Items • Be sure there is only one right answer… Example: When people borrow money from a bank,they pay back the amount borrowed plus • principal. • taxes. • interest. • savings.

  7. Guidelines for Writing KCCT-like Multiple-Choice Items • Develop parallel response options… Example: The producers at the start of a food chain are • small animals. • predators. • green plants. • insects.

  8. In a free-enterprise system, most businesses are owned by factory workers. owned by the national government. owned by private individuals. owned by state and local governments. In a free-enterprise system, most businesses are owned by factory workers. private individuals. the national government. state and local governments. Guidelines for Writing KCCT-like Multiple-Choice Items Put as much of the wording as possible in the stem of the item…

  9. Someone who is hired to do work is a customer. an employer. a consumer. an employee. Which activity could Mike do to improve his TOTAL Physical condition? swimming running bicycling dancing Make all options grammatically consistent with the stem of the item…

  10. Make sure graphics add to the item… • Include clear, correct, easily understood graphics as required by the item.

  11. Make the incorrect response options plausible • Using common misconceptions or errors of students are good response options to include in an item. • Use other concepts or terms from the grade-appropriate core content. • Avoid humorous or nonsensical response options. • Avoid the use of absolute terms in response options (always, never, all, none, only). • Avoid using the options “all of the above” and “none of the above”.

  12. Avoid negative terms where possible… • State the item stems in positive terms (if possible). • If you have to use negative wording in the stem, it should be in all caps or in bold print to assure that the student is in the proper mind set just before reading the options.

  13. Example of a stem usingnegative wording… Example: Which drink does NOT contain caffeine? • fruit juice • coffee • tea • hot chocolate

  14. Practice reviewing Multiple Choice items…

  15. Penguins cannot fly • because • their wings are too small • their wings are too flat • their wings are too curved • their wings are too heavy • Penguins cannot fly • because their wings • are too • small • flat • curved • heavy

  16. Animal tracks can best be found in • mud or snow • grass • water • the library • Animal tracks can best be found in • mud • grass • water • sand

  17. People in the United • States enjoy freedom of • speech. This freedom is • protected by the • Declaration of Independence. • Bill of Rights. • Emancipation Proclamation. • Articles of Confederation. • People in the United • States enjoy freedom of • speech. This freedom is • protected by the • The Constitution. • Bill of Rights. • Emancipation Proclamation. • Articles of Confederation.

  18. A tree, chair, or table • that is used as part of • a play is a • prop. • necessary to make the play more real. • role and actor. • character. • A tree, chair, or • table that is used as • part of a play is • prop. • plot. • role. • character.

  19. When drafting multiple-choice items... • Develop items related to curriculum map, lesson and/or unit of study. • Write the item based on the knowledge, skill and DOK level to be assessed by CCA 4.1.

More Related