1 / 20

Part 2: Test Writing for Nursing

Part 2: Test Writing for Nursing Writing Test Questions that Promote Critical Thinking: What’s New?. Welcome! Please read the following pre-webinar notes:. Audio? Dial 1-877-783-2009 (Passcode: 936785) Attendees will be muted during the webinar until the Q&A session(s).

lora
Download Presentation

Part 2: Test Writing for Nursing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Part 2: Test Writing for Nursing Writing Test Questions that Promote Critical Thinking: What’s New? Welcome! Please read the following pre-webinar notes: Audio? Dial 1-877-783-2009 (Passcode: 936785) Attendees will be muted during the webinar until the Q&A session(s). Control Panel Large? Click the right arrow to hide the Control Panel. Handout(s)? http://www.diassociates.com/media/webinars/Iggy_Webinar_100112.ppt http://www.diassociates.com/media/webinars/test_statistics.doc Need Help? Dial 1-877-341-4788 or Email help@diassociates.com. Questions? Comments? Use the Chat pane or Email us at info@diassociates.com. Contact Information? http://www.diassociates.com donna@diassociates.com

  2. Webinar Objectives for Part 2 • Identify the process of writing test items that simulate and evaluate critical thinking and decision making. • Interpret statistical data from multiple-choice testing. • Make sound decisions about revising or nullifying test items based on statistical interpretations.

  3. Types of Test Items • Selected response = 4-choice (single response) or “Select all that apply” (multiple response) multiple choice

  4. Types of Test Items • Constructed response = alternate item formats, such as: • Completion • Hot spot • Drag and drop/ordered response • Exhibit

  5. Completion Type of Test Item The physician prescribes a loading dose of 18mg/kg IV phenytoin to be given at 50 mg/min. The client weighs 198 pounds. The nurse sets the IV pump for the drug to be given over ______minutes (round to the nearest whole number).

  6. Ordered ResponseTest Item A client with pancreatitis needs a TPN replacement bag. In what order will the nurse add a new TPN solution bag? ___Flush TPN solution through the bag and tubing. ___Ask another RN to check TPN order and bag. ___Add new bag of TPN solution. ___Wash hands thoroughly. ___Check new bag solution with order. ___Turn off and disconnect empty bag. ___Document amount of new solution hung. ___Open clamp to allow fluid to run.

  7. Exhibit and Hot Spot Items • Requires student to review images or medical records, such as MAR, lab, orders. • Student must review exhibit to answer item. • Student must place an X on part of image that answers the question.

  8. TIPS FOR WRITING MULTIPLE CHOICE TEST ITEMS • Be consistent with format. • Be concise. • Simulate nurse-client interactions.

  9. TIPS (cont’d) • Don’t use negative approach (e.g., except, but…) • Keep length approximately the same. • Make ALL of the distracters attractive choices.

  10. TIPS (cont’d) • Present choices in a logical manner. • Do not use “all of the above” or “none of the above.” • Be culturally competent!!!

  11. Form a group (2-4) and develop one application or analysis test item using what you have learned today. • Share with the large group!!!

  12. ANALYZING TEST RESULTS Need these statistics: * Reliability coefficient (KR-20) * Measures of central tendency * Difficulty level and item analysis * IDR and/or PBS

  13. ANALYZING TEST RESULTS (cont’d) • Need test analysis software; e.g.: • *ParScore • *Spectrum • *EAC • www.edassess.net • *AppersonDatalink

  14. TEST RELIABILITY • Measures consistency of test scores • Use KR-20 or Cronbach’s alpha to measure internal consistency • Ideal KR-20 is 0.80 or greater, but can be difficult to achieve

  15. TEST ANALYSIS AND ITEM DECISIONS • Compute mean, mode, median • Review item difficulty (The p values of each item) = what percent of the group got the item correct; - less than 50%, the item could be too difficult - 90% or higher got it correct, it may be too easy or is MASTERY!

  16. TEST ANALYSIS AND REVISION (cont’d) 3. Review the discrimination data, or item discrimination ratio (IDR) of difficult items: - The percent of upper 27% of class who answered correctly minus the percent of the lower 27% who answered correctly

  17. TEST ANALYSIS AND REVISION (cont’d) Acceptable IDR = 25% (.25) or higher; if negative or very low, 3 choices: 1. Accept 2 answers. 2. Nullify item. 3. Throw item out (least desired).

  18. TEST ANALYSIS AND REVISION (cont’d) Point Biserial Discrimination (PBS or BS) =more useful to measure discrimination because it shows a test item’s ability to discriminate based on test as a whole

  19. TEST ANALYSIS AND REVISION (cont’d) Interpretation of PBS: • 0.30 and > … Very Good Item • 0.20 – 0.29 … Reasonably Good Item • 0.09 – 0.19 … Marginally Acceptable Item • Below 0.09 … Poor Item (should be carefully reviewed and possibly nullified)

  20. Thank you!!!!Please send list of attendees and e-mails to Deanne Blach for evaluations and certificates.

More Related