R-type Item Writing Wizard

1. R-type Item Writing Wizard HK Ng, C. Hazlett, J Ware, S. Yip

2. Additionally, some basic medical science teachers have difficulty assessing their students’ reasoning abilities within a clinically relevant context Background R-type selected response items (also referred to as Extended Matching Questions [EMQ]) are particularly suitable for measuring medical students’ scientific & clinical reasoning abilitiesHowever, some teachers find that composing an R-type item is difficult and/or time-consuming

3. The R-type item writing wizard is designed to assist basic & clinical science teachers composing well designed R-Type items more easily & quickly Objective & Purpose

4. Using the Wizard to Create an R-type Item

5. Select a Discipline, Topic & Theme from the respective lists provided by the wizard. When the Theme is selected, a set of relevant options will be automatically provided. More than one set may be available.

6. Select or Compose an Appropriate Lead-In Question

7. Next, compose a relevant, appropriate scientific or clinical scenario Two yr-old boy is brought to clinic complaining of generalized rash & fever for 1 day. Rash initially appeared on face & trunk then spread to limbs. Intensity of rash in axilla & groin region has recently increased. Skin feels like sand-paper & there is also circumoral pallor. Throat is congested & examination is otherwise uneventful.

8. Vignette can be composed within the wizard or copied & pasted from Word Pad or another source except MS Word

9. Specify the Option Which is the Correct Answer

10. Compose Relevant Feedback for Students Feedback can be provided to the students after the assessment for formative purposes

11. If another clinical scenario is relevant for the same option set, compose a 2nd vignette

12. Example of a 2nd Scenario Applicable for the Same Option Set Six yr-old girl, who has had cold & fever for 3 days, is sent home from school because she is feeling so poorly. Later in the same day she develops a maculopapular rash on her face & trunk. She does not want to get out of bed, preferring the bedroom curtains to be closed. On examination, there is grayish spot on the mucous membrane of her mouth.

13. Click button ‘Add Scenario’

14. 2nd Scenario is Added Sequential position of this scenario is indicated

15. By default the feedback from the previous (first) scenario is included

16. Several vignettes can be generated under the same option set

17. Example of a 3rd Scenario One yr-old boy is admitted to the A&E department due to high fever & generalized rash. His mother claims that the boy was still playful a few hours ago & his condition has deteriorated very quickly. On examination, the rash is non-blanching , irregular in size, with a necrotic centre.

18. Transferring the R-Type Item(s) to MS Word

19. If one has finished entering all scenarios for a particular set of options, but wishes to also generate other R-type items, click the button ‘Export and Continue’ Using this protocol, the exported item will be displayed in MS Word only after all the other R-type items have been created

20. When one has finished generating all R-type items click button “Export and Exit” Using this protocol, the wizard will close & a MS Word document will appear (see next slide)

21. Example of an R-type Item Displayed in MS Word After item(s) is (are) displayed in MS Word, go to Word’s menu bar - click View - select Print Layout

22. The Wizard can Increase in its Capability If no appropriate option set is presently available in the Wizard, add a new option set for use now & for the future how to achieve this is explained in the following slides

23. Click the Tab ‘Input/Edit Option Set(s)’

24. Select an existing Discipline Select an existing Topic Select an existing Theme

25. Compose (or copy & paste) your new options one by one within ‘Add Option’ text box & click the button ‘Add’ The options will be added to above option set text box

26. Asthma Costochondritis (Tietze Syndrome) Conversion Disorder Esophagitis Foreign Body Myocarditis Muscle strain Pericarditis Pneumonia Pneumothorax Precordial Catch Syndrome Supraventricular Tachycardia An Example of a New Option Set for the Theme of ‘Chest Pain’

27. Generating the New Option Set Click ‘Create New Option Set’ button & the new option set is added to the wizard & its total number of option sets is appropriately increased (e.g., 271)

28. Wizard also enables one to add additional sets of Disciplines / Topics / Themes

29. Type in a new discipline in relevant text box & click button ‘Add Discipline/Panel’

30. Similarly type in a new topic & theme in relevant text box & click the button ‘Add Topic/Theme’

31. Saving the changes made to Discipline / Topic / Theme

32. Click button ‘Save Changes Permanently’

33. R-type Intranet Wizard

34. The R-type Wizard Intranet Version has all the same features as the PC Version. andin addition, items created with the Intranet Wizard can be saved to the IDEAL non-restricted item bank if this item bank is being kept on the same server as the wizard

35. To enter the item into the non-restricted IDEAL bank, click button ‘Save Item and Continue Edit’