200 likes | 406 Views
Item writing: art or science?. Maj. Corina ISPAS NDFLTC Chief of SLP Section. Item writing. a matter of precision more akin to a computer programming than to writing purpose. Items vs question. not always in question format they should be discrete one item is part of a larger whole
E N D
Item writing: art or science? Maj. Corina ISPAS NDFLTC Chief of SLP Section
Item writing • a matter of precision more akin to a computer programming than to writing purpose
Items vs question • not always in question format • they should be discrete • one item is part of a larger whole • they occur gradually
Item development • Where does test-writing expertise come from?
Item types or format • all items use stimulus material • all items have at least one “right” answer • all items will have inadequate or wrong answers
Item writing guidelines • Format • Content • Structure • Response development
What item serves best? • MCQ • SAQ • Essay length written discourse • Role-play • Other…
Characteristics of a good item? • it tests what it is supposed to be testing • it co vibrates with the profile of the target population • content is relevant to the objective • it is not biased or completely unknown/unavailable to candidates
comes in a variety of shapes and forms • facilitates the item writer enough time to ponder • pre-set scoring procedures and assessment criteria • co-professional input: “the more the merrier”
Other characteristics Independence Stem Distracter Test/Item Length item in relation to other items item as a discrete test element Keyed answer the integrity of the test as a whole item as a whole
Provide enough information of what it is expected poor: Write about what you did in your summer holiday. better: Write about your summer holiday. Include details and information about places you visited and things you did. • Indicate the amount expected in the response poor: Tell us your opinion about globalization. better: Give 2-3 arguments in sustaining your opinion about globalization.
Keep items of similar format/content together • Avoid ambiguity poor: Do you know what the word “enunciate” means? better: The word “enunciate” means….. • Designate specific units in the instructions. poor: What is the total time of the journey? better: The journey took…..hours and …… minutes.
Indicate the criteria of assessment • Introduce the new/unfamiliar tasks by samples or explanation • Indicate the expected structure/ organization • Provide any useful advice • Train your invigilators • Train the scoring team