Item Banking

2. Item Banking Neil Wilkinson

3. Item Banking • Test development • Item banking • What data is stored • Why use item banking • Item bank features • Keys to successful item banks Presentation Title runs here l 00/00/00

4. Test Development

5. Test Development

6. Item Banking + Management + Searching +Reporting +Auditing = Item Bank Statistics History Content Scoring Test Item Learning Outcome References Review Process Author Status Other Data

7. Item banking

8. Item banking Item banking is the process of storing all of your items and related data

9. Item bank An item bank could be a database, a word document, an excel document, anything that ties together content with related data.

10. What data

11. Content • The questionyou are asking • Distractors • Graphics • Other Material (audio/video/pdf/graphics)

12. Scoring • The correct answer or key • Sample responses • Rationale • Alternative scoring

13. Learning Outcome • The learning outcome/syllabus/objectives are generally stored in a tree structure • Every item might have one or more classification • Each author might write to a particular section • Used for gap analysis

14. Reference • It is often useful to store a referenceto something that proves the item correct • It could be a book, journal webpage or other • This gives you the ability to check the quality and validity of the item

15. Other Data • Items often have meta-data • This should be configurableandsearchable • Often a mix of response types (free-text, drop down lists, combo boxes) • Eg Blooms Taxonomy, item status

16. Review Process • Items may have a review process • Each step might have outcomes • Items might need to be trackedthrough the process • Example: ‘how many items are currently at 1st Editorial Review?’

17. Statistics • Items may have statistics generated by a measurement expert • Statistics could have come from many exam sittings • Often used in test construction • Used to review author and item performance

18. Test Build • Items will be added to a test • The test will be exported for delivery in some environment • The test could be in many formats, including Word/QTI/XML

19. History • Who reviewedan item? • What was changed? • What tests has it been deliveredin? • How did it perform?

20. Why?

21. Why Item Bank Increased reliability. Good items can be reused, bad items can be retired.

22. Why Item Bank Increased consistency. Review steps allow all items to go through the same review process.

23. Why Item Bank To allow reportingon program status

24. Why Item Bank Increasedspeedof creating tests

25. Why Item Bank Customised workflow for your items.

26. Why Item Bank Ability to build an audit trail for your items.

27. Why Item Bank Increased securityof items.

28. Item bank features

29. Item Bank Features • Item authoring • Remote item authoring • Support of multiple item types • Item banking • Search capabilities • Import/export capabilities • Batch editing capabilities

30. Item Bank Features • Test construction • Test assembly • Export features • Ancillary features • Security and access • Workflow management • Project tracking

31. Key features

32. Key features of successful Item Banks • Thoughtful creation of meta-data • Item bank manager • Solid processes • Consistency • Training • Migration • Stakeholder buy in

33. Thank you!