Computer-Based Adaptive Testing of Blind Students

1. Computer-Based Adaptive Testing of Blind Students Presented by: Elizabeth Greenberg, State Program Director National Conference on Student Assessment, June 2012

2. Overview of System • First used in Oregon in November 2011 • Students access test questions and stimuli through: • Text-to-speech (JAWS: screen reader for the blind) • Refreshable Braille display (displays a line of Braille and some navigational controls) • Real-time embossing of test items (View Plus Tiger embosser)

3. Overview of System (continued) • Reading and social sciences items available in contracted and uncontracted literary Braille • Math and science items available in Nemeth Braille • All math and science items, as well as reading and social science items with graphics, are automatically sent to the embosser (RBD does not display Nemeth or graphics) • Other items can be embossed if requested by the student

4. Refreshable Braille Display (RBD) • Refreshable Braille Display: • Only displays literary Braille (no Nemeth or graphics) • Displays exactly what JAWS reads from screen. Content cannot be edited by Braillists as it is for embossed files. • Can be configured for contracted or uncontracted Braille • Display follows along with what JAWS is reading aloud

5. Embosser • Embosser: • Can be used for literary Braille, Nemeth, and tactile graphics • Files can be reviewed and edited by Braillists prior to being presented to students. Better quality control than RBD.

6. Required hardware and software • Student: • Computer with Windows 7, AIR secure browser, JAWS, and Internet access • Refreshable Braille Display (Oregon uses ALVA 40-cell display) • Test administrator: • Computer with View Plus desktop embosser driver (for printing .prn files), Duxbury Braille translator (for printing .brf files), and Internet access • View Plus Tiger Max embosser

8. Preparation of Test Items for Braille Testing • Items classified into categories: • Appropriate for Braille: no graphics • Appropriate for Braille: includes graphics • Appropriate for Braille: no graphics but requires some simple transcriber notes • Appropriate for Braille: includes graphics and requires some simple transcriber notes • Not appropriate for Braille • First two categories included on 2011-2012 test (over 15,000 total items available in Braille)

9. Pilot Testing and Training • Pilot testing conducted across Oregon in May 2011 (13 students). • Braille practice tests launched in August 2011. • Trainings for test administrators conducted across Oregon in September 2011. Software and hardware (embossers, refreshable Braille displays) provided at trainings for test administrators to take back to schools. • Test launched November 2012.

10. Braille Tests Completed in Oregon: 2011-2012 • 81 online Braille tests completed in Oregon during academic year 2011-2012 • 23 students tested • Tests administered in all grades: 3 through high school • Tests administered in all subjects: reading, mathematics, science, social sciences

11. Hawaii • Same system used in Hawaii, but Hawaii elected not to use RBD (embosser only) • Hawaii Braille Practice Test launched in January 2011 • Training for test administrators conducted in February 2012 • Online adaptive Braille test launched in March 2012 • Eight students tested in Spring 2012