Christoph Damm, Svatoslav Ondra, Jiří Tužil Masaryk University, Brno, Czech Republic 3 rd International Conference „Edu

1. Wireless System for Real-Time Distribution of Visually Accessible Synchronous Transcription (Speech-to-Text Reporting) Targeted to Larger Group of Users with Hearing Impairment in Environment of Tertiary Education Christoph Damm, Svatoslav Ondra, Jiří Tužil Masaryk University, Brno, Czech Republic 3rd International Conference „Education for All“, Warsaw, 2011

2. Speech-to-text reporting at Masaryk University Teiresias – Support Centre for Students with Special Needs providing services for growing number of hearing impaired students former solutions of speech-to-text reporting for groups: Computer with two screens connected VNC screen sharing with up to 3 laptop computers Complicated setup, could comfortably serve only up to3 students 3rd International Conference „Education for All“, Warsaw 2

3. Two screens VNC screen sharing 3rd International Conference „Education for All“, Warsaw 3

4. Requirements for a new solution simple and quick technical preparation independence on a local technical infrastructure speech-to-text report must be synchronized with a reporter’s typing the look of the reported text should be customizable a possibility of two-way communication support for Czech and English language, at least 3rd International Conference „Education for All“, Warsaw 4

5. Analysis of comparable existing systems intentionally skipping the systems based on automatic speech-to-text recognition, for these reasons: insufficient accuracy of automatic speech-to-text recognition (specialized vocabulary used in university tuition) to gain higher accuracy is highly dependent on technical conditions of audio captioning “training” the system for specific speakers (to improve accuracy) is not possible to be arranged in circumstances of mainstream university environment 3rd International Conference „Education for All“, Warsaw 5

6. Remote automated speech-to-text services Speech Text 3rd International Conference „Education for All“, Warsaw 6

7. Analysis of systems involving a human reporter eScribe Google Documents Bee Communications dependency on reliable Internet connectivity in the place necessary to arrange captioning and transmitting of speaker’s voice, potentially together with presentation screen more complicated setup of technical environment indirect contact between the reporter and the speaker 3rd International Conference „Education for All“, Warsaw 7

8. Polygraf – own system developed key benefits and features: consists of three main hardware parts only neither requires Internet connection, initial network set-up, nor its own server compatible with Microsoft Word commonly used among many speech-to-text reporters. uses the iPad as a text display to ensure the basic user comfort features two-way communication also features dynamic captions on a speaker's computer (to supplement the speaker's presentation). 3rd International Conference „Education for All“, Warsaw 8

9. Polygraf – diagram 3rd International Conference „Education for All“, Warsaw 9

10. Polygraf – hardware components for reporters: a computer with Microsoft Windows and Microsoft Word(v. 2003 or later) installed for users: any device with iOS operating system (iPad, iPhone or iPod) equipped with Wi-Fi interface or a laptop with MS Windows a Wi-Fi access point(no need of Internet connectivity for this wireless network) 3rd International Conference „Education for All“, Warsaw 10

11. Polygraf – hardware components 3rd International Conference „Education for All“, Warsaw 11

12. Polygraf – software components The application component for the reporter’s computer:Microsoft Word AddIn(“reads” the text out of the Word documents and shares it to the users’ devices via Wi-Fi network) The application component for the handheld displays:for iOS operating systems (iPad, iPod, iPhone) or MS Windows(handles the reception of text report and its continuous updating and displaying) The application component for the presenter’s computer:alternative; for MS Windows operating systems(displays the reported text as continuously updated subtitles) 3rd International Conference „Education for All“, Warsaw 12

13. Polygraf – component for the reporter’s computer 3rd International Conference „Education for All“, Warsaw 13

14. Polygraf – component for the handheld displays POLYGRAF 3rd International Conference „Education for All“, Warsaw 14

15. Polygraf – component for the presenter’s computer 3rd International Conference „Education for All“, Warsaw 15

16. Polygraf – usage and practical experience regularly used throughout the last academic year at Masaryk University (approx. 250 lectures with 3–6 students in each) used for the text-reporting and close captioning of presentations at International Conference Universal Learning Design in Brno, February 2011, two paralel conference rooms, two languages in each 3rd International Conference „Education for All“, Warsaw 16

17. Polygraf – future development embedding a viewer of the presentation screen into the iOS application (especially for visually impaired users) expanding to other platforms than iOS (Android, Windows Phone) compatibility with other systems used among speech-to-text reporters 3rd International Conference „Education for All“, Warsaw 17

18. Thank you for your attention. www.teiresias.muni.cz/polygraf (demo version available) 3rd International Conference „Education for All“, Warsaw 18