Traditional supports create a reliance on intermediaries

2. Traditional supports create a reliance on intermediaries

3. Finding experienced or qualified interpreters, note-takers or re-speakers at university level is difficult

4. Speech Recognition:real time access to spoken language

5. Speech Recognition: also supports note taking

6. SR in classrooms is VERY DIFFICULT! • Star Trek expectations • Special vocabulary • Spontaneous speech not writing • Dialogue and interaction • Andtherearenospacesbetweenwordswhenpeopletalksoitisunclearwherewordsbeginandend

7. How to Wreck a Nice Beach You Sing Calm Incense

8. This is a demonstration of the problem of the readability of text created by commercial speech recognition software used in lectures they were designed for the speaker to dictate grammatically complete sentences using punctuation by saying comma period new paragraph to provide phrase sentence and paragraph markers when people speak spontaneously they do not speak in what would be regarded as grammatically correct sentences as you can see you just see a continuous stream of text with no obvious beginnings and ends of sentences normal written text would break up this text by the use of punctuation such as commas and periods or new lines by getting the software to insert breaks in the text automatically by measuring the length of the silence between words we can improve the readability greatly

9. This is a demonstration of the problem of the readability of text created by commercial speech recognition software used in lectures they were designed for the speaker to dictate grammatically complete sentences using punctuation by saying comma period new paragraph to provide phrase sentence and paragraph markers when people speak spontaneously they do not speak in what would be regarded as grammatically correct sentences as you can see you just see a continuous stream of text with no obvious beginnings and ends of sentences normal written text would break up this text by the use of punctuation such as commas and period or new lines by getting the software to insert breaks in the text automatically by measuring the length of the silence between words we can improve the readability greatly

10. 1998 LIBERATED LEARNING Pilot Project Today we will be discussing applied interactions in psychotherapy and how it related to Canadian law I will be covering chapters 7 8 and nine in preparation for next week;s midterm exam But first are they are questions about what we discussed yesterday lets move forward by asking the following question how does

11. It gives you something to compare your notes to and if you miss a class the notes are still accessible

12. It’s very helpful when the lecturer moves on while you’re still writing down a point as you can look at the screen

13. It’s forced me to be more reflective with my own teaching style and approach

14. It makes me ask myself what is teaching, why am I teaching this way, is there a better way?

15. Initial Research Summary • Helps students access lectures • Students thought it had great potential • Improved teaching but gave teachers extra work • Challenges: accuracy, readability, and ease of use

16. Accuracy & UnderstandingStop / Proceed with Caution / GO

17. 28 KB/s speech signal 320 b/s (240 words/minute) Corrects 15 errors/minute 320 b/s (240 words/minute)

18. SR Post-processing Enhancement Human intermediar(y/ies) can interact with a post processing system through the selection and correction of errors. possible feedback? Speaker(s) SR System using voice & language models Post-processing system for automatic error identification and correction uncorrected words Corrected words

19. Post-processing Enhancement using statistical (including alternates lists and confidence levels), linguistic, context, phonemic, visual, signal and noise information Text with Errors Text without Errors

20. Post-processing Enhancement Topic Detection & Machine Translation Text with Errors Text without Errors

21. Multimedia Text can reduce the memory demands of spoken language Speech can better express subtle emotions Images can communicate moods, relationships and complex information holistically.

22. Easy to find WHOLE of recording but NOT a PART Analogy Text book with front cover but no contents page, index or page numbers

25. multimedia start time multimedia end time audio / video synchronised text captions synchronised images (e.g. Slides) user created synchronised bookmarks, tags, notes with associated links to other resources

26. Multimedia Notes Synchronised Bookmarks Audio Text Captions & Search Collaborate/Reflect Images/Slides Video Organise/Index Tags Links Reason/Summarise

31. Synote Supports learners to … • • search text and replay sections • • read transcript rather than listen to speech • • read text of slide images • • insert bookmark to continue later • • tag/highlight sections (e.g. not understood) • • add synchronised notes • • link to other web pages/resources

32. Synote Support teachers to… • index and tag their recordings • provide synchronised slides and captions • respond to learner tags • link to web pages/resources • link to sections of existing multimedia

33. Synote Demo

34. Questions ? www.synote.org