Pardon Me, Your Computer’s Showing Using speech to speed and streamline desktop computing

1. Pardon Me, Your Computer’s Showing Using speech to speed and streamline desktop computing Kimberly Patch President, Redstart Systems SpeechTek West February 22, 2007

2. Keys to Using Speech to Speed • and Streamline Computer Control • Minimizing steps • Making commands easy to remember • Enabling combinations

3. Human-Machine Grammar • Follows the way the brain works • Designed for controlling a computer

4. Keys to Using Speech to Speed • and Streamline Computer Control • Minimizing steps

5. Tap existing knowledge, but don’t let experience confine new methods of communication.

6. Retrieving a Picture 11 steps

7. Think outside the silicon box

8. Retrieving a Picture 11 steps

9. Retrieving a Picture 3 steps 2 steps

10. Address Email and Add Subject, First Line 12 steps

11. Address Email and Add Subject, First Line 12 steps3 steps

12. Accommodating vs. Direct

13. Accommodating vs. Direct

14. Keys to Using Speech to Speed • and Streamline Computer Control • Minimizing steps • Making commands easy to remember

15. How do you remember commands?

16. Two Fry

17. Counter Trey Right

18. Unit 26, Code 11-31, 13th and Vine

19. Delta 265, Clear to Land, Runway 3-0

20. Chair Dance Teeth Grow

21. Blues 2

22. Efficiently Worded Instruction

23. Important Factors • How the brain processes words

24. Important Factors • How the brain processes words • Memory chunking

25. Important Factors • How the brain processes words • Memory chunking • Six degrees of separation

26. Human-Machine Grammar • No synonyms

27. Human-Machine Grammar • No synonyms • Logical rules to minimize wording possibilities

28. Human-Machine Grammar • No synonyms • Logical rules to minimize wording possibilities • Follows the way the brain uses language

29. UC Top 60 Command Words (plus numbers and labels)

30. Most Common HMG Rules • Match words used for a command as closely as possible • with what the command does • Be consistent • Eliminate synonyms • Follow the way people naturally adjust language to fit • a situation • Follow the order of events

31. Common Commands Speech On Line Copy 3 Before Window Close Screen Clear

32. Keys to Using Speech to Speed • and Streamline Computer Control • Minimizing steps • Making commands easy to remember • Enabling combinations

33. Computer Command Steps

34. Computer Command Steps

35. Computer Command Steps

36. Carnegie Mellon Study 74% of users prefer a structured rather than natural language approach to speech recognition Speech Graffiti Vs. Natural Language: Assessing the User Experience, Stephanie Tomko and Roni Rosenfeld, Carnegie Mellon University www.cs.cmu.edu/~usi/papers/HLT04.pdf

37. Command Language Based on Efficient Human Process • Minimal steps

38. Command Language Based on Efficient Human Process • Minimal steps • Easy-to-remember commands

39. Command Language Based on Efficient Human Process • Minimal steps • Easy-to-remember commands • Combinations

40. Beyond the Keyboard and Mouse • Speech links • Document access and navigation • Favorites-like lists • Virtual calculator

41. Word Help – Insert a Special Character 8 steps 7 steps

42. Beyond the Keyboard and Mouse • Speech links • Document access and navigation • Favorites-like lists • Virtual calculator

43. kim@redstartsystems.com • www.redstartsystems.com • Human-Machine Grammar • Papers and presentations • Utter Command – speech interface software • that works the way your brain does