1 / 77

earPod : Eyes-free Menu Selection with Touch Input and Reactive Audio Feedback

earPod : Eyes-free Menu Selection with Touch Input and Reactive Audio Feedback. Shengdong Zhao. Pierre Dragicevic. Mark Chignell. Ravin Balakrishnan. Patrick Baudisch. Menu Selection on Mobile Devices Often Requires Visual Feedback. Why Eyes-free?. Why Eyes-free?.

dinah
Download Presentation

earPod : Eyes-free Menu Selection with Touch Input and Reactive Audio Feedback

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. earPod:Eyes-free Menu Selection with Touch Input and Reactive Audio Feedback Shengdong Zhao Pierre Dragicevic Mark Chignell Ravin Balakrishnan Patrick Baudisch

  2. Menu Selection on Mobile Devices Often Requires Visual Feedback

  3. Why Eyes-free?

  4. Why Eyes-free?

  5. Eyes-free capable

  6. Eyes-free capable Marking Menus

  7. Eyes-free capable Marking Menus (Expert Use)

  8. Eyes-free capable Marking Menus (Expert Use)

  9. True eyes-free • TouchPlayer (Pirhonen et al, 2002)

  10. True eyes-free • TouchPlayer (Pirhonen et al, 2002) • Head gesture-based auditory pie menu (Brewster et al, 2003)

  11. earPod 13

  12. earPod 14

  13. earPod Design 15

  14. earPod Walkthrough 16

  15. Browsing

  16. Fast browsing 18

  17. Fast browsing

  18. Very fast browsing and cancel 20

  19. Very fast browsing and cancel

  20. Expert use

  21. Expert use

  22. Interactive Voice Response System 24

  23. Interactive Voice Response System Slow Painful “Touchtone Hell” (Yin and Zhai, 2006) 25

  24. Characteristics of IVR • Inpatient user • Urgent; want to talk to real person • Lack of user control • It’s both bad and good • Typically narrow but deep phone tree, resulting long sentences

  25. Visual vs. auditory menu Visual Linear Menu 27

  26. Visual vs. auditory menu IVR System Visual Linear Menu 28

  27. Problems of IVR system • Speech is serial and slow (Slowiaczek and Nusbaum 1985)

  28. System Visual Outputs time Mouse Input User Problems of IVR system • Synchronous vs. asynchronous communication Synchronous

  29. System System Visual Outputs Audio Audio time time Press Key Press Key Waiting Waiting Mouse Input User User Problems of IVR system • Synchronous vs. asynchronous communication Asynchronous Synchronous

  30. Problems of IVR system • Transition to expert use Skill level Novice (Voice menu: recognition) Skill development

  31. Problems of IVR system • Transition to expert use Expert (direct code access: recall) Skill level Novice (Voice menu: recognition) Skill development

  32. Problems of IVR system • Transition to expert use Expert (direct code access: recall) Skill level Novice (Voice menu: recognition) Skill development

  33. earPod’s approach • Problem: speech is serial and slow

  34. earPod’s approach • Problem: speech is serial and slow • By-pass audio

  35. earPod’s approach • Problem: speech is serial and slow • By-pass audio • Use interruptible audio feedback

  36. earPod’s approach • Problem: speech is serial and slow • By-pass audio • Use interruptible audio feedback • Use non-speech audio

  37. earPod’s approach • Problem: asynchronous communication

  38. Audio Outputs time Touchpad Input User earPod’s approach • Problem: asynchronous communication • Synchronous communication (reactive audio feedback)

  39. earPod’s approach • Problem: steep novice to expert transition

  40. Smooth transition • Learning menu structure

  41. Smooth transition • Learning menu structure • Learning expert gesture Target Item

  42. Smooth transition • Learning menu structure • Learning expert gesture Target Item Novice

  43. Smooth transition • Learning menu structure • Learning expert gesture Target Item Novice Novice/Expert

  44. Smooth transition • Learning menu structure • Learning expert gesture Target Item Novice Novice/Expert Expert

  45. Expert (direct tapping: recall) Skill level Novice (glide browsing: recognition) 47 Skill development

  46. Support Single-hand Usage (Karlson et al, 2007) 48

  47. Haptic guidance

  48. Haptic guidance

More Related