1 / 76

earPod : Eyes-free Menu Selection with Touch Input and Reactive Audio Feedback

This article discusses the design and capabilities of earPod, a menu selection system for mobile devices that is designed to be used without visual feedback. It explores the challenges of eyes-free menu selection and presents solutions such as reactive audio feedback and marking menus. The article also highlights the benefits of an auditory-based menu system and describes the design and walkthrough of earPod.

shirk
Download Presentation

earPod : Eyes-free Menu Selection with Touch Input and Reactive Audio Feedback

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. earPod:Eyes-free Menu Selection with Touch Input and Reactive Audio Feedback Shengdong Zhao Pierre Dragicevic Mark Chignell Ravin Balakrishnan Patrick Baudisch

  2. Menu Selection on Mobile Devices Often Requires Visual Feedback

  3. Why Eyes-free?

  4. Why Eyes-free?

  5. Eyes-free capable

  6. Eyes-free capable Marking Menus

  7. Eyes-free capable Marking Menus (Expert Use)

  8. Eyes-free capable Marking Menus (Expert Use)

  9. True eyes-free • TouchPlayer (Pirhonen et al, 2002)

  10. True eyes-free • TouchPlayer (Pirhonen et al, 2002) • Head gesture-based auditory pie menu (Brewster et al, 2003)

  11. earPod 13

  12. earPod 14

  13. earPod Design 15

  14. earPod Walkthrough 16

  15. Browsing

  16. Fast browsing 18

  17. Fast browsing

  18. Very fast browsing and cancel 20

  19. Very fast browsing and cancel

  20. Expert use

  21. Expert use

  22. Interactive Voice Response System 24

  23. Interactive Voice Response System Slow Painful “Touchtone Hell” (Yin and Zhai, 2006) 25

  24. Visual vs. auditory menu Visual Linear Menu 26

  25. Visual vs. auditory menu IVR System Visual Linear Menu 27

  26. Problems of IVR system • Speech is serial and slow (Slowiaczek and Nusbaum 1985)

  27. System Visual Outputs time Mouse Input User Problems of IVR system • Synchronous vs. asynchronous communication Synchronous

  28. System System Visual Outputs Audio Audio time time Press Key Press Key Waiting Waiting Mouse Input User User Problems of IVR system • Synchronous vs. asynchronous communication Asynchronous Synchronous

  29. Problems of IVR system • Transition to expert use Skill level Novice (Voice menu: recognition) Skill development

  30. Problems of IVR system • Transition to expert use Expert (direct code access: recall) Skill level Novice (Voice menu: recognition) Skill development

  31. Problems of IVR system • Transition to expert use Expert (direct code access: recall) Skill level Novice (Voice menu: recognition) Skill development

  32. earPod’s approach • Problem: speech is serial and slow

  33. earPod’s approach • Problem: speech is serial and slow • By-pass audio

  34. earPod’s approach • Problem: speech is serial and slow • By-pass audio • Use interruptible audio feedback

  35. earPod’s approach • Problem: speech is serial and slow • By-pass audio • Use interruptible audio feedback • Use non-speech audio

  36. earPod’s approach • Problem: asynchronous communication

  37. Audio Outputs time Touchpad Input User earPod’s approach • Problem: asynchronous communication • Synchronous communication (reactive audio feedback)

  38. earPod’s approach • Problem: steep novice to expert transition

  39. Smooth transition • Learning menu structure

  40. Smooth transition • Learning menu structure • Learning expert gesture Target Item

  41. Smooth transition • Learning menu structure • Learning expert gesture Target Item Novice

  42. Smooth transition • Learning menu structure • Learning expert gesture Target Item Novice Novice/Expert

  43. Smooth transition • Learning menu structure • Learning expert gesture Target Item Novice Novice/Expert Expert

  44. Expert (direct tapping: recall) Skill level Novice (glide browsing: recognition) 46 Skill development

  45. Support Single-hand Usage (Karlson et al, 2007) 47

  46. Haptic guidance

  47. Haptic guidance

  48. earPod Design Summary • Touch Input 50

More Related