610 likes | 623 Views
Discover the current landscape of hands-free mice, considerations for making the right choice, feature-matching processes, and data collection tools. Learn about different types of hands-free mice, primary user groups, and factors to consider when selecting the ideal device for your needs.
E N D
Hands-free Mice: what’s available and how to make the “right” choice Heidi Koester, Ph.D. hhk@kpronline.com Koester Performance Research, Ann Arbor, MI https://kpronline.com
Overview Intro + considerations when choosing a hands-free mouse Current landscape of available hands-free mice Feature-matching process Data collection tools for evidence-based choice
What is a hands-free mouse? • Allows full control of mouse functions without use of the hands • Can be used to access computer (Windows, Mac, etc.), as well as tablet or smartphone (Android, iOS) • Primary user is someone with motor impairments • Cervical spinal cord injury • Cerebral palsy • Neuromuscular disease
What is a hands-free mouse? Often (but not always) controlled using the head Mouth, lips, speech, eyegaze, feet, etc. are other possibilities.
A sampling of hands-free mice Lip/chin joysticks Target trackers Speech recognition Wearable sensors Eye trackers Face trackers
Some other mouse methods Switch control Mouthstick stylus MouseKeys
Considerations for choosing a hands-free mouse https://kpronline.com/blog/13-considerations-for-choosing-a-hands-free-mouse • Key things to think about before making a choice • Relative importance depends on specific needs • But a good starting point for making a well-reasoned decision • Considerations about the HFM itself (How it works) • Considerations of user requirements (What the user needs)
Considerations: cursor control • Exactly what you need to do to move the mouse cursor around the screen • Direct control: • Your body movements translate directly into cursor movements • Indirect control: • Hone in on desired location with a series of commands • Speech recognition • Point mode for Switch Control
Considerations: cursor control • Indirect control: • Mouse Grid for speech • Show Numbers for speech • Point mode for Switch Control • 4 switch hits • https://www.youtube.com/watch?v=DRUg2UqGVNc
Considerations: indirect cursor control “Show numbers”, “Choose 12”
Considerations: mouse buttons • Activating mouse buttons • left-click, right-click, double-click • drag • scroll • Switches (external or built-in) • Dwell • Button palette
Considerations: required components • Hardware • Sensor unit? • Wireless receiver? • Switches? • Mounting system? • Software • Special drivers? • Button palette software? • Built-in to OS?
Considerations: wired or wireless? • Wired-to-you (tethered) • Cable “tying” you to the workstation • Roll-up-and-use
Considerations: wearable required? • Target trackers often require a small wearable • Small reflective dot • Wearable sensors have headsets • Speech recognition might require a headset • For best accuracy • (This also makes it tethered, unless you use a wireless mic)
Considerations: something close to face? • Mouth or chin joysticks usually are • Wearable sensors may be • Usually unobstructed: • Eye or face trackers • Speech recognition
Considerations: mounting? Mouth or chin joysticks usually need mounting Target and eye tracker units often do Does the system come with a good mounting solution already? Will it satisfy needs in your setting?
Considerations: compatibility Will it work on the platform(s) you use? Windows, Mac OS, iOS, Android
Considerations for choosing a hands-free mouse • Key things to think about before making a choice • Relative importance depends on specific needs • But a good starting point for making a well-reasoned decision • Considerations about the HFM itself (How it works) • Considerations of user requirements (What the user needs)
Considerations: tasks What are the main tasks that you use the mouse for? Clicking buttons, links only? Running the desktop? (drag, resize) Text entry (on-screen keyboard) Presentations, images, drawing (nudging, cropping, fine adjustments) Consider combining strengths of different mouse solutions to meet your needs
Considerations: need 100% independent use? How important is to be able to use your computer/device with no help from anyone else? If very important or necessary, pay close attention to considerations for wearables, mounting, and connection
Considerations: portability/transferability Do you need to use the system on multiple computers/devices? If software is required, can you install it on all your devices? (feasibility and $)
Considerations: robustness How “touchy” is this system? Positioning Environment Maintenance
Considerations: cognitive load • How much learning and thinking is required to start using this system? • To get good at using it?
Overview Intro + considerations when choosing a hands-free mouse Current landscape of available hands-free mice Feature-matching process Data collection tools for evidence-based choice
6 families of hands-free mice Lip/chin joysticks Target trackers Speech recognition Wearable sensors Eye trackers Face trackers https://kpronline.com/blog/your-guide-to-25-hands-free-mice
Details for each family: https://kpronline.com/blog/wp-content/uploads/2018/11/KPR-hands-free-mice-family-features.pdf
Lip/chin joysticks • Mouse button activation • Built-in sip/puff (IntegraMouse, Jouse3, QuadJoy) • Built-in switch pads (BJOY Chin) • Second joystick (TetraMouse) • Price range:$449 (TetraMouse) to $2496 (IntegraMouse)
Detailed considerations for each device: https://kpronline.com/blog/wp-content/uploads/2018/11/KPR-25-hands-free-mice-features.pdf
Wearable sensors • Mouse button activation • GlassOuse includes jack for 1 switch. All else a la carte. • Zono includes all button options (palette, 2 jacks, dwell) • GlassOuse: Bluetooth. Zono: USB • Prices: $499 (Glassouse) $999 (Zono)
Detailed considerations for each device: https://kpronline.com/blog/wp-content/uploads/2018/11/KPR-25-hands-free-mice-features.pdf
Wearable target trackers • Mouse button activation • Button palette, dwell not included (HeadMouse, TrackerPro) • Wireless receiver for switches (HeadMouse) • Prices: $990 (HeadMouse, TrackerPro)
Webcam face trackers Open Sesame • Possibility of a free solution? • “Tied” to face, which not everyone likes • Resolution, responsiveness may be an issue • Windows only, except Open Sesame (Win + Android)
Eye trackers • Windows 10 Eye Control is intriguing
Speech recognition • Mac OS and iOS due for major upgrade in speech recognition • Price range: $0 (built-in) to $150-300 (Dragon)
Overview Intro + considerations when choosing a hands-free mouse Current landscape of available hands-free mice Feature-matching process Data collection tools for evidence-based choice
Feature matching • Find candidate devices that seem likely to meet your needs • Do this before trialing any devices • Identify your requirements (needed features) • Use HAAT model for overall considerations of your abilities/needs, context/setting, activities/tasks • Use the 13 considerations for specific hands-free mouse considerations • Prioritize your requirements • Match needed features to available features
Resources for identifying needs wati.org educationtechpoints.org SETT framework HAAT model
Meet “Adam” High school student with quadriplegia (C4-5 SCI) Head/neck movements are fairly strong Hand/arm movements very limited – can activate a light touch switch with back of right hand Speech, vision, cognition are all unaffected Grade-appropriate schoolwork, plans on college
Adam’s main needs and current setup • Mouse control and text entry for Windows • Also has Android phone and tablet • Use browser-based software • Home: uses Dragon NaturallySpeaking for dictating text and some mouse commands. HeadMouse tracker (when set up) for remaining mouse control • School: DNS not ideal in most classroom situations. Trying HeadMouse + dwell for mouse control and for text entry with on-screen keyboard. • HeadMouse working OK but is there something better?
Primary questions to address HeadMouse working OK but is there something better, especially for school? Is Dragon OK as the main solution at home, or should he have another mouse solution readily available?
Adam’s feature list Cursor control: direct. Head control probably best but all options possible (lip/chin, face, speech, eye) Mouse buttons: built-in switches, but dwell ok if needed Components/connections: The fewer, the better. Will be set up at start of each class. Prefer not to be tethered. Wearable-free: Would rather don a headset for class than wear a dot on forehead Away from face: preferred Mounting: prefer to have none Compatibility: Needs to be available for Windows & Android, with options for additional platforms.
Adam’s feature list Tasks: typing with on-screen keyboard. Regular mouse control + precise control for drawing, presentations 100% independent use: not strictly needed in school but good as a goal Portability/transferability: has own laptop, so needs to be portable but not necessarily transferable. (Secondary consideration is having a solution for school computers when laptop not convenient or available) Robustness: Easy to setup & position. Works in all lighting conditions. Speech not usually best option in classrooms. Needs to be pretty tough, transportable Cognitive load: prefer typical mouse paradigm but cognition not a concern
Feature-match at the family level Can we eliminate any families at this point? Lip/chin joysticks: for school, not a good fit due to mounting, components, and setup. (Might be a great option for home, however.) Eye trackers: less direct and precise cursor control Speech: not a good fit for school Consider wearable sensors, target trackers, and face trackers
Feature-match at the device level Narrow down to devices in each family Feature-matching table to identify any unsuitable devices Use checklist, spreadsheet, etc. to compare Adam’s feature list to the features available in each hands-free mouse option
Feature-match at the device level Example spreadsheet
Adam’s candidate devices After feature-matching each family: Wearable sensors: GlassOuse, QuhaZono Target trackers: HeadMouse Nano, Tracker Pro Face trackers: several Windows options