1 / 38

Designing Technology For People with Disabilities Maria Klawe Harvey Mudd College

Designing Technology For People with Disabilities Maria Klawe Harvey Mudd College. Outline. The opportunity Two examples The Aphasia Project Swing Swing Revolution. The opportunity. Inexpensive multi-modal technologies New input devices Wii, Guitar Hero, Dance mat

havard
Download Presentation

Designing Technology For People with Disabilities Maria Klawe Harvey Mudd College

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Designing Technology For People with Disabilities Maria Klawe Harvey Mudd College

  2. Outline • The opportunity • Two examples • The Aphasia Project • Swing Swing Revolution

  3. The opportunity • Inexpensive multi-modal technologies • New input devices • Wii, Guitar Hero, Dance mat • Health care slow to use information technology • Aging population • Cognitive and physical deficits

  4. What is Aphasia? Aphasia is a loss of words – not intelligence lhd have meelk • Acquired language disorder • Caused by brain damage (e.g. stroke, trauma, etc.) • Impairment of communication abilities • Relative sparing of other cognitive abilities

  5. Impact of Aphasia • More common than Parkinson’s disease • Withdrawal from society

  6. Problems with existing solutions • Limited to communication; lack of higher level applications • Communication too slow for most aphasics • Stigma of relying on laptops in public • Poor user-interface of handhelds • Buttons too small • Confusing navigation • Poor organization of multi-media data

  7. The Aphasia Project • Goal: understand how individuals with aphasia communicate and seek opportunities where technology can better support individuals in their daily life • Interdisciplinary project: computer science, psychology, speech language pathology • Multi-site: UBC, Princeton, aphasia centers

  8. Types of Subprojects I: Participatory design of application prototypes • Daily planner • Handheld • Combined handheld and laptop system • Recipe book (laptop or tablet) • File system (handheld) II: Evaluation of commercial PDAs • Long term use by Skip • Short term use of camera function • Basic research • Impact of aging on use of mobile devices • Effectiveness of images and videos versus icons in visual language

  9. Special challenges with research involving aphasics • Access to participants • Communication with participants • Every individual is different • Right hemiparesis • Lack of experience with computers, PDA

  10. Participatory Design of a High-Level Application Prototype Anita Borg, 1949 - 2003 • daily planner Karyn Moffatt

  11. ESI Planner 1 The Enhanced with Sound and Images Planner • PDA application (iPaq from HP) • A computerized daily planner designed for people with aphasia • Uses images, sound, and text to represent people and places in appointments

  12. I: Images, Sound, Text… • Say you have an appointment with Queen Elizabeth, at the Eiffel Tower on November 6, 2003 from 8:00am to 10:00am • ESI Planner would display it like this:

  13. I: Participatory Design • Five phases

  14. I: Participatory Design • Five phases • Idea brainstorming • Interviews • Identified needs: • Daily planner • Recipe book ? ? ?

  15. June: 9/6/03 6 7:00 am - 9:30 am 7 8 Marilyn Monroe Eiffel Tower 9 10 10 11 Starts 11 : 15 20 12 1 Ends 1: 00 05 2 3 4 5 6 7 8 I: Participatory Design • Five phases • Idea brainstorming • Paper low-fi prototypes 2 - Using computer tools 1 - Drawn by hand

  16. I: Participatory Design • Five phases • Idea brainstorming • Paper low-fi prototypes • Medium-fi prototypes

  17. I: Participatory Design • Five phases • Idea brainstorming • Paper low-fi prototypes • Medium-fi prototypes • High-fi prototypes and formal evaluation in lab • Field study lasting several weeks

  18. I: High-fi Prototypes ESI Planner NESI Planner

  19. I: Formal Evaluation • 8 participants • Session 1: • 30 minutes with each Planner (ESI and NESI) • 10 tasks (retrieval, creation, modification) • # of tasks completed • # of tasks completed correctly • Session 2: Western Aphasia Battery

  20. I: Results Preference: 5 ESI, 3 NESI. Significantly more tasks completed correctly with ESI Planner.

  21. Limitations of ESI Planner 1 • Need for field study • Interface for input and modification of appointments (small buttons, too cluttered) • Lack of stable memory on iPAQ after power loss • Lack of library of icons and sounds • Difficulties of participatory design with aphasics

  22. ESI Planner 2 • Input on laptop • Lingraphica library of icons and sounds • Stable memory • Built-in camera in iPAQ • Participatory design with speech language pathologists (SLPs) • Four week field study

  23. The Field Study • Seven aphasics at Adler Aphasia Center • Four weeks, one videotaped meeting with each participant per week • Log of interactions with iPAQ and computer

  24. Outcomes • Limited use of appointments • Input only possible at Adler Center • Desire for input on iPAQ • Extensive use of camera • Desire for better photo management on iPAQ • Problems with sound playback • Range of text and speech abilities • Enthusiasm for continued use of iPAQs

  25. Current projects • Understanding visual languages, e.g. video vs still images • Hierarchical vs semantic nets for word access • Effects of aging on device interactions

  26. Broader impact • Dual usefulness between aphasics and elderly (poor vision, memory loss, Alzheimers, etc.) • Other visual language applications

  27. For More Info… http://www.cs.ubc.ca/projects/Aphasia/

  28. Swing Swing Revolution • Goal: increase balance, mobility and fitness in older people • Approach: modify Dance Dance Revolution

  29. DDR mat

  30. DDR game

  31. DDR game

  32. DDR game

  33. DDR game

  34. DDR game

  35. DDR game

  36. DDR game

  37. modifications • Finer grained dance mat • Can select subset of mat (e.g. one side) • Gradual increase in difficulty • Use with walker or balance rails • Age appropriate music

  38. Questions and comments

More Related