1 / 25

What we learn about technology from people living with dementia

What we learn about technology from people living with dementia. Jim Ang Panote Siriaraya School of Engineering and Digital Arts University of Kent. Jim Ang. Game and virtual world enthusiast Email junky Dream about uploading my conscious to the net

ayanna
Download Presentation

What we learn about technology from people living with dementia

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. What we learn about technology from people living with dementia Jim Ang PanoteSiriaraya School of Engineering and Digital Arts University of Kent

  2. Jim Ang • Game and virtual world enthusiast • Email junky • Dream about uploading my conscious to the net • Lecturer in multimedia and digital systems • Backgrounds in human computer interaction/man-machine interaction

  3. PanoteSiriaraya • Background in Human-Computer Interaction with an emphasis on designing technology to support aging • Likes to build and program stuff (web app, simulators for rescue robots and recently virtual worlds) • Research Associate at University of Kent

  4. The project • Funded by EPSRC for 13 months (from Oct 2012) • In collaboration with Silverfit and Avante care homes in UK and the Netherlands • AgeUK and Society Alzheimer’s Society

  5. Care homes

  6. Dementia

  7. 3D virtual worlds • Aim: • How can 3D virtual worlds be designed to support older people (in the care environment) and carers • Why virtual ? • Access to certain objects which may be otherwise not accessible physically • Able to (in principle) visit any locations • Potentially cheaper and safer than physical activity

  8. Natural user interface • Interaction with 3D virtual worlds is complex • No straightforward mapping between 2D interaction devices (keyboard and mouse) to 3D space. • Gesture-based interaction • Kinect • Leap motion

  9. Prototype 1

  10. Prototype 1

  11. Initial observations • Residents were disoriented and confused when using the virtual room • They were unable to associate their actions with the on screen avatar • The “picking up objects” system was confusing • Avatar’s hand went through the table • giving them complete interactivity freedom (just do whatever you want and the avatar will reflect this) is not supported by Kinect yet.

  12. Prototype 2

  13. Prototype 2 http://www.youtube.com/watch?v=bflFQOPc9YI

  14. Prototype 3

  15. Lesson learnt about virtual world technology for dementia • They love technology! • The experience of virtual worlds could help in the recovery of self through place-based reminiscence • Safe and expressive virtual wonderland • Virtual worlds could provide a “sanctuary” to maintain the continuity of self

  16. Muscle memory • Visual, audio memory – used a lot in reminiscence therapy • Research has suggested that the ways in which we think is an extension of our existence as embodied minds. The way we think is driven by our physical motions, which in turn drive the way that we think. • Triggering muscle memory with gesture interaction ?

  17. Presence • For virtual world to be effective, users should be able to suspend their disbelief and maintain the illusion that the alternative • almost all residents were able to see the projected screen as a place they were situated in and perceive themselves as actually performing the activity

  18. Tangible user interface/physical computing • Although these prototypes worked for many residents, they didn’t work for those with a more severe condition • Touch appeared important! • Internet of things / ubiquitous computers • Linking physical to virtual

  19. Let the experimentation begin!

  20. Linking to physical world http://www.youtube.com/watch?v=YUGcRowBQfc http://www.youtube.com/watch?v=PC3ht4Bbh3U

  21. Linking to physical world http://www.youtube.com/watch?v=ndxOZoDEFyI http://www.youtube.com/watch?v=P01HX6mgBfo

  22. Day-to-day objects as interaction devices

  23. Day-to-day objects as interaction devices • NFC http://www.youtube.com/watch?v=Q3jjFjIJJRU

  24. Lesson learnt about (virtual world) technology • Our interaction with technology focuses too much audio and visual – what about physical touch? • Virtual world technology should not just be “virtual.” It can include a physical element • Fully immersive vs mixed reality

  25. virtual coordinator

More Related