From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People

1. From Smart Home to Smart Care :Pervasive Assistance for Cognitively Impaired People • Sylvain Giroux

2. Plan • Context • Objectives and Approach • Pervasive computing • Tangible User interface • Mobile computing • From smart homes • Hardware : the lab • To smart care • Middleware • A pervasive reminder system • Cognitive assistance • Plan recognition • In situ clinical studies • Conclusion

3. Context • People suffering of cognitive impairments in Quebec • Alzheimer disease : 5.1% of people over 65 years old • Head trauma : 3000 new cases each year • Schizophrenia : 1% of the population • They would be able to stay at home • if light assistance was provided. • But healthcare resources are scarce. • So relatives have to take responsibility for care. • turns to an exhausting burden. • Hence relatives and caregivers urge for help.

4. Objectives • Provide adapted and personalized environmental cues to • Foster the autonomy of cognitively impaired people at home • Lessen risks and hazards at home • Pervasive computing • Tangible user interfaces • Keep ensuring continuous cognitive assistance outside people’s home • Mobile computing • Location-based services • Help relatives and caregivers to keep in touch at distance with cognitively impaired people

5. General architecture

6. From smart homes… • Smart homes are augmented environments • Heterogeneous networks • Sensors networks • Embedded computers • Information appliances • Networked communicating objects

7. An augmented apartment

8. A intégrer • Ariane Controls • Contrôle de l’éclairage • Crestron • Contrôle audio/vidéo • Multi-affichage sur écran • Contrôle du débit d’eau • X10

9. From smart homes… • Smart homes are augmented environments • Heterogeneous networks • Wireless • WiFi, Bluetooth, RFID, UWB, etc. • Wired • Ethernet, Electrical wires • Servers • Controls over sounds and video streams

10. From smart homes… • Smart homes are augmented environments • Sensors networks • Identification and localization of objects and people • Ubisense, UWB • Smart tags (RFID)

11. From smart homes… • Smart homes are augmented environments • Embedded computers • Not yet investigated

12. From smart homes… • Smart homes are augmented environments • Information appliances

13. From smart homes… • Smart homes are augmented environments • Networked communicating objects

14. … to smart care • Smart homes can assist cognitively impaired people and foster their autonomy. • Indeed such augmented homes can become true cognitive prostheses. • As well, smart homes can • help caregivers to grant better care • give a sense of security to residents and their relatives.

15. Middleware • Spontaneous networking • Heterogeneous networks • Autonomic computing • Mobile code and agents • Location and context awareness • Security and privacy

16. A Pervasive Reminder Systemfor Smart Homes • Identification and localization of a user • Transitory coalition of devices • Pervasiveness: • Integration in a real living environment • Fluid usage • Transparent user friendly migration of sessions • Zero-configuration • Spontaneous networking and service discovery • To cope with heterogeneity of devices and hardware, networks • Keeping the system in a clean state • Simon Guertin, M. Sc.

17. Multi-channel delivery of geo-referenced services • Thèse de Davide

19. Cognitive assistance • What are the primitive information needed • What are the objects involved in an activity ? • Track primitive actions • What is the user doing or wants to do ? • Plan recognition • Hierarchical models • Lattice • Assist the user • Highligth objects • Tangible user interfaces

20. Plan recognition • Hierarchical models • Lattice-based models • No action models • Kautz

21. Personnalization • Appli de Jérémie en maîtrise

22. Cognitive deficits • Attention • Memory • Planing • Initiation

23. Attention deficits • During task completion, the person shifts her attention from the activity under progress to a stimulus causing interference. • The person demonstrates difficulty to focus on the activity to be performed and as a consequence, the current activity should be forgotten and never completed.

24. Planning deficits • The planning deficit leads to the difficulty to perform an appropriate sequence of actions in order to achieve a goal.

25. Memory deficits • The memory processes refer to information storage and retrieval. • Suffering from memory deficits could lead to difficulties to remember the activity to perform, the steps of the activity or the locations of the tools and materials involved in that activity. • Follow-me The lamp turns on to highlight the searched object (red book) The lamp turns off when the object is too far away.

26. Initiation deficits • The initiation deficit leads to inactive periods whereas the person is supposed to perform actions • For example, during breakfast time, standing in the kitchen for a long time could be attributed to an initiation deficit.

27. Clinical studies • Centre de recherche Fernand-Séguin, • Dr Emmanuel Stip, psychiatrist • Expérimentation pageurs JF moreau • Centre de résadaptation Estrie • Head trauma

28. Conclusion • At the DOMUS laboratory, on-going research projects aim at building the theory and praxis of pervasive computing and tangible user interfaces (TUI) compulsory to create smart homes for cognitively impaired people. • Pervasive computing enables a seamless integration of assistance in residents’ everyday life • while TUI turn the whole house into a cognitive prosthesis. • Prototypes are used to investigate how pervasive services and TUI can support and enhance healthcare and communication between people and caregivers. • A fully-equipped experimental apartment can accommodate cognitively impaired people and their caregivers for day and night. • The middleware provides for spontaneous networking, distributed and mobile computing, and sensor networks. • Cognitive assistants use descriptions of activities of daily living to reason upon resident actions. They then rely on context awareness and TUI to interact with people. • Finally the assistance systems remotely share information with caregivers.

29. Our team • Researchers • Faculty of science • Sylvain Giroux, • Ph. D. in Computer science • Hélène Pigot, • Ph. D. in Computer science and B. in occupational therapy • André Mayers, • Ph. D. in Computer science and M. inpsychology • Faculty of engineering • Philippe Mabilleau, • Ph.D. in engineering • Faculty of administration • Claude Caron (geo-business) • Analyst • Francis Bouchard • Students • 6 Ph. D. students • 12 M. Sc. students • 6 B.Sc. students, • 2 international trainees (M. Sc. level)

30. Collaborations • Medical aspects • CRE, Centre de réadaptation Estrie (head trauma) • Institut de gériatrie de Sherbrooke • Centre de recherches Fernand Séguin, Université de Montréal (schizophrenia) • Institut de réadaptation, Université de Montréal • Alzheimer disease • Computer science • France Telecom • Ariane Controls, Canada • Université Joseph Fourier, Grenoble • UQAM

31. Thank you for your attention http://domus.usherbrooke.ca/

32. Medical aspects CRE, Centre de réadaptation Estrie (head trauma) Institut de gériatrie de Sherbrooke Centre de recherches Fernand Séguin, Université de Montréal (schizophrenia) Institut de réadaptation, Université de Montréal Alzheimer disease Computer science France Telecom Ariane Controls, Canada Université Joseph Fourier, Grenoble UQAM Collaborations

33. At the DOMUS laboratory, on-going research projects aim at building the theory and praxis of pervasive computing and tangible user interfaces (TUI) compulsory to create smart homes for cognitively impaired people. Pervasive computing enables a seamless integration of assistance in residents’ everyday life while TUI turn the whole house into a cognitive prosthesis. Prototypes are used to investigate how pervasive services and TUI can support and enhance healthcare and communication between people and caregivers. A fully-equipped experimental apartment can accommodate cognitively impaired people and their caregivers for day and night. The middleware provides for spontaneous networking, distributed and mobile computing, and sensor networks. Cognitive assistants use descriptions of activities of daily living to reason upon resident actions. They then rely on context awareness and TUI to interact with people. Finally the assistance systems remotely share information with caregivers.