Haptic Perception and Cognition: Using Geons for the Blind

1. Haptic Perception and Cognition: Using Geons for the Blind By: Nathan Bench

2. Outline 1. INTRODUCTION TO BLIND NAVIGATION & WAY-FINDING 2. RESEARCH IN BLIND NAVIGATION & WAY-FINDING 3. (RELATED TANGENT) 4. PROPOSED RESEARCH STUDY 5. FINAL THOUGHTS Haptic Perception and Cognition: Using Geons for the Blind

3. Haptics provides a means of perception through tactile feedback that imparts understanding of our environment. -Leaderman & Klatzky (2009), Giudice & Legge, (2008) Haptic Perception and Cognition: Using Geons for the Blind

4. 1. Introduction Blind Statistics: Need for Technology 1.3 million Americans are legally blind and 22.5 million Americans suffer from some form of vision loss. Globally 37 million are blind and 124 million suffer from some form of vision impairment. Haptic Perception and Cognition: Using Geons for the Blind

5. 1. Introduction Current Mobility Aids The white cane and guide dog are the most preferred mobility aid. Primary areas for development (Dakopoulosand Bourbakis, 2010): Vision enhancement Vision replacement Vision substitution BAT K-Sonar Trekker Breeze BrailleNote GPS Mobile Geo software vOICe system Haptic Perception and Cognition: Using Geons for the Blind

6. 1. Introduction The Idea: Blind Navigation Jack Loomis -1985 idea for technology use for navigation. -Digital maps -Way-finding via landmarks -Audio feedback -Haptics Haptic Perception and Cognition: Using Geons for the Blind

7. 2. Research in Blind Mobility Sensory Substitution vOICe System-Meijer (1992)-Soundscapes (show example clip)Tongue Display Unit (TDU)-Ptito, Chebat, and Kupers (2008) -Tactile stimulationTraining-Found to increase understanding of sensory substitution Haptic Perception and Cognition: Using Geons for the Blind

8. 2. Research in Blind Mobility GPS, Optics, & Haptics Personal Guidance System (PGS) (1985-2008) -Loomis, Klatzky, & Golledge Research Body Mounted Vision System-Treuillet et al. (2007) Haptic Virtual Surface -Turchet et al. (2010) Bionic Eye-Zrenner et al. (2010)Tactile Handheld Miniature Bidirectional device (THMB)-Luk et al. (2006)-Hayward and Cruz-Hernandez (2000) Large Area Tactile Pattern Display (LATPaD)-Lévesque et al. (2011) THMB (a) with tactile display (b) that is controlled by piezoelectric actuators (b). (Image by Luk et al., 2006). LATPaD is controlled by piezoelectric actuators and position sensing (Image by Lévesque et al. (2011). Haptic Perception and Cognition: Using Geons for the Blind

9. 2. Research in Blind Mobility Advantages of Haptic Use “Haptic[s] … allows for users to feel virtual objects in a simulated environment.”-Salisbury, Conti, & Barbagli Haptic Perception and Cognition: Using Geons for the Blind

10. 2. Research in Blind Mobility Disadvantages & Limitations of Haptic Use Vision and audition stimulus [are] perceived and processed at a greater rate than haptic stimulus. -Connell & Lynott (2009) Haptic Perception and Cognition: Using Geons for the Blind

11. 3. Tangent Brownian Motion 1827 the English botanist Robert Brown noticed that pollen grains suspended in water jiggled about under the lens of the microscope Video Haptic Perception and Cognition: Using Geons for the Blind

12. 3. Our approach Haptic Perception and Cognition: Using Geons for the Blind

13. Testing 3. Our approach Software: Nano Cubes High temperature Low temperature Haptic Perception and Cognition: Using Geons for the Blind

14. Testing 3. Our approach Participant use in action Haptic Perception and Cognition: Using Geons for the Blind

15. Testing 3. Our approach Software and Falcon in action Haptic Perception and Cognition: Using Geons for the Blind

16. Testing 3. Our approach • Group 1 • Group 2 Two Participant Groups • Pre-test • Video Visual Visuohaptic • Post-test Haptic Perception and Cognition: Using Geons for the Blind

17. Testing 3. Results 4 3 Score Difference 2 1 0 V VH Type p value= .0085 Haptic Perception and Cognition: Using Geons for the Blind

18. Introduction 4. Proposed Research Study Recognition-by-Components (RBC) theory developed by Irving Biederman (1987) Spatial cognition and haptic perception in blind and low-sighted individuals Human sensory perception and how it relates to navigation and way-finding. Haptic Perception and Cognition: Using Geons for the Blind

19. Geons 3. Proposed Research Study Examples of Biederman’sgeons and how they are used to create other objects. (Biederman, 1987). Haptic Perception and Cognition: Using Geons for the Blind

20. Geon Properties 3. Proposed Research Study View Invariant* 
Discriminable 
Noise Resistant 
Parsimonious Edge & concavity detection Examples of Biederman’sgeons and how they are used to create other objects. (Biederman, 1987). Haptic Perception and Cognition: Using Geons for the Blind

21. Supporting Research 3. Proposed Research Study Recognition-by-components (RBC) -Biederman (1987) Haptic Perception -J. J. Gibson (1962) -Lederman & Klatzky (2009) -Hayward (2008) Spatial Cognition -Olson & Bialystok (1983) -Golledge (2004) Cognitive Mapping -Golledge (1999, 2004) -Hommel & Knuf (2003) Way-finding -Allen (1999) -Arentze, Dellaert & Timmermans (2008) Audition -Magnusson et al. (2002) -O’Callaghan (2007) -Norman (2002) Haptic Perception and Cognition: Using Geons for the Blind

22. Significance 3. Proposed Research Study Lack of in depth research on this topic New area of technological understanding Potential application in navigation Haptic Perception and Cognition: Using Geons for the Blind

23. 3. Proposed Research Study Methodology & Framework Signal Detection Theory-humans are quite acute to observable stimuliInformation Processing Theory-how humans process information for decision and behavior Haptic Perception and Cognition: Using Geons for the Blind

24. Experimental Design 3. Proposed Research Study Reversed Haptic Virtual Shape -Exploration -Learning -Application B A {Assumption} low-force predilection over high-force Top-down view example reversed haptic virtual shape. A) The shape of low force feedback. B) The area of high force feedback. Haptic Perception and Cognition: Using Geons for the Blind

25. Experimental Design 3. Proposal of Research Reversed Haptic Virtual Shape Haptic Perception and Cognition: Using Geons for the Blind

26. Testing 3. Proposal of Research • Sightedw/ sound • Sighted w/o sound • Blind w/ sound • Blind w/o sound Four Participant Groups • Exploration • Learning • Application • Survey Haptic Perception and Cognition: Using Geons for the Blind

27. 4. Conclusion Review & Final Thoughts Haptic Perception and Cognition: Using Geons for the Blind

28. The end Thank you. Haptic Perception and Cognition: Using Geons for the Blind