80 likes | 265 Views
AISN. http://www.cs.bgu.ac.il/~royif/AISN. Auditory imaging for sightless navigation. Yakir Dahan Vitali Sepetnitsky Royi Freifeld. Overview. Project Goals Challenges Main Steps Technologies Schedule. Project Goals. Sightless navigation by sensory substitution
E N D
AISN http://www.cs.bgu.ac.il/~royif/AISN Auditory imaging for sightless navigation YakirDahan VitaliSepetnitsky RoyiFreifeld
Overview • Project Goals • Challenges • Main Steps • Technologies • Schedule
Project Goals • Sightless navigation by sensory substitution • Development of an application that allows a person to navigate, relying primarily on the sense of hearing • Development of spatial auditory environment • Providing a flexible testing environment for future research
Main challenges • 3D sound generation • Choosing / generating sound samples that on one hand will reveal as much information as possible about the visual objects and on the other hand will be intuitive (easily interpreted). • Image analysis • Applying a reliable object tracking mechanism
Main steps • Shapes detection • Objects tracking • Sounds creation (according to a 3D image) • Human subject research
Technologies • Image processing • OpenCV • 3D sound generation and processing • Binaural spatialization using HRTF datasets • OpenAL (Creative Labs / Rapture3D) • JavaSound3D • DirectSound3D
Project schedule (expected) • Summer 2010 – Theoretic research • Learning and testing 3D sound & image technologies • October – November • Choosing technologies • System architecture • Application Requirements Document draft • December – January 2011 • Final version of ARD • Working on prototype
Project schedule (cont.) • February – March • Final prototype • Application Design Document draft • Application development • April - May • Final version of ADD • Application testing and experiments conduction • June • Preparation to the Projects day