90 likes | 186 Views
Audio for Telepresence and Virtual Reality. Colin S. Harrison. Objective is to enhance sense of hearing for Telepresence and integrate with Virtual Environment Laboratory. Replicate feeling of being there. Hear a sound – turn to look at it. Replicate human hearing.
E N D
Audio for Telepresence and Virtual Reality Colin S. Harrison
Objective is to enhance sense of hearing for Telepresence and integrate with Virtual Environment Laboratory • Replicate feeling of being there • Hear a sound – turn to look at it • Replicate human hearing • Localise azimuth, elevation, range, properly externalised • Use audio to augment video for improved sensation of presence
Human 3D Spatial Hearing • Differences in Time (ITD) • Differences in Intensity (IID) • Movable Head • Pinnae Filtering (Head Related Transfer Function)
Implementation • Binaural sound / Simulated head • (HRTF) for Headphones • Integrate with Telepresence Projects • B-Format for loudspeakers • Integrate with VE aspects: ABACUS suite • Lake DSP for Headtracked Binaural Simulation and Loudspeaker reproduction
Originality • Binaural -Two eared technique • Ear/sensor assembly • Mechatronic head • World first system • with physical binaural sensors • B-Format approach for Telepresence ( new Application) • No other UK VE site has installed realistic sound
Virtual Environment Integration • Link to existing Virtual Environment Laboratory • Add realistic sound to VE presentations of architectural projects • Change sound as position and room type changes Publications • Conference Paper: (Mechatronics 98) • Journal Paper: (by invitation Mechatronics)
Industrial Relevance • Hostile human environments • Remote Military Intervention • Nuclear Chemical -Chernobyl • Surveillance (Big Brother hears you too!) • Entertainment • Architectural walkthroughs
And Finally • Telepresence: seamlessly represent senses: consider a Turing Test • Accurate sound triggers sense memories