1 / 11

Visual Adaptation And Spatial Auditory Processing

This study explores the impact of visual stimuli on sound location perception, specifically investigating the Ventriloquism Effect and Ventriloquism Aftereffect across species and reference frames. By examining auditory saccade accuracy pre- and post-adaptation to visual shifts, the research sheds light on the mixture of head- and eye-centered reference frames. Results show spatially aligned AV-stimuli still influence auditory responses, expanding the auditory spatial map beyond the trained area. Collaborators from Duke University, NTT Tokio, and Boston University contributed to this insightful cross-species analysis.

jromeo
Download Presentation

Visual Adaptation And Spatial Auditory Processing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Visual Adaptation And Spatial Auditory Processing Peter Lokša, Norbert Kopčo Collaborators:Jenni Groh, Barb Shinn-Cunningham, I-Fan Lin

  2. Way to go • Red Sox! • Way to go • Red Sox! Introduction • Visual stimuli can affect the perception of sound location • e.g. the Ventriloquism Effect • e.g. the Ventriloquism Afterffect • But does effect persist? • But does effect persist? • - barn owls: prism adaptation (Knudsen et al.) • - monkeys: “ventriloquism aftereffect” (Woods and • Recanzone, Curr. Biol. 2004)

  3. What is reference frame • What is the • reference frame? • Eye-centered? • ? • ? • Oculomotor? • Head (ear) -centered?

  4. Methods • Basic idea: • 1. Pre-adaptation baseline: Measure auditory saccade accuracy • 2. Adaptation phase: Present combined visual-auditory stimuli, with visual location shifted • 3. Compare auditory saccade accuracy pre- and post-adaptation

  5. Expected behavior • Magnitude (°) • Stimulus Location (°) Method: center • Fix head to face 0° • Induce shift: • - in only one region of space • - from a single fixation point • Test to see if shift generalizes • to the same sub-region in: • - head-centered space • - eye-centered space • Experiment divided into • 1-hour blocks: • (12 for humans, 16 for monkeys) • Within a block, 3 types of • randomly interleaved trials: • - Training AV stim: 50% • - Test A-only stimuli: 50% (25% from trained, 25% shifted FP) • Audiovisual display • Speakers • LEDs • FP

  6. Follow-up • Are results independent of where ventriloquism is introduced? • - Spatial auditory resolution is lower in the periphery • - Maier et al. 2009 – binaural cue adaptation only in center • Eye-centered? • ? • ? • Oculomotor? • Head (ear) -centered?

  7. Method: periphery • Fix head to face 0° • Induce shift: • - in only one region of space • - from a single fixation point • Test to see if shift generalizes • to the same sub-region in: • - head-centered space • - eye-centered space • Experiment divided into • 1-hour blocks: • (12 for humans, 16 for monkeys) • Within a block, 3 types of • randomly interleaved trials: • - Training AV stim: 50% • - Test A-only stimuli: 50% (25% from trained, 25% shifted FP) • Expected behavior • Audiovisual display • Speakers • Magnitude (°) • LEDs • FP • Stimulus Location (°)

  8. Results: AV-shifted data

  9. Results: AV-aligned Baseline • Humnas: • Monkeys:

  10. Summary • The main results are consistent across species and regions: • it’s possible to locally introduce ventriloquism aftereffect • the reference frame is a mixture between head- and eye-centered • But • Visual stimuli influence saccade responses to auditory stimuli even when the AV-stimuli are spatially aligned: • Expanding the auditory spatial map outside the trained area • In an head-centered way when AV training is in center • In a way that is modulated by eye-centered representation when AV training is in periphery

  11. Collaborators • Jenni Groh, Duke University • I-Fan Lin, NTT Tokio • Barb Shinn-Cunningham, BU

More Related