1 / 38

Cortical Representations of Attention and Salience

James A. Mazer Department of Neurobiology Yale School of Medicine. Cortical Representations of Attention and Salience. Theoretical and Experimental Approaches to Auditory and Visual Attention Banbury 2008. Neural Representations of Attention and Salience.

ide
Download Presentation

Cortical Representations of Attention and Salience

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. James A. Mazer Department of Neurobiology Yale School of Medicine Cortical Representations ofAttention and Salience Theoretical and Experimental Approaches to Auditory and Visual Attention Banbury 2008

  2. Neural Representations of Attention and Salience • Feature-based attention in area V4 • labeled lines or matched filters? • (monkey single-unit) • Maintaining spatial attention during eye movements • spatiotopic or retinotopic maps for spatial attention? • (human psychophysics)

  3. Integration Rules ??? color/wavelength phase spatial frequency elevation orientation azimuth search target: Attention and salience maps

  4. Integration Rules ??? color/wavelength phase spatial frequency elevation orientation azimuth search target: Attention and salience maps feature-based attention

  5. Integration Rules ??? color/wavelength phase spatial frequency elevation orientation azimuth Attention and salience maps spatial attention spatial cue: target on right

  6. Integration Rules ??? color/wavelength phase spatial frequency elevation orientation azimuth Attention and salience maps spatial attention spatial cue: target on left Koch, Itti, Heeger & Reynolds …

  7. V2 V1 V4 IT 1. “Feature-based” attention in area V4 • essential form processing relay station • known anatomical and physiological target for top-down signals

  8. RSVP: (slow) Rapid Search Visual Presentation search target stimulus stream

  9. RSVP: (slow) Rapid Search Visual Presentation search target + stimulus stream

  10. RSVP: (slow) Rapid Search Visual Presentation search target + stimulus stream

  11. RSVP: (slow) Rapid Search Visual Presentation search target + stimulus stream

  12. RSVP: (slow) Rapid Search Visual Presentation search target + stimulus stream

  13. RSVP: (slow) Rapid Search Visual Presentation search target + stimulus stream

  14. RSVP: (slow) Rapid Search Visual Presentation search target + stimulus stream

  15. RSVP: (slow) Rapid Search Visual Presentation search target + stimulus stream

  16. RSVP: (slow) Rapid Search Visual Presentation search target + stimulus stream

  17. RSVP: (slow) Rapid Search Visual Presentation search target + stimulus stream match!

  18. RSVP: (slow) Rapid Search Visual Presentation search target + stimulus stream match!

  19. Tuning during RSVP: Spike Triggered Average Response (Hz)‏ Orientation (deg)‏ t t t t t t t

  20. Tuning during RSVP: Spike Triggered Average Response (Hz)‏ Orientation (deg)‏ t t t t t t t

  21. Tuning during RSVP: Spike Triggered Average Response (Hz)‏ Orientation (deg)‏ t t t t t t t

  22. Tuning during RSVP: Spike Triggered Average Response (Hz)‏ Orientation (deg)‏ t t t t t t t

  23. Tuning during RSVP: Spike Triggered Average Response (Hz)‏ Orientation (deg)‏ t t t t t t t

  24. Tuning during RSVP: Spike Triggered Average Response (Hz)‏ Orientation (deg)‏ t t t t t t t

  25. color/wavelength phase spatial frequency elevation orientation azimuth Interim Summary: Feature-based attention V4 • feature-based attention affects: • shifts in preferred stimuli • orientation-dependent gain changes • changes in preferred stimulus could facilitate target detection, but not in any simple manner (some +, some -)‏ • modulation is maximal in a sub-population of broadly tuned V4 neurons, suggesting multiple intermingled populations within V4 • perhaps reflecting modulated and veridical subpopulations…

  26. 2. Maintaining spatial attention across eye movements

  27. Spatial cueing 101 Posner (1980) and many others...

  28. Spatial cueing 101 valid cue invalid cue Posner (1980) and many others...

  29. Spatial cueing 101 faster more accurate more sensitive etc… invalid valid valid cue invalid cue Posner (1980) and many others...

  30. Neural representation of the cue?

  31. Neural representation of the cue?

  32. Neural representation of the cue?

  33. Neural representation of the cue?

  34. Neural representation of the cue? Retinotopic (eye-centered)

  35. Neural representation of the cue? Retinotopic (eye-centered) Spatiotopic (head-centered)

  36. elevation azimuth The representation of spatial attention • Spatial attention survives intervening saccades • Spatial attention is transiently maintained in retinotopic coordinates even when it hurts... • The native representation of spatial attention appears to be retinotopic • Simple model: retinotopy + recurrence...

  37. Conclusions • feature-based attention • feature-based in V4 can alter both gain and preferred stimulus • orientation tuning changes are “correlated” with behavioral goals • maintaining spatial attention across eye movements • saccade planning and spatial cueing are dissociable (anti-premotor) • spatial attention is intrinsically retintopic • spatiotopic representations required active, top-down updating or remapping under voluntary control

  38. Acknowledgements Mazer Lab Jonathan Touryan Monica Cano Vinas Julie Golomb Matt Krause Marvin Chun (Yale Psychology)

More Related