1 / 42

Sensory-motor integration

Sensory-motor integration. Bijan Pesaran. Visual response in PMv centered on hand. Graziano and Gross (1994). Visual response in PMv centered on hand. Graziano and Gross (1994). Invariant visual response in VIP. Duhamel et al (1997). Duhamel et al (1997). PRR neurons are eye-centered.

alaverne
Download Presentation

Sensory-motor integration

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Sensory-motor integration Bijan Pesaran

  2. Visual response in PMv centered on hand Graziano and Gross (1994)

  3. Visual response in PMv centered on hand Graziano and Gross (1994)

  4. Invariant visual response in VIP Duhamel et al (1997)

  5. Duhamel et al (1997)

  6. PRR neurons are eye-centered Batista et al (1999)

  7. Updating of response in PRR Batista et al (1999)

  8. Mechanisms for encoding multiple variables • Centered tuning curve

  9. Eye position influences visual response of 7a neurons Andersen et al (1985)

  10. Gain field Tuning curve Mechanisms for encoding multiple variables • Centered tuning curve • Multiplicative encoding - gain field

  11. Visual receptive fields in VIP partially shift with eye position Eye positions Avillac et al (2005)

  12. Gain field Tuning curve Mechanisms for encoding multiple variables • Centered tuning curve • Multiplicative encoding - gain field • Partial shift encoding – intermediate reference frame

  13. Eye position encoding • Widespread phenomenon throughout visual and motor cortices Peaked response Eye left Eye middle Eye right Response Target position

  14. Eye position encoding • Difficulty addressing flanking responses Peaked response Flanking response Eye left Eye middle Eye right Response Target position

  15. Gain model

  16. Gain model Shifting model

  17. Nonlinear 3D geometry and muscle dynamics Geometry of visually-guided reaching • Eye-centered • Hand-centered • Relative position vectors T T-H T-E H H-E E E-H

  18. Nonlinear 3D geometry and muscle dynamics Geometry of visually-guided reaching T T-H T-E H H-E E E-H What is code? Batista et al (1999) Eye-centered MIP PMd Pesaran et al (2006) PMv T-E Graziano et al (1997) Hand-centered T-H

  19. Decompose the 3-D response matrix

  20. Distinguish between different reference frames

  21. Define multiple effector reference frames

  22. - - + + Multiple reference frames Direct Transformation Eye-centered hand location • Direct visuomotor transformation • Supports Area 5 data (Buneo et al 2002) Nonlinear 3D geometry and muscle dynamics Eye-centered target location Hand-centered target location Motor output Serial Transformation Head-on-body position Body-centered hand position Eye-in-head position Head-centered target location Nonlinear 3D geometry and muscle dynamics Eye-centered target location Body-centered target location Hand-centered target location Motor output

  23. Encoding relative position Nonlinear 3D geometry and muscle dynamics T Nonlinear muscle dynamics T-H T-E H H-E E E-H • Coordinating the hand and the eye • Eye-centered • Hand-centered • Relative hand-eye position • Vectors in abstract space Batista et al 1999 MIP PMd PMv Graziano et al 1997

  24. 1 2 Time (sec) 0 Cue Start Delay Hold Go Design reference frame task

  25. 1 2 Time (sec) 0 Cue Start Delay Hold Go Design reference frame task

  26. Design reference frame task • Four initial eye positions

  27. Design reference frame task • Four initial eye and hand positions

  28. Design reference frame task • Four initial eye, hand and target positions • 111 PMd neurons and 48 MIP neurons

  29. Example PMd neuron

  30. Example MIP neuron

  31. - - + + Sensory-motor transformations Serial Transformation Eye-in-head position Head-on-body position Body-centered hand position Head-centered target location Eye-centered target location Body-centered target location Hand-centered target location - +

  32. Sensory-motor transformations Direct Transformation Eye-centered hand location - Hand-centered target location + Eye-centered target location Buneo et al. (2002)

  33. Sensory-motor transformations Relative position Transformations Hand-centered target location + Eye-centered target location - Eye-centered hand location Relative location of hand and eye Hand-centered eye location - Hand-centered target location Eye-centered target location +

  34. T T-H T-E H H-E E E-H Relative position particularly useful for coordination • Relative hand-eye position could be important for hand-eye coordination • Can map hand and eye onto each other • Computationally efficient • No need to code for all combinations of locations

  35. T T-H T-E H H-E E E-H Relative position particularly useful for coordination • Relative hand-eye position could be important for hand-eye coordination • Can map hand and eye onto each other • Computationally efficient • No need to code for all combinations of locations

  36. T T-H T-E H H-E E E-H Relative position particularly useful for coordination • Relative hand-eye position could be important for hand-eye coordination • Can map hand and eye onto each other • Computationally efficient • No need to code for all combinations of locations

More Related