160 likes | 313 Views
New MNS. New Grasp. New Concept. New Anatomy. Fig 1. Fig 2. Fig 3. Fig 3. Task Constraints (F6) Working Memory (46) Instruction Stimuli (F2). AIP. Ways to grab. PFC. Dorsal Stream: Affordances. “It’s a mug”. F1. F5 canonical. IT. cIPS. Ventral Stream: Recognition.
E N D
Fig 3 Fig 3
Task Constraints (F6) Working Memory (46) Instruction Stimuli (F2) AIP Ways to grab PFC Dorsal Stream: Affordances “It’s a mug” F1 F5 canonical IT cIPS Ventral Stream: Recognition Hand Control Task Constraints (F6) Working Memory (46) Instruction Stimuli (F2) PF Hand-objecttrajectories PFC “It’s a mug” F5 mirror F1 Hand Shape & Motion STS IT Hand Control Feedback Correction
Observe Execute F5 mirror F5 canonical Recognize Actions Command Actions Interpretation Planning
Working Memory for Perception and Production of Utterances Working Memory for Actions, Objects, and Relationships Wernicke’s Auditory Input Tpt Multimodal Broca’s area (vocal, manual, oro-facial) Protospeech (basis for speech) From Imitation to Describing Actions, Objects, Relationships PF extended DPLF Protosign (basis for sign language) IT STSa PF F5 mirror Recognizing an Action Visual Input AIP F5 canonical Choosing an Action Arbib, 2001 updated by FARS modificato Recognizing Actions, Objects, and Relationships
Object features The Mirror Neuron System (MNS) Model (Oztop & Arbib) Object affordance extraction cIPS F5canonical Motor program (Grasp) AIP Object affordance 7b: PF/PG -hand state Cortex Integrate association temporal association Hand Visual shape Action recognition Motor Mirror recognition execution Feedback Motor Hand (Mirror program M1 motion Neurons) Hand-Object (Reach) detection spatial relation F5mirror F4 analysis STS 7a Object location • Activity of F5 canonical neurons is part of the code forCommand:Grasp-A(Object) The full neural representation of the “Cognitive Form” (CF): Grasp-A(Object)requires not only the regions AIP and F5canonical shown in the MNS diagram, but also inferotemporal cortex (IT) which holds the identity of the object. How are these representations bound together? • NOTE: This is only the “Cognitive Form”. There are no “Linguistic Forms” in the monkey.
Object features The Mirror Neuron System (MNS) Model (Oztop & Arbib) Object affordance extraction cIPS F5canonical Motor program (Grasp) AIP Object affordance 7b: PF/PG Cortex -hand state Integrate association temporal association Hand Visual shape Action recognition recognition Motor Mirror execution Feedback Motor Hand program M1 Hand-Object motion (Reach) spatial relation detection F5mirror F4 analysis STS 7a Object location • Activity of F5 mirror neurons is part of the code forDeclarative:Grasp-A(Agent, Object) The full neural representation of the “Cognitive Form” (CF): Grasp-A(Agent, Object)requires not only the regions AIP, STS, 7a, 7b and F5miirror shown in the MNS diagram, but also inferotemporal cortex (IT) which holds the identity of the object and regions of STS (?) not included in MNSwhich hold the identity of the agent. • How are these representations bound together?
F5 canonical F5 mirror STS IT Object Observed Action Executed Action Agent • Agent Action Object Analysis of the Mirror System makes • Grasp (Raisin) primary, where the Agent is the self and thus unspecified, • and then makes • Grasp (Leo, Raisin) secondary • The mirror system expands the representational capacity of the canonical system to allow the Agent role to be played by others as well. • But note that the full power of the system is “Beyond the Mirror” embedding MNS in a larger system: