CA meeting Athens 2007

1. CA meeting Athens 2007 Raymond Cuijpers Ellen de Bruijn Hein van Schie Roger Newman-Norlund Majken Hulstijn Jurjen Bosga Ruud Meulenbroek Harold Bekkering

2. Introduction Classical picture: Motor output Motor Processing Motor plan Planning Reasoning Percept Sensory Processing Sensory information

3. Motor output Motor Processing Modern picture • Motor system involved in action observation (MNS) • Perception biased by action planning • Already partly incorporated in architecture of UMP Motor plan Planning Reasoning Percept Motor plan Sensory Processing Sensory information

4. Division of labour in WP2 Division of labour in WP2 • Joint reasoning: action observation and action planning (Hein van Schie, Roger Newman-Norlund, Raymond Cuijpers) • Joint attention: task dependent visual processing (Astros Chatziastros) • Joint co-ordination: coordination of body kinetics and kinematics (Jurjen Bosga, Ruud Meulenbroek, Majken Hulstijn) • Error monitoring and learning (Ellen de Bruijn) World knowledge, Personal prefs. Error monitoring Error monitoring Reasoning Planning Sensory Proc. Motor Proc. Sensory information Motor output

5. Raymond Cuijpers Modeling action observation and action planning

6. World knowledge, Personal prefs. Reasoning Planning ‘How can we improve the internal mechanism of our computational model?’ Dynamics and short-term memory of goal inference Results • Adds short-term memory • Dynamics similar to linear regime of neural field approach (UMP) Explore differences and similarities: • effect on behaviour? implementation Present model - No memory - Sensitive to noise Improved model - Dynamic smoothing Probability fields

7. Anticipation in action observation ‘How is goal knowledge used for anticipation during action observation?’ • A main advantage of goal inference is anticipation of events • Previous studies showed that the eye leads the hand when performing and observing a well-known action • According to our model anticipation depends on knowledgeabout the goal

8. Hein van Schie Observation of goals and means in joint action

9. ‘How does observation of action goals and action means affect movement planning’ Automatic interference effects of observed action goals and means on motor performance • In uncolored trials movement preparation is faster after goal cueing (pointing) than after means cueing (grip). • In colored trials irrelevant postures affect response preparation (congruency effects). • The interference of irrelevant goals in means trials is stronger than the interference of irrelevant means in goal trials. In half of all trials subjects respond to color (left, right, full, precision), instead of the posture Results are consistent with the hypothesized dominance of action goals in human behavior.

10. EEG motor resonance during observational learning of movement sequences ‘What is the role of motor resonance in the learning of new action-sequences via observation? Preliminary results suggest that: • Individual differences in motor resonance predict number of errors in reproduction. • Within subjects, observational learning is associated with changes in motor resonance. • Results suggest a functional contribution of motor resonance to observational learning of arbitrary movement sequences. (Top) Subjects observe a sequence of six consecutive ipsi- and contralateral pointing movements of a virtual actor for reproduction (Bottom) Mu-power distribution in four subjects

11. Roger Newman-Norlund Neural correlates of action observation and action planning

12. ‘How are complementary motor programs primed/activated?’ Influence of Direction of Movement on Imitative and Complementary actions Preliminary results suggest that: • Direction of movement has no effect on initiation of Imitative actions. • Complementary actions are initiated faster when objects move towards actor.

13. GOAL 1 2 ‘How does goal knowledge affect joint action?’ Influence of Goal Knowledge on Task Performance and Coupling of Behavior Preliminary results suggest that: • Sharing goal knowledge leads to increases in coupling, faster goal acquisition. • Sharing goal knowledge leads to worse performance in other parameters (i.e. bar drops) • Coupling evidences similar improvement independent of goal-knowledge manipulation. % Recurrence Correlation (R2) Lag (ms)

14. Jurjen Bosga Inter- and intrapersonal co-ordination of body kinetics and kinematics

15. Inter- and Intrapersonal Coordination in Joint Action on a Balancing Board “Seeing each other” • How much predictive motor control in joint action is elicited by seeingthe co-actor? • Task • Rock the board from side to side • With imposed amplitude and frequency • With and without seeing co-actor • Data • Being collected “Not seeing each other” Balancing Board

16. Ellen de Bruijn Error monitoring in competitive and cooperative contexts

17. Flexible adaptive behaviour in cooperation and competition ‘How does monitoring of own and observed errors modulate preferences?’ Preliminary results suggest that in competition: • Participants efficiently adapt their behaviour following own errors and after other’s errors. • These findings suggest a highly flexible adaptive motor system in joint action • Investigations of adaptive behaviour in cooperative settings are currently ongoing.

18. Neural correlates of own and observed error processing in cooperation and competition ‘How does context modulate error-detection processes in joint action?’ Preliminary results suggest that in cooperation: • Same areas (medial frontal cortex and insula) are involved in the detection of own and observed errors • Whether activation in these areas is error-specific or reward-specific is currently being analyzed (cooperation vs. competition).

19. Division of labour in WP2 Division of labour in WP2 • Joint reasoning: action observation and action planning (Hein van Schie, Roger Newman-Norlund, Raymond Cuijpers) • Joint attention: task dependent visual processing (Astros Chatziastros) • Joint co-ordination: coordination of body kinetics and kinematics (Jurjen Bosga, Ruud Meulenbroek, Majken Hulstijn) • Error monitoring and learning (Ellen de Bruijn) World knowledge, Personal prefs. Error monitoring Error monitoring Reasoning Planning Sensory Proc. Motor Proc. Sensory information Motor output