Perception-action mediation in music

Perception-action mediation in music Stefan Koelsch Perception of Musical Sounds @ University of Sussex

Common Coding Prinz, European Journal of Cognitive Psychology, 1997

motor theory of speech perception • (perception of) speech is decoded by the same processes that are involved in speech production (Liberman & Mattingly, 1985)

Koelsch & Siebel, TICS, 2005

„mirror neuron“ The experimenter grasps a piece of food with his hand then moves it toward the monkey, who, at the end of the trial, grasps it. The neuron discharges during observation of the grip, ceases to fire when the food is given to the monkey and discharges again when the monkey grasps it. Adapted from Rizzolatti et al. (1996) Cogn. Brain Res. 3, 131–141

Perception – action mediation in pianists Haueisen & Knoesche, JOCN 2001

PM neurons responding to sounds Example of a neuron that discharges when the monkey performs a hand action (not shown). This neuron also responded to the vision and sound of a tearing action (paper ripping; V+S). Simply hearing the sound of the same action (performed out of the monkey’s sight) was equally effective (S). Sounds that were non–action-related (white noise, monkey calls) did not evoke any excitatory response (CS1, CS2). Rastergrams are shown together with spike density functions. Vertical lines indicate the time when the sound occurred. Traces under the spike density functions in S and in CS conditions are oscillograms of the sounds used to test the neurons. Kohler E, et al., Science 2002

Perception – action mediation in nonmusicians Callan et al., NeuroImage 2006

Training of perception – action mediation with music Lahav, Saltzman & Schlaug, J Neurosci 2007

perception – action – mediation and emotion Koelsch, Fritz & Mueller, et al Human Brain Mapping 2006

Perception – action („mirror“) mechanisms serve ... • The understanding of actions • The learning of actions • Prediction of actions of others

Premotor codes are also used for Working memory Koelsch, Schulze, Sammler, et al., Human Brain Mapp, in press

Perception-action mediation in music