Chapter 7: Taking Action

1. Chapter 7: Taking Action

2. The Ecological Approach to Perception Approach developed by J. J. Gibson (began in late 1950s) Gibson felt that traditional laboratory research on perception was: too artificial - observers were not allowed to move their heads. unable to provide an explanation for how pilots used environmental information to land airplanes The instructor can emphasize that the approach focuses on the moving observer and identifying information in the environment that the moving observer uses for perception. The approach can be stated as �Look for information in the environment that provides information for perception.�The instructor can emphasize that the approach focuses on the moving observer and identifying information in the environment that the moving observer uses for perception. The approach can be stated as �Look for information in the environment that provides information for perception.�

3. The Ecological Approach to Perception - continued Optic array - structure created by the surfaces, textures, and contours in the environment Optic flow - appearance of objects as the observer moves past them Gradient of flow - difference in flow as a function of distance from the observer Focus of expansion - point in distance where there is no flow

4. Optic Flow Self-produced information - flow is created by the movement of the observer Invariant information - properties that remain constant while the observer is moving optic flow demo

5. Figure 7.2 The relationship between movement and flow is reciprocal, with movement causing flow and flow guiding movement. This is the basic principle behind much of our interaction with the environment.

6. Self-Produced Information - Keeping your Balance Experiment by Lee and Aronson 13- to 16-month-old children placed in �swinging room� In the room, the floor was stationary but the walls and ceiling swung backward and forward. The movement creates optic flow patterns. Children swayed back and forth in response the flow patterns created in the room.

7. Experiment by Lee and Aronson - continued Adults show the same response as children when placed in the swinging room. Results show that vision has a powerful effect on balance and even overrides other senses that provide feedback about body placement and posture.

8. Figure 7.4 Lee and Aronson�s swinging room. (a) Moving the room toward the observer creates an optic flow pattern associated with moving forward, so (b) the observer sways backward to compensate. (c) As the room moves away from the observer, flow corresponds to moving backward, so the person leans forward to compensate, and may even lose his or her balance. From Lee, D. N., & Aronson, E., (1974). Visual proprioceptive control of standing in human infants. Perception and Psychophysics, 15, 529-532.

9. Self-produced Information - Somersaulting Somersaulting Could be performed by learning a predetermined sequence of moves; thus performance would be the same with and without vision Bardy and Laurent found that expert gymnasts performed worse with their eyes closed. They use vision to correct their trajectory. Novice gymnasts do not show this effect.

10. Figure 7.3 �Snapshots� of a somersault, starting on the left and finishing on the right. From Bardy, B. G., & Laurent, M. (1998). How is body orientation controlled during somersaulting? Journal of Experimental Psychology: Human Perception and Performance, 24, 963-977.

11. Do People use Flow Information? Experiment by Land and Lee Car fitted with instruments to measure Angle of steering wheel Speed of vehicle Direction of gaze of driver When driving straight, driver looks straight ahead but not at focus of expansion

12. Experiment by Land and Lee - continued When driving around a curve, driver looks at tangent point at side of the road Results suggest that drivers use other information in addition to optic flow to determine their heading. They might be noting the position of the car in relation to the center line or side of the road.

13. Figure 7.6 Results of Land and Lee�s (1994) experiment. The ellipses indicate the place where drivers were most likely to look while driving down on (a) a straight road and (b) a curve to the left.

14. The Direction Strategy for Determining Heading Visual direction strategy - observers keep their body pointed toward a target Walkers correct when target drifts to left or right Blind walking experiments show that people can navigate without any visual stimulation from the environment.

15. The Physiology of Navigation Optic flow neurons - neurons in the medial superior temporal area (MST) of monkeys respond to flow patterns Experiment by Britten and van Wezel Monkeys were trained to respond to the flow of dots on a computer screen. They indicated whether the dots flowed to the right, left, or straight ahead.

16. Experiment by Britten and van Wezel As the monkeys did the task, microstimulation was used to stimulate MST neurons that respond to specific directions of flow patterns. Judgments were shifted in the direction of the stimulated neuron.

17. Figure 7.8 Monkey brain, showing key areas for movement perception and visual-motor interaction. The instructor can use this slide to show students where the regions are located that are presented in the last two experiments as well as other experiments presented later in the slide show.The instructor can use this slide to show students where the regions are located that are presented in the last two experiments as well as other experiments presented later in the slide show.

18. Brain Areas for Navigation Experiment by Maguire et al. Observers learned the layout of a �virtual town� In a PET scanner, they were told to navigate to locations in the town. Navigating activated the right hippocampus and part of the parietal cortex. Activation was greater when the navigation between points was accurate than when it was inaccurate.

19. Figure 7.11 (a) Scene from the �virtual town� viewed by Maguire et al.�s (1998) observers. (b) Plan view of the town showing three of the paths observers took between locations A and B. Activity in the hippocampus and parietal lobe was greater for the accurate path (1) than for the inaccurate paths (2 and 3).

20. Experiment by Spiers and Maguire London cab drivers played an interactive computer game with accurate depictions of London streets. They were given instructions to drive towards a destination. In mid-route, the destination was changed. They also heard a statement unrelated to the destination.

21. Experiment by Spiers and Maguire - continued The cab drivers� brain activity was measured by fMRI during their �trip.� After the trip was finished, they viewed a playback and were asked what they were thinking at different points. The results showed a link between brain activation and specific navigation tasks. The instructor can add the specifics such at the activation of the visual cortex and parahippocampal place area (PPA) while drivers inspected the buildings along the way and of the hippocampus and PPA when they were planning which route to take.The instructor can add the specifics such at the activation of the visual cortex and parahippocampal place area (PPA) while drivers inspected the buildings along the way and of the hippocampus and PPA when they were planning which route to take.

22. Figure 7.13 Patterns of brain activation in the taxi drivers in Spiers and Maguire�s (2006) experiment. The descriptions above each picture indicate what event was happening at the time the brain was being scanned. For example, �customer-driven route planning� shows brain activity right after the passenger indicated the initial destination. The �thought bubbles� indicate the drivers� reports of what they were thinking at various points during the trip.

23. Affordances - What Objects are for Gibson believed affordances of objects are made up of information that indicates what an object is used for. They indicate �potential for action� as part of our perception. People with certain types of brain damage show that even though they may not be able to name objects, they can still describe how they are used or can pick them up and use them.

24. Affordances - What Objects are for - continued Experiment by di Pelligrino et al. Tested woman with damage to parietal lobe who showed extinction - the inability to direct attention to more than one thing at a time Two cups were presented; one to the right and one to the left The left cup was not detected unless there was a handle added. Researchers concluded that the affordance for grasping was activating a different part of the brain. Instructor should use the next slide to present the details of the study.Instructor should use the next slide to present the details of the study.

25. Physiology of Reaching and Grasping Neurons in the parietal lobe that are silent when a monkey was not behaving, fire when the monkey reached to press a button to receive food. This response only happened when the animal was reaching to achieve a goal. Calton et al. identified goal directed neurons in the parietal reach region (PRR) The instructor should use the next slide to explain the experiment by Calton etl al.The instructor should use the next slide to explain the experiment by Calton etl al.

26. Physiology of Reaching and Grasping - continued Experiment by Connolly - evidence for PRR in humans Experimental condition - observers looked a fixation point and were given a cue for the location of a target After a nine-second delay, they pointed at the target Control condition - a nine-second waiting period occurred, then the cue appeared and the observer pointed at the target

27. Figure 7.16 (a) Procedure for Connolly�s (2003) experiment. The observer looks at the fixation point (+), and the target (o) appears off to the side. (b) Activation of the PRR during the 9-second delay or during the waiting period. See text for details.

28. Experiment by Connolly - continued During the nine-second delay or waiting period for both conditions, fMRI was used to measure activity in the PRR Results showed higher activity during the nine-second delay than in the nine-second waiting period This suggests that the PRR encodes information related to the intention for movement to a location.

29. Mirror Neurons in Premotor Cortex Neurons in the premotor cortex of monkeys that Respond when a monkey grasps an object and when an experimenter grasps an object Response to the observed action �mirrors� the response of actually grasping There is a diminished response if an object is grasped by a tool (such as pliers).

30. Mirror Neurons in Premotor Cortex - continued Possible functions of mirror neurons To help understand another animal�s actions and react to them appropriately To help imitate the observed action Audiovisual mirror neurons - respond to action and the accompanying sound Mirror neurons may help link sensory perceptions and motor actions.

31. Figure 7.17 Response of a mirror neuron (a) to watching the experimenter grasp food on the tray; (b) when the monkey grasps the food; (c) to watching the experimenter pick up food with a pair of pliers. From Rizzolatti, G., Forgassi, L., & Gallese, V. (2000). Cortical mechanisms subserving object grasping and action recognition: A new view on the cortical motor functions. In M. Gazzaniga (Ed.), The new cognitive neurosciences (pp 539-552). Cambridge, MA: MIT Press.

32. Figure 7.18 Response of an audiovisual mirror neuron to four different stimuli. From Kohler, E., Keysers, C., Umilta, M. A., Fogassi, L., Gallese, V., & Rizzonatti, G. (2002). Hearing sounds, understanding actions: Action representation in mirror neurons. Science, 297, 846-848.)

33. Predicting People�s Intentions Experiment by Pierno et al. Observers watch three four-second videos Grasping condition Gaze condition Control condition Response of the neurons in the human action observation system was measured in a brain scanner. The human action observation system consists of neurons in the premotor cortex that contain mirror neurons and some other areas of the brain as well. The instructor should use the next two slides to provide details about the experiment and the results.The human action observation system consists of neurons in the premotor cortex that contain mirror neurons and some other areas of the brain as well. The instructor should use the next two slides to provide details about the experiment and the results.

34. Figure 7.20 Results of Pierno et al.�s (2006) experiment showing the increase in brain activity that occurred for the three conditions shown in Figure 7.19 in (a) the premotor cortex and (b) an area in the frontal lobe. Results show that the activation of the area is essentially the same when the observer sees the person grasp and look at the ball. The researchers suggest that this means that these neurons are responding to the intention of the person to grasp the ball.Results show that the activation of the area is essentially the same when the observer sees the person grasp and look at the ball. The researchers suggest that this means that these neurons are responding to the intention of the person to grasp the ball.

35. Mirror Neurons and Experience Experiment by Calvo-Merino et al. Tested three groups Professionally trained ballet dancers Professionally trained capoeira dancers Control group of non-dancers They watched two videos One with standard ballet movements One with standard capoeira movements

36. Mirror Neurons and Experience - continued Activity in the premotor cortex was measured while they watched the videos. Results showed PM activation was Greatest for ballet dancers while watching ballet Greatest for capoeira while watching capoeira Same response for both for non-dancers

37. Figure 7.22 Results of Calvo-Merino�s (2005) experiment, showing increase in activity in PM cortex. Black bars = response to ballet films, white bars = response to capoeria films.

38. Two Approaches for Neural Prostheses The goal is for people with spinal cord injuries to be able to move a computer mouse directly with their thoughts. Hochberg et al. - used signals sent from motor cortex of a person through a computer to position cursor Musallam et al. - used activity from PRR of a monkey through computer to position computer

39. Two Approaches for Neural Prostheses - continued Problems with these approaches Less accurate and more variable control than actual muscle movement Devices only use signals from a small group of neurons Researchers need to determine which signals are most important for the desired movement