The neural basis of face recognition? Tim Andrews

1. The neural basis of face recognition? Tim Andrews

4. Unfamiliar Familiar Hancock, Bruce and Burton (2000) Trends in Cognitive Sciences 4:330-337 Jenkins, White, Van Monfort, Burton (2011) Cognition 121: 313-323

5. Outline • Which areas of the brain respond to images of faces? • Are these regions selective for the identity of the face? • Which aspects of the face are important for representing facial identity? • Is an image-invariant neural code used to represent information about identity? • Are face-selective regions sufficient for face recognition?

6. Face localiser scan

7. fMRI analysis - modelling the data

8. zscore 7.4 4.6 Face-selective regions FFA: fusiform face area OFA: occipital face area STS: superior temporal sulcus STS OFA FFA Haxby, Hoffman & Gobbini, TICS 4: 223-233 (2000) Bruce & Young (1986) Br. J. Psychology 77: 305-327 Calder & Young, Nature Reviews Neuroscience 6: 641-51 (2005)

9. Outline • Which areas of the brain respond to images of faces? • Are these regions selective for the identity of the face? • Which aspects of the face are important for representing facial identity? • Is an image-invariant neural code used to represent information about identity? • Are face-selective regions sufficient for face recognition?

10. fMR-adaptation Grill-Spector, Henson & Martin (2006) Trends Cog Sci 10: 14-23 Krekelberg, Boynton and van Wezel (2006) Trends Neurosci 29: 250-256

11. fMR-adaptation Grill-Spector et al (1999) Neuron 24: 187-203 Henson et al. (2000) Science 287: 1269-72 Andrews & Ewbank, Neuroimage 23: 905-913(2004) Grill-Spector, Henson & Martin (2006) Trends Cog Sci 10: 14-23

12. fMR- adaptation to intact, but not scrambled faces Andrews, Clarke, Pell, Hartley (2010) Neuroimage 49: 703-711

13. No adaptation to images of places Andrews, Clarke, Pell, Hartley (2010) Neuroimage 49: 703-711

14. Outline • Which areas of the brain respond to images of faces? • Are these regions selective for the identity of the face? • Which aspects of the face are important for representing facial identity? • Is an image-invariant neural code used to represent information about identity? • Are face-selective regions sufficient for face recognition?

15. Internal and external features

16. fMR-adaptation to internal and external features of familiar faces Andrews, Davies-Thompson, Kingstone & Young (2010) J. Neuroscience 30: 3544-22

17. Adaptation to internal and external features of unfamiliar faces FFA OFA STS Andrews, Davies-Thompson, Kingstone & Young (2010) J. Neuroscience 30: 3544-22

18. Composite face images

19. Adaptation to composite familiar faces same internal, same external same internal, diff. external diff. internal, same external diff. internal, diff. external Andrews, Davies-Thompson, Kingstone & Young (2010) J. Neuroscience 30: 3544-22

20. Adaptation to composite unfamiliar faces same internal, same external same internal, diff. external diff. internal, same external diff. internal, diff. external Andrews, Davies-Thompson, Kingstone & Young (2010) J. Neuroscience 30: 3544-22

21. The Presidential Illusion! FFA OFA STS Sinha and Poggio (1996) Nature 384:404 Sinha and Poggio (2002) Perception 31:131

22. Face to Face Coalition! FFA OFA STS Andrews and Thompson (2010) iPerception 1: 28-30

23. Outline • Which areas of the brain respond to images of faces? • Are these regions selective for the identity of the face? • Which aspects of the face are important for representing facial identity? • Is an image-invariant neural code used to represent information about identity? • Are face-selective regions sufficient for face recognition?

24. Unfamiliar Familiar

25. Image invariant adaptation Experiment 1: same identity FFA Davies-Thompson, Newling and Andrews (2012) Cerebral Cortex in press

26. Image invariant adaptation Experiment 2: different identity FFA Davies-Thompson, Newling and Andrews (2012) Cerebral Cortex in press

27. Image invariant adaptation Experiment 1: same identity FFA Davies-Thompson, Newling and Andrews (2012) Cerebral Cortex in press

28. Image invariant adaptation Experiment 2: different identity FFA Davies-Thompson, Newling and Andrews (2012) Cerebral Cortex in press

29. Image invariant adaptation Experiment 1 Experiment 2

30. Outline • Which areas of the brain respond to images of faces? • Are these regions selective for the identity of the face? • Which aspects of the face are important for representing facial identity? • Is an image-invariant neural code used to represent information about identity? • Are face-selective regions sufficient for face recognition?

31. Case Study - JJ • 17 year old male • Complete loss of vision following head trauma • Visual acuity recovered after 5 days, but he retained a specific deficit in colour and face perception • 10 days after injury, battery of visual tests revealed normal acuity, stereopsis, motion discrimination, contrast sensitivity, object/place recognition, but still had abnormal colour vision and remained densely prosopagnosic. • After 4 months he showed a complete recovery of colour and face perception.

32. Structural MRI revealed no obvious lesion

33. 1

35. Normal functional responses in face-selective regions OFA FFA STS FFA FFA FFA Pre-recovery Post-recovery Controls

36. Normal adaptation to faces in prosopagnosic patient! same different

37. Conclusions

38. Thanks to… • Jodie Davies-Thompson • Andy Young • Heidi Baseler • Andre Gouws • Simon Hickman • Alan Kingstone • Tony Morland • Peter Thompson • Wellcome Trust • ESRC

39. JJ – face perception

40. JJ – non-face object perception