1 / 81

Holistic, part-based and semantic processes in face recognition: Dissociations and interactions

Holistic, part-based and semantic processes in face recognition: Dissociations and interactions. ¹ Department of Psychology, University of Toronto ² Rotman Research Institute, Baycrest Centre for Geriatric Care ³ Centre for Vision Research, York University. In collaboration with:

lois
Download Presentation

Holistic, part-based and semantic processes in face recognition: Dissociations and interactions

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Holistic, part-based and semantic processes in face recognition: Dissociations and interactions ¹ Department of Psychology, University of Toronto ²Rotman Research Institute, Baycrest Centre for Geriatric Care ³ Centre for Vision Research, York University

  2. In collaboration with: David Anaki Josee Rivest Sandra Black Larry Leach Yakir Kaufman Bruce Bolster

  3. Outline • Historical background • Enduring problems • New studies • • Dissociations among three agnosic patients • • Prosopagnosia (patient DC) • • Object agnosia (patient CK) • • Pure alexia (patient CM) • • Semantic/associative prosopagnosia (patient AP) • Interactions among face, object, and semantic systems

  4. Historical background

  5. Bodamer, 1947

  6. Definition: prosopagnosia • Acquired inability to recognize • familiar faces from vision • • Recognition triggered by alternative means: • ex.: voice, paraphernalia, gait • • Appropriate semantic information about familiar people • • Good visual acuity • • Face recognition may be achieved by a feature-by-feature approach (?)

  7. RECOGNITION impairment... • Must NOT be secondary to: • • sensory loss • • general intellectual loss • • memory & language problems • • or a combination of these factors

  8. Associated Recognition Deficits • • Object agnosia • • Pure alexia • • Good visual acuity • • Good semantic memory/processing • • Appropriate orthographic units • • No agraphia, no aphasia • • Letter-by-letter readers

  9. But again… dissociations: • • Prosopagnosia with alexia • but without object agnosia • (e.g. Buxbaum, Glosser & Coslett, 1998, De Renzi & di Pellegrino, 1998) • • Prosopagnosia with object agnosia • but without alexia • (e.g. Humphreys & Riddoch, 1989) • • Object agnosia • without prosopagnosia or alexia • (e.g. Humphreys & Rumiati, 1998; Rumiati, Humphreys, Riddoch & Bateman, 1994) +

  10. Neuroanatomy • From patients… • • Bilateral damage in the occipitotemporal cortices: • - the inferior temporo-occipital regions • - the lingual and fusiform gyri • (e.g. Damasio, Damasio & Van Hoesen, 1982; • Takahashi, Kawamura, Hirayama, Shiota & Isono, 1995) • • A right hemisphere lesion (in the equivalent areas) • - may be sufficient • (e.g. De Renzi, 1986a; Landis, Regard & Bliestle, 1988; Rapcsak, Polster, • Comer & Rubens, 1994; Takahashi et al., 1995)

  11. More evidence… • “Normal” human brains: • fMRI studies • - the fusiform gyri (Face Fusiform Area: FFA) • (e.g. Kanwisher, Woods, Iacoboni & Mazziotta, 1997) • A PET study • - the medial fusiform gyri (areas 19-37) • - the right parahippocampal gyrus (area 36) • - the anterior region of the temporal poles • (Sergent & Signoret, 1992)

  12. Enduring Debates: Are faces special? 1. Modularity vs. General Purpose 2. Representations vs. Processes 3. Face-specific vs.Individuation or Expertise 4. Focal/Localized vs. Distributed 5. Laterilzed vs. Bilateral 6. Holistic vs. Analytic or part-based 7. Different versions of holistic

  13. • 41-year old man • 16 years education (MA degree) • Manager • Closed-head injury: hit by a car when jogging • Bilateral thinning in the occipito-temporal regions Behrmann, Winocur & Moscovitch (1992) Behrmann, Moscovitch & Winocur (1994) Moscovitch, Winocur & Behrmann (1997) CK - Object Agnosia & Alexia

  14. IMPAIRED NORMAL • Word recognition (reading) • Object recognition • Residual blindness in upper left field • Average IQ • Acuity • Upright face recognition • Visual construction abilities • Memory • Semantic knowledge Behrmann, Winocur & Moscovitch (1992) Behrmann, Moscovitch & Winocur (1994) Moscovitch, Winocur & Behrmann (1997) CK - Object Agnosia & Alexia

  15. Face module • Features - primarily internal • At least two of three needed • Orientation specific - 0 (upright) to 60-90 degrees • Global configurational properties • template and/or second order relations

  16. Face counterpart in object system • Feature - internal and external • Distinctive? Verbalizable? • Orientation sensitive • Categorical or local relations (jig-saw effect) • Integration of features and relations

  17. Interaction of face and face counterpart • Mapping of features and relations in counterpart to holistic face representations stored in long-term memory (FRUs) • Interactive activation between systems: face, object, and semantics

  18. WORDS FACES OBJECTS Holistic Part-based Inverted faces Upright faces

  19. Patients CK DC CM Recognition Faces √ X √ Objects X √ √ √ Double dissociation Words X X

  20. More dissociations Patients CK DC CM Recognition Faces √ X √ Objects X √ √ Words X √ X

  21. Patients CK DC CM Recognition Faces √ X √ Objects X √ √ Words X √ X Object Agnosia & Alexia Pure Alexia Prosopagnosia

  22. DC - Prosopagnosia • 54-year old man • 16 years education • Detective for the homicide division of a police • force (on disability) • Colloid cyst hydrocephalus • Posterior cerebral artery infarction

  23. DC - Prosopagnosia • Bilateral lesions in the lingual gyri, Brodmann Areas 18 & 19 R L

  24. DC - Prosopagnosia R L • Bilateral lesions in the lingual gyri: more atrophy to the right fusiform gyrus than the left

  25. IMPAIRED •Face recognition • Bilateral superior field deficits DC - Prosopagnosia NORMAL •Superior IQ • Acuity • Object recognition • Reading • Visual construction abilities • Space perception • Colour vision • Memory • Semantic knowledge

  26. Face recognition: • Famous faces • slow —no instant recognition • Looks like a “piecemeal” approach • Bob Hope: “I will guess that it is Bob Hope. He has a long nose, his hair cut is him too, a side ways grin; I am not 100% sure that it is him...”

  27. Hollywood stars • • Jerry Seinfeld: “I do not know, an ordinary guy” • “Oh, Jerry” • —watched Seinfeld at least once a day • • Denzel Washington: “a US ball player” • —described many movies that he was acting in • • Michelle Pfeiffer: “A model: Sharon Stone? Christie Brinkley?” • His family members and myself • with hair covered: • • misidentified his son (who was in the testing room) • • misidentified me

  28. • 35-year old man • 15 years of education • Computer programming • Closed-head injury / drugs • Temporal occipital abnormalities on EEG CM - Pure Alexia

  29. CM - Pure Alexia NORMAL IMPAIRED •High average IQ • Acuity • Face recognition • Object recognition • Visuo-spatial abilities •Word recognition (reading): Letter-by-letter reader

  30. WORDS FACES OBJECTS Part-based Holistic Processing systems Is there one part-based system?

  31. WORDS FACES OBJECTS Part-based Part-based Holistic Processing systems Are there separate part-based systems?

  32. WORDS FACES OBJECTS Holistic Part-based Part-based Processing systems Does part-basedface recognition depend on one or both part-based systems?

  33. FACES WORDS OBJECTS Holistic Part-based Part-based Intact upright face recognition Moscovitch, Winocur & Berhmann (1997) CK - Object Agnosia & Alexia

  34. WORDS FACES OBJECTS Holistic Part-based Part-based Intact face and object recognition CM - Pure Alexia

  35. WORDS FACES OBJECTS Holistic Part-based Part-based Can part-based face recognition rely only on systems mediating recognition of objects and words?

  36. WORDS FACES OBJECTS Part-based Part-based Holistic Or does it rely on the interaction between part-based and holistic systems ?

  37. WORDS OBJECTS FACES Holistic Part-based Part-based Intact object and word recognition DC - Prosopagnosia

  38. Control DCB √ √ √ Participants Brain-damaged Controls CK CM DC n=12 Recognition √ √ √ X Faces Objects √ X √ √ √ X X √ Words

  39. Tasks: Face recognition • Upright faces

  40. 70 perfect score 60 50 40 Mean Number of People Recognized 30 20 10 0 Controls CK CM DC DCB Results Mean Number of Famous People Recognized from Photos (Max. = 70)

  41. Caricatures of Famous People Woody Allen Ronald Regan

  42. 100 100 90 90 80 80 70 70 60 60 Percent mean recognition Percent correct identification 50 50 40 40 30 30 20 20 10 10 0 0 Controls CK DC DCB Controls CK DC DCB Caricatures of Famous People Recognized (Max. = 29)

  43. Child Mothers Fathers

  44. 100 90 80 70 60 Percent mean recognition 50 40 30 20 10 0 Controls CK CM DC DCB Percent of Correct Responses on a Seven-Item Forced Choice Recognition Test for Identifying Each of the “Parent” Photos from the Photo of a “Child”

  45. Tasks:Face recognition Faces • Fractured • Disguised • Inverted

  46. Who is: Jason Alexander George • Inverted

  47. Who is: • Fractured Oprah

  48. Who is: • Disguised EddieMurphy

  49. Controls CK CM DC DCB Results Percentage of Correct Recognition of Inverted Faces 100 90 80 70 60 50 Percent Recognized 40 30 20 10 0

More Related