1 / 45

Ongoing Challenges in Face Recognition

Ongoing Challenges in Face Recognition. Peter Belhumeur Columbia University New York City. How are people identified?. People are identified by three basic means: Something they have (identity document or token) Something they know (password, PIN) Something they are (human body). Iris.

stacia
Download Presentation

Ongoing Challenges in Face Recognition

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Ongoing Challenges in Face Recognition Peter Belhumeur Columbia University New York City

  2. How are people identified? People are identified by three basic means: • Something they have(identity document or token) • Something they know(password, PIN) • Something they are(human body)

  3. Iris

  4. Retina Every eye has its own totally unique pattern of blood vessels.

  5. Hand

  6. Fingerprint

  7. Ear

  8. Face

  9. Who are these people? [Sinha and Poggio 1996]

  10. Who are these people? [Sinha and Poggio 2002]

  11. Images as Points in Euclidean Space x 1 x x n 2 • Let an n-pixel image to be a point in an n-D space, x  Rn. • Each pixel value is a coordinate of x.

  12. Face Recognition: Euclidean Distances D1 > 0 D2 > 0 ~ D3= 0

  13. Face Recognition: Euclidean Distances D1 > 0 D2 > 0 D3 > D1 or 2 [Hallinan 1994] [Adini, Moses, and Ullman 1994]

  14. Same Person or Different People

  15. Same Person or Different People

  16. Why is Face Recognition Hard?

  17. Challenges: Image Variability Long Term • Facial Hair • Makeup • Eyewear • Hairstyle • Piercings • Aging Short Term Expression Illumination Pose

  18. Illumination Invariants? Does there exist a function f s.t. f ( ) = f ( ) = f ( ) = a and f ( ) = f ( ) = f ( ) = b ?

  19. Can Any Two Images Arise from a Single Surface? n s a I(x,y) = a(x,y) n(x,y) s I(x,y) n Same Albedo and Surface Different Lighting l a J(x,y) = a(x,y) n(x,y) l J(x,y)

  20. The Surface PDE I(x,y) = a(x,y) n(x,y) s ( I l – J s )n = 0 J(x,y) = a(x,y) n(x,y) l Linear PDE Nonlinear PDE

  21. Non-Existence Theorem for Illumination Invariants Illumination invariants for 3-D objects do not exist. This result does not ignore attached and cast shadows, as well as surface interreflection. [Chen, Belhumeur, and Jacobs 2000]

  22. Geometric Invariants? Does there exist a function f s.t. f ( ) = f ( ) = f ( ) = a and f ( ) = f ( ) = f ( ) = b ?

  23. Non-Existence Theorem for Geometric Invariants Geometric invariants for rigid transformations of 3-D objects viewed under perspective projective projection do not exist. [Burns, Weiss, and Riseman 1992]

  24. Image Variability: Appearance Manifolds x2 xn x1 Lighting x Pose [Murase and Nayar 1993]

  25. Modeling Image Variability Can we model illumination and pose variability in images of a face? Yes, if we can determine the shape and texture of the face. But how?

  26. Modeling Image Variability: 3-D Faces ] Laser Range Scanners Stereo Cameras Structured Light Photometric Stereo [Atick, Griffin, Redlich 1996] [Georghiades, Belhumeur, Kriegman 1996] [Blanz and Vetter 1999] [Zhao and Chellepa 1999] [Kimmel and Sapiro 2003] [Geometrix 2001] [MERL 2005]

  27. Illumination Variation Reveals Object Shape n s2 s1 a s3 I1 I2 I3 [Woodham 1984]

  28. Illumination Movie Illumination Movie

  29. Shape Movie Shape Movie

  30. Image Variability: From Few to Many Lighting x Pose x2 xn x1 Real Synthetic [Georghiades, Belhumeur, and Kriegman 1999]

  31. Illumination Dome

  32. Real vs. Synthetic Synthetic Real

  33. Real vs. Synthetic Real Synthetic

  34. A Step Back in Time

  35. Albrecht Dürer, “Four Books on Human Proportion” (1528)

  36. D’arcy Thompson, “On Growth and Form” (1917)

  37. D’arcy Thompson, “On Growth and Form” (1917)

  38. D’arcy Thompson, “On Growth and Form” (1917)

  39. But what if we could ….? [Blanz and Vetter 1999, 2003]

  40. Building a Morphable Face Model [Blanz and Vetter 1999, 2003]

  41. 3-D Morphaple Models: Semi-Automatic [Blanz and Vetter 1999, 2003]

  42. Building Morphable Face Models [Blanz and Vetter 1999, 2003]

  43. Fitting Morphable Face Models [Blanz and Vetter 1999, 2003]

More Related