1 / 23

Learning the Appearance of Faces: A Unifying Approach for the Analysis and Synthesis of Images.

Learning the Appearance of Faces: A Unifying Approach for the Analysis and Synthesis of Images. Thomas Vetter. University of Freiburg. Germany. http://graphics.informatik.uni-freiburg.de. Computer Vision & Computer Graphics.

drew
Download Presentation

Learning the Appearance of Faces: A Unifying Approach for the Analysis and Synthesis of Images.

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Learning the Appearance of Faces:A Unifying Approach for the Analysis and Synthesis of Images. Thomas Vetter University of Freiburg Germany http://graphics.informatik.uni-freiburg.de

  2. Computer Vision & Computer Graphics Vision ( image) parameters image Graphics ( parameters ) -1 G( image ) Parameters | G(p) - I |2 = minParameters Computer Graphics can help to solve Computer Vision!

  3. Analysis by Synthesis model parameter Analysis Image Model Synthesis Image 3D World Image Description

  4. Synthesis of Faces Database Morphable Face Model Face Analyzer 3D Head Modeler Result Input Image

  5. Approach: Example based modeling of faces 2D Image 3D Face Models = w1 * + w2 * + w3 * + w4 * +. . .

  6. Cylindrical Coordinates h f h f red(h,f) green(h,f) blue(h,f) radius(h,f)

  7. Morphing 3D Faces 1 __ 2 3D Blend 3D Morph 1 __ = + 2

  8. Correspondence: A two step process! 2nd Example Example Reference • Correspondence between • two examples ( Optical Flow like algorithms). • many examples ( Morphable Model )

  9. Vector space of 3D faces. • A Morphable Model can generate new faces. a1 * + a2 * + a3 * + a4 * +. . . = b1 * + b2 * + b3 * + b4 * +. . .

  10. Manipulation of Faces Modeler

  11. Modelling in Face Space Caricatur Original Average

  12. Modelling the Appearance of Faces A face is represented as a point in face space. • Which directions code for specific attributes ?

  13. Learning from Labeled Example Faces Fitting a (linear) regression function

  14. Facial Attributes Subjective Attractiveness Weight Original

  15. Transfer of Facial Expressions - = Smile Novel Face: + Smile = Originals:

  16. Facial Expressions Original

  17. 3D Shape from Images Face Analyzer Input Image 3D Head

  18. Matching a Morphable 3D-Face-Model Optimization problem! a1 * + a2 * + a3 * + a4 * +. . = R b1 * + b2 * + b3 * + b4 * +. .

  19. Error Function • Image difference • Plausible parameters • Minimize

  20. Optimization Strategies • Difference Decomposition • Stochastic Gradient Decent

  21. Future Challenges • Which Object Classes are linear ? • How to built them automatically?

More Related