1 / 19

Facial Motion Cloning Using Global Shape Deformation

Facial Motion Cloning Using Global Shape Deformation. Marco Fratarcangeli and Marco Schaerf University of Rome “La Sapienza” http://www.dis.uniroma1.it/~frat. Motivation. Reduce artistic skill and time required for animation by re-using existing animation Solution: Facial Motion Cloning.

mahala
Download Presentation

Facial Motion Cloning Using Global Shape Deformation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Facial Motion Cloning Using Global Shape Deformation Marco Fratarcangeli and Marco Schaerf University of Rome “La Sapienza” http://www.dis.uniroma1.it/~frat

  2. Motivation • Reduce artistic skill and time required for animation by re-using existing animation • Solution: Facial Motion Cloning Source Target 1 Target 2 Target 3 University of Rome "La Sapienza" - Department of Computer and Systems Science

  3. Overview • Motivation • Related Work • Our Approach • Input & Output • Shape fitting • Cloning process • Results • Conclusions University of Rome "La Sapienza" - Department of Computer and Systems Science

  4. Related Work • Expression Cloning [Noh et Neumann 2001] University of Rome "La Sapienza" - Department of Computer and Systems Science

  5. Related Work • Facial Motion Cloning [Pandzic 2003] University of Rome "La Sapienza" - Department of Computer and Systems Science

  6. Input & Output • Manually picked feature points on the input meshes; • Feature points are compliant with the MPEG-4 specification;(Facial Definition Points) University of Rome "La Sapienza" - Department of Computer and Systems Science

  7. Output: corresponding key positions for the target face … Input & Output • 84 key movements defined by MPEG-4(Facial Animation Parameters) … University of Rome "La Sapienza" - Department of Computer and Systems Science

  8. Volume Morphing Source Shape Fitting Find the morphing function f(P) fitting the source into the target (Radial Basis Functions [Fang 96]) University of Rome "La Sapienza" - Department of Computer and Systems Science

  9. Radial Basis Functions (RBF) if we find a suitable set of correspondence points between source and target, then, we can calculate the interpolation function f(p) fitting the source into the target. [Fang 96] That is, given the known data ui = f (pi), we can compute uk = f (pk). University of Rome "La Sapienza" - Department of Computer and Systems Science

  10. Iterative Fitting – Visual Example Enriching the correspondence set Þprecise fitting University of Rome "La Sapienza" - Department of Computer and Systems Science

  11. 4. Is the source face fitted into the target? NO YES Map & clone… 2. Insert the target vertices having biggest distance into the correspondences set 3. Recompute the interpolation function f(P) and perform morphing Iterative Fitting • After the initial rough fitting… 1. Project target vertices towards source surface University of Rome "La Sapienza" - Department of Computer and Systems Science

  12. Map the target into the deformed source Volume Morphing Source Shape Fitting Find the morphing function f(P) fitting the source into the target (Radial Basis Functions [Fang 96]) University of Rome "La Sapienza" - Department of Computer and Systems Science

  13. ... and map the displacements to the target faces. Cloning Process Use f(P) to deform all the source key positions... University of Rome "La Sapienza" - Department of Computer and Systems Science

  14. University of Rome "La Sapienza" - Department of Computer and Systems Science

  15. Results - Performance University of Rome "La Sapienza" - Department of Computer and Systems Science

  16. Results – Error Assessment Average of the difference between the initial coordinates and the final coordinates University of Rome "La Sapienza" - Department of Computer and Systems Science

  17. Conclusions • PROs: • Pre-existing facial animation becomes reusable; • Fast cloning process: in seconds we have a brand new talking head (1-20 secs on a AMD 2,14 GHz); • Animation through linear interpolation of the key positions leads real-time performance; • MPEG-4 parametrization permits very low bit-rate transmission [Model-based coding - Forchheimer 83]; • CONs: • Target models can not have higher resolution than source models; • Projection method (Target Þ Source) is not perfect ... University of Rome "La Sapienza" - Department of Computer and Systems Science

  18. The End Further material soon here: http://www.dis.uniroma1.it/~frat University of Rome "La Sapienza" - Department of Computer and Systems Science

  19. University of Rome "La Sapienza" - Department of Computer and Systems Science

More Related