100 likes | 234 Views
FaceSpace – A Facial Spatial-Domain Toolkit. Steve DiPaola - Assoc. Professor - Interactive Arts Simon Fraser University, Vancouver NOTES: www.dipaola.org/IV02 The Face Space: Facial Animation & Modeling Systems Facial Knowledge Domain: Parameters Expression Space
E N D
FaceSpace – A Facial Spatial-Domain Toolkit • Steve DiPaola - Assoc. Professor - Interactive Arts Simon Fraser University, Vancouver • NOTES: www.dipaola.org/IV02 • The Face • Space: Facial Animation & Modeling Systems • Facial Knowledge Domain: Parameters • Expression Space • Prototypes: FaceLift – FaceSpace
The Face • 6 billion unique faces – the magnificent surface • Showcase to the Self • Displays: Age, sex, health, mood, thoughts -- our soul. • Evolution: We are all experts on facial interpretation • Not experts at how we use & interpret face communication.
Face system toolkit • 1) Understand the real : how faces work • Facial communication and expression • Facial meaning & relationships • 2) Bring knowledge to our UI, Expression systems • Expressive communication systems (Agents, Avatars) • Interactive movies, games,voice-mail , …
Current Face Authoring Tools • Current Authoring tools use: • general purpose 3D & adhoc techniques • Most common face authoring approaches • Face Creation: • General modeling : specific face type • Face Animation: • Morphing: point set interpolation • Boning, Skinning • Muscle or surface deformation systems
FaceScript Facial Knowledge Domain: FaceSpace • Knowledge-based approach • Face areas & function dictate: • resources / techniques • Object oriented (facial need) • Parameters Space: + • Param: controls an aspect of face • Encapsulated in unitized vectors • Hides complexity > uniformity • Compact, mathematically rigorous • Face: set of LL parameters • All faces: space of parameters
Proto: FaceLift – Maxis’ “The Sims” • N-dimensional parameter (vector) space of correlated faces • Use genetic algorithm to traverse or “browse” • + • Searches vrs creating a face • Faces “near-by” other faces • Breed, add/combine faces • Faces: pointer to a region of faces
A space of face types • Facial Knowledge Space: • Correlated, contiguous • Complete, self describing • Many benefits … • + • Proto: low level Parameters • Low level knowledge • Common face knowledge
Customized Space Classification • Space Classification (axis)?: • Cultural stereotypes (gangsters, …) • Ethnic, demographic, evolutionary, … • Human qualities, personalities, … • Dimensions of a space: • customized and task oriented • LL params: full range, compact, oo • HL params: goal specific • - expressions: devolve to LL params
Emotion and Expression Space • Extend “space” to expressions, emotions • High articulation, low specification • Time based issues (atom of slyness) • HL Params: Hierarchicy behavior set • Emotion models, expression models: • Lip sync • Gestures • Mood +
FaceSpace – A Facial Spatial-Domain Toolkit • Steve DiPaola - Assoc. Professor - Interactive Arts Simon Fraser University, Vancouver NOTES: www.dipaola.org/IV02 steve@dipaola.org www.dipaola.org