250 likes | 314 Views
Facial Motion Capture. Dr. Midori Kitagawa School of Arts, Technology and Emerging Communication University of Texas at Dallas. Facial Anatomy.
E N D
FacialMotion Capture Dr. Midori Kitagawa School of Arts, Technology and Emerging Communication University of Texas at Dallas
Facial Anatomy • Our most important irreplaceable organ, the brain, and the sensory organs for all of our five senses (eyes for sight, ears for hearing, tongue for taste, nose for smell, and skin for touch) are in our heads.
Human skull • Consists of the 8 cranial bones and 14 facial bones. • Its shape underlies the appearance of the individual. • Age, gender, ethnical and individual differences.
Cranium • Dome-shaped part of the skull that contains the brain. • Formed by 8 plates of bones that are fused only after births.
Frontal cranial • Top part of the face above the eyes and plays the most important role in the facial features among the cranial bones. • Arcus superciliaris (brow ridge) is a ridge above the eyebrows and a part of the frontal cranial bone.
Maxilla • Upper jaw bone is two bones fused together. • During the pregnancy, two bones in the embryo’s cheeks grow towards the center of the face.
Mandible • Lower jaw or jawbone • Largest, strongest and lowest bone in the human face
Maxilla and Mandible • Getting smaller • Wisdom teeth
Facial muscles • The face is the only part of the human body where voluntary muscles attach to other muscles instead of bones. • Most of our facial muscles are small, thin, layered, and embedded in fatty tissue. • Motion capture of facial expressions is almost exclusively done with optical systems due to the subtlety of the motion.
Temporalis • Covers the large temporal area of the face. • It starts from a side of the cranium, goes under the zygomatic arch, and attaches to the top of the mandible.
Temporalis • Human temporalis is smaller than the ape’s or our ancestors’. • Sagittal crest (a ridge of bone running lengthwise along the midline of the top of the skull) indicates that there are exceptionally strong jaw muscles
Masseter • Starts from the zygomatic arch and attaches to the lower part of the mandible. • Plays a major role in the chewing of solid foods
Temporalis and Masseter • Carnivores have larger temporalis and smaller masseter. • Herbivores have smaller temporalis and larger masseter.
Temporalmandibular joint (TMJ) • Joint between the mandible and temporal bone of the skull.
How many degrees of freedom in TMJ? • Mandible moves in all three directions. We can move our mandibles up and down, front and back, and right and left. • Mandible rotates to open/close the mouth. • 3 DOF translation + 1 DOF rotation = 4 DOF • We often simplify and restrict the movement of a 3D character’s lower jaw by allowing the jaw joint to have only one degree of freedom.
Facial Capture • Optical
Facial Capture • If a high-end system has a sufficient number of high resolution cameras, it can capture full body motion and facial expressions simultaneously (i.e., full performance capture). • With most optical systems, facial expressions are captured separately from body motion using a smaller capture volume or a separate facial capture rig.
Full Performance Capture • Simultaneous capture of full body motions and facial
Facial Capture • Computer vision