110 likes | 119 Views
Explore the fascinating world of communicating with avatar bodies, delving into gestures, postures, facial expressions, and more. Learn how user movements translate onto avatars and the significance of synchrony and expression in nonverbal behaviors. Discover the design space and network issues in avatar communication, evaluating factors like task dependence and interaction engagement. Uncover the co-expressive nature of gestures and speech, and the use of virtual prototypes for design. Embark on a journey beyond chat to understand the nuanced language of avatar bodies in digital realms.
E N D
Communicating withAvatar Bodies Francesca Barrientos Computer ScienceUC Berkeley 8 July 1999HCC Research Retreat
ComicChat Oz blaxxun Avatar worlds
Nonverbal behaviors • Gesture • Proxemics • Posture • Facial expression • Gaze • Context • Appearance • ...
(Nivi waves to Harry.) Previous approaches Natural Language Inference Expression selection Automatic animation
Interfaces for controlling animation of nonverbal behaviors verbal communication through audio continuous control Understand how user movements translate onto avatar bodies Beyond chat
Part of meaning of gesture comes from its co-ocurrence with speech Rhythm, flow, stroke, force, shape… Importance of synchrony
Evaluation • Depends on task • Ease of use • Expressive satisfaction • Level of interaction engagement • Emergent communicative behaviors
Network issues • Synchronizing control and audio data
Summary • Avatars allow communication using surrogate bodies • Gesture and speech are coexpressive • Design tool: virtual prototypes for PRoP design