1 / 42

Making the head smile

Making the head smile. Smile ? -> part of non-verbal communication Functions of non-verbal communication To enhance linguistic information To give new information. Non-verbal communication. Figure by Jari Kätsyri. Voice prosody. Figure by Jari Kätsyri. Head. Figure by Jari Kätsyri.

taber
Download Presentation

Making the head smile

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Making the head smile • Smile? -> part of non-verbal communication • Functions of non-verbal communication • To enhance linguistic information • To give new information Michael Frydrych, 11.6.2004

  2. Non-verbal communication Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  3. Voice prosody Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  4. Head Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  5. Eyes Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  6. Facial expressions Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  7. Gestures Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  8. Conversation regulation Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  9. Conversational signals Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  10. Maintenance Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  11. Emotions Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  12. Expressing emotions Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  13. Conversational signals Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  14. Voice Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  15. Head Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  16. Eyes Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  17. Face Figure by Jari Kätsyri Michael Frydrych, 11.6.2004

  18. Examples Michael Frydrych, 11.6.2004

  19. Dimitris Metaxas, Normal Badler • Modeling of hand gestures • Modeling emotions, personality… Michael Frydrych, 11.6.2004

  20. Facial expressions Emotional expressions in face • Are expressions showing emotions? • How they can be described? • What kind of emotions are there? Michael Frydrych, 11.6.2004

  21. Emotion in face: To communicate or to express? • Communicating vs. expressing emotions • Intentional communication (Chovil) vs. • Involuntary behaviour (Ekman) • Technology viewpoint • Emotion = Emotional expression = (Non-verbal) communication • (In most situations emotions inappropriate) Michael Frydrych, 11.6.2004

  22. Emotions and facial expressions (Ekman) • Emotion  Facial expression ? • Emotional expressions can be inhibited • No evidence for non-expressed emotions • Facial expression  Emotion ? • Emotional expressions can be faked • There are facial muscles with no voluntary control • Facial expression  Emotion (?) Michael Frydrych, 11.6.2004

  23. Description of expression Several descriptions of expressions exist: • Facial Action Coding System – FACS • By Eckman and Friesen • ”Language of facial expressions” • MPEG-4 Synthetic-Natural hybrid coding (SNHC) • “Technical” description for low-bandwidth transmission Michael Frydrych, 11.6.2004

  24. FACS • Noticeable changes, not exactly facial muscles • Tool for identifying facial actions • Not for modeling facial actions • Does not describe dynamics • Action units (AUs) • AU1: Inner brow raiser • … • AU23: Lip tightener • … • AU66: Crosseye Michael Frydrych, 11.6.2004

  25. AU examples: AU7 (lid tightener) Michael Frydrych, 11.6.2004

  26. AU examples: AU9 (nose wrinkler) Michael Frydrych, 11.6.2004

  27. AU examples: AU11(nasolabial furrow deepener) Michael Frydrych, 11.6.2004

  28. Pure and blended emotions • 7 pure emotions • Pleasure (pl), surprise (su), fear (f), hate (h), sorrow (so), disgust (d), (interest) • Blended emotions • Combinations of pure emotions • Easy: pl+su, h+d, so+f • Difficult: su+f, d+pl, h+so, f+pl • (Some) additivity Michael Frydrych, 11.6.2004

  29. Possible causes of blended expressions in real world • Mixed emotions (sadness+disgust) • Consequent emotions (surprise+happiness) • Masking (anger+happiness) • … Michael Frydrych, 11.6.2004

  30. Attempts to add emotions Michael Frydrych, 11.6.2004

  31. sad neutral surprise Michael Frydrych, 11.6.2004

  32. 6 basic expressions courtesy Jari Kätsyri Michael Frydrych, 11.6.2004

  33. Blended expressions courtesy Jari Kätsyri Michael Frydrych, 11.6.2004

  34. Textured × non-textured Identification of expressions from pictures and videos of textured and non-textured version of AP Michael Frydrych, 11.6.2004

  35. Differences among databases Number of correct responses for pictures and videos of different databases Michael Frydrych, 11.6.2004

  36. Neutral expression Average evaluations for AP textured and non-textured neutral expressions Michael Frydrych, 11.6.2004

  37. Better implementation • Collecting data Michael Frydrych, 11.6.2004

  38. Collecting data for expressions happy anger Michael Frydrych, 11.6.2004

  39. HUT facial expression database • First Finnish database of moving facial expressions Michael Frydrych, 11.6.2004

  40. Study:Interaction of blur x type x emotion • New database, 6 actors • 3 levels of blur • Pictures, short video sequences • 6 basic expressions • 3 subject groups (17 each) • each group – 1 level of blur • each actor 6 expressions • 3 actors pictures, 3 actors videos Michael Frydrych, 11.6.2004

  41. Interaction of blur x type x emotion Michael Frydrych, 11.6.2004

  42. The end • Thank you! • and … a little exercise again Michael Frydrych, 11.6.2004

More Related