1 / 17

Towards investigating effective affective dialogue strategies

Towards investigating effective affective dialogue strategies. Gregor Bertrand, F lorian Nothdurft , Steffen Walter, Andreas Scheck, Henrik Kessler and Wolfgang Minker. Outline. Introduction Role of Emotion in SLDS Purpose of our Study Design of our Study Current Status

upton-suarez
Download Presentation

Towards investigating effective affective dialogue strategies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Towardsinvestigatingeffectiveaffectivedialoguestrategies Gregor Bertrand, Florian Nothdurft, Steffen Walter, Andreas Scheck, Henrik Kessler and Wolfgang Minker

  2. Outline Introduction Role of Emotion in SLDS Purpose of our Study Design of our Study Current Status Conclusion / outlook

  3. Introduction • Research on Companion Technologies (www.sfb-trr-62.de) • Speech dialogue one form of UI • Role of emotion in dialogue: • Agreement / disagreement • Adapt dialogue style • Need of clarification • Misunderstanding • Additional modality • Adapt dialogue to user emotion

  4. Outline Introduction Role of Emotion in SLDS Purpose of our Study Design of our Study Current Status Conclusion / outlook

  5. Role of Emotion in SLDS Spoken language dialogue system Acoustic front-end Speech recognition Linguistic analysis Dialogue management Application Speech synthesis Text generation Spoken Language Dialogue System architecture Extend with emotional capabilities

  6. Role of Emotion in SLDS Acoustic front-end Speech recognition Linguistic analysis Dialogue Management Application Speech synthesis Text generation Emotion based on sensor measurements React to user emotion in an appropriate way – but how?

  7. Outline Introduction Role of Emotion in SLDS Purpose of our Study Design of our Study Current Status Conclusion / outlook

  8. Purposeofourstudy • Investigation of emotions relevant for speech interaction • Investigation of biophysiological features connected to emotion • EEG (electro encephalography) • Blood pressure • Heart rate • Skin conductance level • Breathing • Explorative testing of emotional strategies

  9. Outline Introduction Role of Emotion in SLDS Purpose of our Study Design of our Study Current Status Conclusion / outlook

  10. Design ofour Study • User GUI • Speech Interface provided by Wizard of Oz architecture Timer Performance feedback

  11. Design ofour Study • Wizard GUI Application control Performance rating Predefined feedback

  12. Design ofour Study • Biophysiological data is taken • 5 Rounds of Memory • Each Round is supposed to evoke an emotional state (points in PAD-space) • Classification of the data • Emotional dialogue strategies • Thankful • Motivating • Empathetic • Neutral Pleasure Arousal Dominance

  13. Outline Introduction Role of Emotion in SLDS Purpose of our Study Design of our Study Current Status Conclusion / outlook

  14. Current Status • 14 Persons (aged between 20 and 50 years) • SVM - Classifiers for intraindividual emotional features do well • SVM - Classifiers for interindividual emotional features do not so well • Individuals show different features on biophysiological level • Dialogue strategies need to adapt to individual emotional situation

  15. Outline Introduction Role of Emotion in SLDS Purpose of our Study Design of our Study Current Status Conclusion / Outlook

  16. Conclusion / Outlook WoZ experiment on user emotion Speech interface Individuality of user emotion Requirements for dialogue management  Design of an appropriate dialogue model  Design of an appropriate dialogue management algorithm

  17. Thanksforyourattention! …Questions?

More Related