130 likes | 148 Views
Institut für Informatik. Application of Emotion Recognition Methods in Automotive Research. Matthias Wimmer, Christian Peter, Jörg Voskamp, Martin A. Tischler. 2nd Workshop “Emotion and Computing”, 10.9.2007, Osnabrück. Theoretical Background of Driving Pleasure.
E N D
Institut für Informatik Application of Emotion Recognition Methodsin Automotive Research Matthias Wimmer, Christian Peter, Jörg Voskamp, Martin A. Tischler 2nd Workshop “Emotion and Computing”, 10.9.2007, Osnabrück
Theoretical Background of Driving Pleasure • Jordan (2000): “Four Pleasures” • Physio-pleasure • Psycho-pleasure • Socio-pleasure • Ideo-pleasure Driver‘s Objective: Optimal Activation Resources und Restrictions Transfer of Driver‘s Request Task Difficulty Driveability Task Demands Vehicle Sportiveness Emotional estimation Comfort Capability Environment based on Fuller (2005) Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"
Measurement of Emotions in Vehicles Questioning during driving Cognitive appraisal of the vehicle and the situation • Facial expressions • Gestures • Changes in voice Driving style and operator control action ECG, EMG, EDA Valence Behavior Acitvation Feeling Appraisal Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"
Pilot Study „Driving Pleasure W204“ 2007 C220 CDI (W204) 1982 190E (W201) Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"
Cooperation Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"
Subjects: 8 non professional drivers (age: 33-53) Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"
Task:Drive on three courses Autobahn Handling course Bosch Proofing Ground Boxberg (near Heilbronn) Country road Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"
video camera driving dynamics meter EREC glove microphone cell phone handsfree set ERECrecording unit TechnicalSetup Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"
The Methods in Detail Physiological measurement system EREC (skin resistance, heart rate, temperature) Video and audio recorder on the back seat Drivers were asked to “think aloud” Interviews and questionnaires after driving each car Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"
Subjective Driving Experience strongly disagree strongly agree 1,0 3,0 5,0 7,0 subjective control no worries about safety MB 190E drove too risky MB C220 vehicle is predictable vehicle met my desires N=8, Method: questionnaire Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"
Institut für Informatik Facial Expression Recognition Mercedes-Benz 190E Mean expression of happiness: 4,2% Peak value: 15,0% Mercedes-Benz C-Class 220 Mean expression of happiness: 5,5% Peak value: 19,8% 0% = neutral face 100% = maximum expression Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"
Activation A A C H C H 1 3 5 7 9 Valence A Autobahn C Country road H Handling MB 190E MB C-Class 220 1 Speech Analysis + • Most important parameters • changes of pitch • intensity • energy changes over frequency bands • Average confidence • 1.1-1.2 for valence • 0.9-1.0 for arousal - + - Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"
Conclusions • Methods show corresponding results • Speech analysis • Easy to apply, but speech is not a natural product while driving • Facial expression recognition • Challenge in fitting the face model and classifying the facial expression • Problems: changing light and background, non emotional-related head movements, driver is talking • Advantages of tested methods • Non disturbing • Continuous data collection • Useful completion to psychological methods Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"