Chapter 7

1. Chapter 7 Affective Computing

2. Structure • Introduction • Emotions • Emotions & Computers • Applications

3. Introduction • Definition: • computing that relates to, arises from, or deliberately influences emotion. • it is trying to make computer capable of observing, interpreting and generating emotional features. • a computational device helping communicate the emotions of its user, either for: • personal reflection • to increase the bandwidth of communication between people.

4. Emotions • The necessary background for affective computing is the knowledge on emotions and their role in human behavior and cognitive processes. • Definition: • physiological changes caused in our body (anger, happy & etc) & a purely intellectual thought-process. • Closely related to perception.

5. Emotions • Humans understand each other’s emotions through visual, auditory and tactile senses. • Lack of sensory data causes misunderstandings: • E.g.: Widespread use of email has caused many emotional misunderstandings when affectual meanings have been communicated via textual messages that cannot carry the affective information.

6. Emotions & Computers • Affective computing consists of four related areas: • Recognizing emotions • Expressing emotions • Having emotions • Emotional intelligence

7. Emotions & Computers:Recognizing emotions • It is the foundation of AC. • For recognizing ordinary human emotions, computer needs human senses like audio and video, gathering facial expressions and vocal intonations. • Can sense inputs that can’t be detected by human senses – reading infrared temperature, measuring electrothermal conductivity, and etc.

8. Emotions & Computers:Recognizing emotions • Once emotional expressions are sensed and recognized, the system can use its knowledge about emotion generation and situation to infer the underlying emotional state that most probably gave rise to the expressions.

9. Emotions & Computers:Expressing emotions • A computer can express emotion without actually havingemotions (like actors). • The basic requirement for a computer to express emotions: • to have channels of communication such as voice and image • an ability to communicate affection over those channels

10. Emotions & Computers:Expressing emotions • Computers can express emotions humanly like face expression or vocal intonation. • It also can be something totally new and inhuman for computers are not human and may have different ways of expressing emotions. • Affective bandwidth: • a characteristic that can be assigned to communication channels.

11. Emotions & Computers:Expressing emotions • Affective bandwidth: (cont…) • describes how much certain communication channel lets affective information through. • With text it is minimal, increasing with voice and video. • Ordinarily mediated communication channels have much less affective bandwidth than person-to-person. • In a VR environment utilizing emotional data that humans cannot perceive (skin conductivity, temperature) have higher affective bandwidth.

12. Emotions & Computers:Having emotions • Picard (1998) proposes model of five components that all should be present in a system if it is to have emotions: • Emergent emotions • Fast primary emotions • Cognitive emotions • Emotional experience • Body-mind interactions

13. Emotions & Computers:Having emotions • Emergent emotions: • Those which are attributed to systems based on their observable emotional behaviour, especially when the system at hand doesn’t have any explicit internal mechanism or representation to emotions. • E.g.: • Smiling emoticon gives positive emotions to user but it doesn’t really have any emotions. • The user perceives the emotions him/herself.

14. Emotions & Computers:Having emotions • Fast primary emotions: • Many animals including humans have hard-wired, innate responses, especially to potentially harmful events. • We can feel startled, angry, or afraid before the signals event get to the cortex, and before becoming aware of what is happening. • System can use this primary emotions to recognize communicating patterns.

15. Emotions & Computers:Having emotions • Fast primary emotions: (cont…) • Two communicating pattern recognition systems: • a rough system that acts fast and can hijack the cortex • a finer system that is slower but more precise.

16. Emotions & Computers:Having emotions • Cognitive emotions: • involving explicit cognitive reasoning in their generation. • E.g.: • completing a difficult task can generate an intense feeling of satisfaction. • In healthy human, cognitively generated emotions usually provoke an emotional experience with subjective feelings, activating limbic responses and bodily feelings.

17. Emotions & Computers:Having emotions • Emotional experience: • There are three aspects of emotional experience. • First aspect: • A feeling system is able to label its emotional behaviours, and understand its own affective system. • Then it can be said to have fundamental awareness of its emotional behaviours

18. Emotions & Computers:Having emotions • Emotional experience: • Second aspect: • awareness of the emotions’ physiological accompaniments. • For humans these include heart rate, breathing, cold feet, and so forth. • Most computers don’t have sensors that could discern their physical state but those could be added. • E.g.: Relate computer awareness with internal software state.

19. Emotions & Computers:Having emotions • Emotional experience: • Third aspect: • the tricky “gut feelings” that let’s humans know subjectively something is good or bad, that humans like or dislike something.

20. Emotions & Computers:Having emotions • Body-mind interactions: • Emotions influence: • decision making, perception, interest, learning, priorities, creativity, and more. • cognition, and therefore intelligence, especially when it involves social decision making and interaction. • physiological systems outside of brain – vocal and facial expressions, posture and movement.

21. Emotions & Computers:Having emotions • Body-mind interactions: • Emotions complicatedly interact with the human body and mind for it influences everything related to humans. • The aspect of emotion’s interaction with body and mind that may be most important for computers is the influence of emotion on cognitive processes.

22. Emotions & Computers:Emotional intelligence • A computer with emotional intelligence will be one that is: • skilled at understanding and expressing its own emotions • recognizing emotion in others • regulating affect • using moods and emotions to motivate adaptive behaviours.

23. Emotions & Computers:Emotional intelligence • Recognition of emotion in others includes: • reasoning about what emotion is likely to be generated in a situation • ultimately understanding what is important to other person • what are his/her goals, preferences and biases

24. Emotions & Computers:Emotional intelligence • These components of emotional intelligence rely on the three previous abilities of affective computing: • Recognizing emotions • Expressing emotions • Having emotions. • Computers that have emotions have to be aware of them, and will need to be able to regulate and utilize them.

25. Research Areas of AC (MIT 2000)

26. Emotions & Computers:Potential Concerns • Technology almost always has a darker side. • Emotional computer can make harmful and distorted decisions (remember Terminators anyone?!) • Emotionaldecision making has strong negative connotations • Acting emotionally is normally bad to self & others.

27. Emotions & Computers:Potential Concerns • Making the computer decision making process emotional is a delicate matter. • A balance should be found where the positive effects of emotionality can be utilized without slipping into irrational behavior. • A strong regulation of affection is required.

28. Technologies of Affective computing • Three basic technologies to capture emotions: • Emotional Speech • Facial Expression • Body Gesture