HUMAINE Plenary Paris, June 4, 2007

1. HUMAINE PlenaryParis, June 4, 2007 Blueprint for an emotionally competent agent Blueprint for an emotionally competent agent Klaus R. Scherer Swiss Center for Affective Sciences Klaus R. Scherer Swiss Center for Affective Sciences

4. What is an emotion?

5. Functions and components of emotion

6. Blueprint of a blueprint Integra- tion to qualia Multi-modal mapping of direct and propriocept. app. results Current feature vector of event implic. Multi-level Appraisal Cate- goriza- tion Regu- lation Event Efferent Effects

7. Component process model Appraisal and efferent motor expression Memory Motivation Reasoning Self Concept Attention Normative Significance Event Relevance Implication Coping this is novel and important this will obstruct my goals I can deal with this this is unfair and immoral

8. Levels of processing in the appraisal process Leventhal, H., & Scherer, K. R. (1987). The relationship of emotion to cognition: A functional approach to a semantic controversy. Cognition and Emotion, 1, 3-28..

9. Component process model:Afferent and efferent processes

10. CPM response patterning predictions for efferent effects of the conduciveness check

11. Component process model - Monitoring and regulation via multimodal integration Appraisal Regulation patterning and weight of criteria Feeling SNS patterning and amplitude Quality Intensity Duration patterning and amplitude ANS urgency Motivation

12. Motor expression Physiological symptoms Action tendencies Cognitive appraisal A B Unconscious reflection and regulation C Conscious representation and regulation Zone of valid self-report measurement Verbalization and communication of emotional experience Component process model - Internal representation and feeling

13. When does component reflection become conscious representation?

14. A first blueprint LTM Monitor Feeling Attention propositional Executive space Motivation schematic propositional ANS preparation schematic SNS Action tend. Event sensory- motor Sensory registers

15. Discrete emotion theory(Ekman – Emotions Revealed - 2003) Autoappraiser data base Universal events (innate threat schema) Learned events Neuro-motor program Event There are no major incompatibilities with the CPM model ... if the Autoappraiser data base is instantiated by the CPM appraisal mechanism and if the notion of “affect program” is replaced by more molecular and more variable “partial programs”. lookup

16. Appraisal-generatedsequential cumulative expression 0 1+2 1+2+4 1+2+4+17+23 1+2+4+17+23+10+14

17. What is the mechanism that produces facial expressions? An innate affect program that produces an emotion-specific pattern when triggered by an event? A sequential unfolding of facial movements resulting from successive appraisals of the situation? OR Watch now! Watch now! The apex of the expression is the same but the process is different. Research on the dynamics of facial expression is required to settle this question that has important theoretical implications.

18. Joseph LeDouxLow and high roads to fear Visual thalamus Visual cortex Amygdala Illustration based on LeDoux JE (1994) Emotion, Memory, and the Brain. Scientific American.

19. Computational modeling of fear conditioning:Neural architecture There are no major incompatibilities with the CPM model ... as this mechanism can be considered as a special case of automatic appraisal at low levels of processing, based on conditioned responses Armony, J. L., Servan-Schreiber, D., Cohen, J. D., & LeDoux, J. E. (1997). Computational modeling of emotion: explorations through the anatomy and physiology of fear conditioning.Trends Cogn Sci, 1(1), 28-34.

20. Öhman & Wiens model of fear activation There are no major incompatibilities with the CPM model ... if one drops the assumption of dedicated modules for the automatic processing of specific emotions such as fear and assumes that evolutionarily prepared or strongly conditioned stimuli are automatically appraised at low levels of processing using prepotent schemata Öhman, A., & Wiens, S. (2004). The concept of an evolved fear module and cognitive theories of anxiety. In A. S. R. Manstead, N. H. Frijda & A. H. Fischer (Eds.), Feelings and emotions: The Amsterdam symposium (pp. 58-80). Cambridge, UK: Cambrigde University Press.

21. Bellicose Alarmed Hostile Tense Hateful Envious Angry Afraid Enraged Annoyed Defiant Contemptuous Two-Dimensional Core AffectRussell/Barrett NEWS! Components Appraisal There are no major incompatibilities with the CPM model ... if one drops the assumption of core affect as the primary output of the appraisal system and the notion that the components of emotion are dissociated, the unity of the experience consisting exclusively in a socioculturally determined construction

22. A hierarchical set of mappingsfrom greater to lower complexity Appraisal criteria checking Criteria-specific outcomes Componential patterning Outcome-specific responses Integration to unique feeling Integration and synchronisation Specific to individuals Qualia emotions Semantic feature rules Labelled emotions Specific to language/culture Semantic field rules Modal (basic) emotions Universal Semantic dimension rules Affective dimensions Universal

23. Three components of Emotional Competence • Production of appropriate emotional reactions to different types of eliciting events based on adequate appraisal of internal goal states, coping potential, and the probable consequences of events. Adaptive response patterning. • Adaptive regulation of one's emotional states both with respect to internal set points and according to the socio-cultural and situational context • Efficient emotional communication in social interaction through appropriate expression of one’s own state and the ability to accurately recognize the affective state of others

24. Appropriate emotional reactions: Appraisal • Appropriate emotion elicitation. Automatic detection of significant objects and events. Avoiding to overreact (hyper, stress) or underreact (Aristotle’s social fool) • Appropriate emotion differentiation. Evaluating the implications of an event in a realistic fashion. Correct estimation of coping potential. Accurate assessment of social expectations, norms, and moral standards.

25. Appropriate emotion regulation: Response preparation and control • Appropriate response preparation. Synchronized response patterning correctly driven by appraisal results. Preparation of adaptive action tendencies. • Appropriate monitoring. Appropriate reflection and integration of all emotion components. Balanced conscious and unconscious processing. Precise proprioceptive feedback. • Appropriate regulation and control. Absence of impulsiveness. Automatic use of appropriate regulation mechanisms (reappraisal and response manipulation). Social attunement.

26. Efficient emotional communication: Strategic display and accurate recognition • Appropriate strategic emotion display. Ability to adapt emotional expression to strategic interaction goals (Aristotle, Goffman). Congruent expression in different modalities. • Accurate emotion recognition. High ability to recognize emotional states of others in different modalities, even if controlled or concealed. High capacity for empathy.

27. The Aristotelian model - Appropiateness Disorder A Competence Fits trait: Production Incompetence A Competence Incompetence B Disorder B Too little Just right Too much Fear disposition The Galtonian model - Ability Continuously increasing competence Competence Fits skill: Perception Disorder The more the better Recognition accuracy Criteria for emotion competence

28. Desiderata for computational modeling informed by emotion theories 1 • Links to theory and evidence • Theory-guided approach and precise hypotheses • Neuro-architectural constraints of elicitation and control processes • Possibility to check simulation outcomes against real data • Open, generative systems • Specifying the mapping of raw input into system functions • Economical use of fixed built-in templates, rules, or data bases • Allowing emergent response patterns and behavior

29. Desiderata for computational modeling informed by emotion theories 2 • Dynamic modeling • Predicting temporal unfolding of constituent process • Allowing for nonlinear and chaotic functions • Specification of multimodal integration functions over time • Hierarchic control structure • Specifying a hierarchy of control processes • Specification of multiple processing levels with loop-backs • Allowing for recursive processing

30. A blueprint for an affectively competent agent (book proposal) Tanja Bänziger, GERG University of Geneva Plenary meeting, 04-07 June 2007, Paris

31. Overview • Guideline: What does it take to make an agent "emotionally competent" • Confrontmodels grounded in • Emotion Psychology • Affective Neuroscience • Philosophy • Affective Computing • Cross-fertilization • give raise to new perspectives and questions in the considered research fields • the book should outline the (mutual) benefits of interdisciplinarity

32. Overview (structure and contents)link pdf on portal • Structure: 5 sections and 18 chapters • Comments and dialogues in the final section • "The last section of this volume will include comments and discussions on a number of major open or controversial issues." • This could include (…suggestions!) • Animal models, human models, models for robots, for ECAs … • How do they relate (multi-layered, different, …) • Affective neuroscience models and computational models • Can they inform each other, mutual benefits, limits of the analogy • Minimal requirements for an affectively competent agent • What should the minimal specifications (characteristics) of an "affectively competent agent" include • Does/will an "affectively competent agent" (ever) compare with an emotional human being , science and science-fiction • Ethical issues raised in the volume • Creating an emotionally competent agent: benefits and risks

33. Thank you for your attention! Neural Network #1