610 likes | 781 Views
Theory of Affect Part Two MS2306. From rational machines to affective computing. See IBM film from 1965 (first 2mins) See Royal Society Summer Exhibition (2mins). This week. Defining affect The marketing of affect Affect and HCI. The Atmosphere of Affect.
E N D
Theory of Affect Part Two MS2306
From rational machines to affective computing • See IBM film from 1965 (first 2mins) • See Royal Society Summer Exhibition (2mins)
This week • Defining affect • The marketing of affect • Affect and HCI
The Atmosphere of Affect Insubstantiality of affect makes it difficult to touch. It has no substance (form), but it does have an influence… a force…
Nonrepresentation What is in the box?
Theories of Affect • What is Affect? (Thrift, 2008 pp. 175-182) • No stable definition of affect • Not just about feeling or emotion, more about motion, social interaction…
Affect is not the opposite of cognition • Affect is not irrational • Alternative way of thinking about the world – a different kind of intelligence (Thrift, 2008)
Four Approaches to Affect • Darwin’s study of emotions • Universal emotion • Affective expression evolutionary • Preparing humans and animals for action • Omits communicative affect The Expression of the Emotions in Man and Animals in 1872
Slight Sadness Fear mixed with surprise Happiness and contempt Sadness and fear Disgust and contempt Fear and surprise Questioning surprise Neutral
2. Psychoanalytical Affect Emotions part of the inner unconsciousness of the individual Linked to biological drives A biologically-derived affect Four Approaches to Affect Freud Is psychoanalysis dead or just unconscious?
Four Approaches to Affect 3. Bodily States and Processes • Criticises idea of subjects “talking about” their emotion • Source of emotions can come from outside the body • Blushes, laughs, crying and anger are visceral responses to others
Four Approaches to Affect 4. Manifold “Psychology” of Affect • Capacity to affect and be affected • Like insects, swarms • Emergent interactions driven by sensory environment
Feeling, Emotion, Affect Feeling, Emotion, Affect byEric Shouse (drawing on Brian Massumi) M/C Journal, Affect. Volume 8, Issue 6 Dec. 2005
Feeling • A sensation • ‘Checked against previous experiences’ • Labeled (I feel happy, hurt, angry, scared…) • ‘Personal and biographical’ • ‘every person has a distinct set of previous sensations from which to draw when interpreting and labeling’ Feeling, Emotion, Affect byEric Shouse M/C Journal, Affect. Volume 8, Issue 6 Dec. 2005
Emotion • A projection • Display or broadcast of a feeling • Can be either genuine or feigned • Paul Ekman’s experiment • American and Japanese subjects watched films depicting facial surgery • When alone - displayed similar expressions • When in groups - expressions were different Feeling, Emotion, Affect byEric Shouse M/C Journal, Affect. Volume 8, Issue 6 Dec. 2005
Affect • A non-conscious experience of intensity • A moment of unformed and unstructured potential - Always prior to and/or outside of consciousness (Massumi in Parables of the Virtual) • The body’s way of preparing itself for action (decision making) Feeling, Emotion, Affect byEric Shouse M/C Journal, Affect. Volume 8, Issue 6 Dec. 2005
Thrift locates the “strategic” use of affect in political and corporate arenas… He also refers to its location in design Putting Affect to Work?
The marketing of affect Look at how good Apple are at developing affective relations between users (consumers), brands and products
Computer design has not however always considered human emotion
The marketing of affect Corporations in the business of making 'hormonal’splashes through increasing contact with consumers (Thrift p. 247)
Affective Computing • Field concerns emotions and computers • A major shift from traditional “rationale” computer research
But Jim, human emotions are irrational Affective Computing Main focus on the link between emotion and… Decision making Learning Memory processes
Neuroscience • Antonio Damasio (1994) located the importance of emotions in thinking processes • I think therefore I am • I feel therefore I am
Indecision • Contrary to Spock, experiments with real people with brain disorders that produce a lack of emotion were found to be terrible at making decisions • Consider all the possibilities • Continue analyzing • Unable to conclude
Affective Computing • Can computers express,recognize and understand emotions? • Is a computer able to feel? See Eerik Vesterinen’sliterature review - Locates prominent research questions in the field
How do computers express emotions? • Like an actor controlling facial expressions, stance, voice tone, proximity etc…
Expressing emotions • A computer can express emotions without really “having” emotions, or without really “feeling”
Videos of MIT's Nexi MDS Robot: First Test of Expression • - Official MDS Robot Video - First Test of Expressive Ability (Longer version)
How do computers recognize emotions? • A computer must have senses • Audio to hear vocal intonations • Video to see facial expressions • Try it out on the Affectiva website • http://www.affectiva.com/affdex/?#pane_tryit • Read about it: http://www.npr.org/2012/02/03/146343563/how-did-that-ad-make-you-feel-ask-a-computer
How do computers recognize emotions? • Reading infrared body temperature and measuring electrothermal skin conductivity • Measuring heart rate and respiration • Uses these inputs to infer an emotional state
Alicebot.Org Joseph Weizenbaum’sEliza (Java Version Article by Noah Wardrip-Fruin Eliza, Tale-Spin, and SimCity “Jenn” at alaskaair.com How do computers recognize emotions? • Testing a computer’s ability to guess the emotional state of a user
Can Computers Feel? • Picard (1998) proposes a model of five components that should all be present in a system if it is to have emotions. • Emergent Emotions • Fast Primary Emotions • Cognitive Emotions • Emotional Experience • Body-Mind Interactions See also Picard’s AFFECTIVE COMPUTING FOR HCI
Four HCI Goals in Affective Computing • Reducing user frustration • Listening • Empathic • Sympathetic • Enabling comfortable communication of user emotion • Voice tone • Sense facial expressions • Developing infrastructure and applications to handle affective information • Affective “wearables” • Building tools that help develop social-emotional skills • Autism Research See Picard’s AFFECTIVE COMPUTING FOR HCI
Designing Sensory Environments • See Neurosky • Affective Gaming • "The Sinking City of Atlantis“ • Firm adds smell to video games