270 likes | 559 Views
The Next Generation of Robots?. Rodney Brooks. Social Level. robot responds to human. human responds to robot. Levels of Control. Behavior Level. perceptual feedback. current goal. Skills Level. coordination between motor modalities. current primitive(s). Primitives Level.
E N D
The Next Generation of Robots? Rodney Brooks
Social Level robot responds to human human responds to robot Levels of Control Behavior Level perceptual feedback current goal Skills Level coordination between motor modalities current primitive(s) Primitives Level
Eye tilt Right eye pan Left eye pan Camera with wide field of view Neck tilt Camera with narrow field of view Neck pan Axis of rotation Neck lean Human <—> Robot Cameras Gaze direction Microphones Facial features Head orientation Speech synthesizer
Competencies • Direct Visual Attention • Recognize Socially Communicated Reinforcement • Communicate Internal State to Human • Regulation of Social Interaction
Cameras Eye, neck, jaw motors Ear, eyebrow, eyelid, lip motors QNX L Motor ctrl Attn system Eye finder dual-port RAM CORBA Face Control Percept & Motor Tracker Dist. to target Motion filter Drives & Behavior Emotive Response NT speech synthesis affect recognition Skin filter Color filter audio speech comms Speakers Linux Speech recognition CORBA CORBA Microphone No One in Charge • 4 Motorola 68332 micro-controllers • L, multi-threaded lisp • higher-level perception, motivation, behavior, motor skill integration & face control • 11 400-500 MHz PCs • QNX (vision) • Linux (speech recognition) • NT (speech synthesis & vocal affect recognition
Visual Attention Frame Grabber color skin tone motion habituation w w w w attention inhibit reset Top down, task-driven influences Eye Motor Control
Person backs off Person draws closer Beyond sensor range Too far – calling behavior Too close – withdrawal response Comfortable interaction distance Comfortable interaction speed Too fast – irritation response Too fast, Too close – threat response Social Constraints
That’s a good bo-o-y! No no baby. o pitch, f (kHz) pitch, f (kHz) o time (ms) time (ms) approval prohibition Can you get it? Can you get it? MMMM Oh, honey. pitch, f (kHz) pitch, f (kHz) o o time (ms) time (ms) attention comfort Evidence for 4 contours in Kismet-directed speech Cross Cultural Affect
soothing Soothing vs Low-Intensity Neutral Soothing & Low-Intensity neutral vs Everything Else approval vs attention approval Approval & Attention vs Prohibition vs High Intensity Neutral attention prohibition neutral Affect Recognizer neutral prohibition attention & approval energy variance soothing & low-energy neutral pitch mean
Naive Subjects • 5 female subjects • 4 naive subjects • 1 caregiver • Four contours and neutral speech • praise, prohibition, attention, soothing • Multiple languages • French, German, Indonesian, English, Russian • Driven by Human
arousal surprise afraid elated angry stress excitement happy frustrated displeasure pleasure neutral sad content depression calm fatigued relaxed bored sleepy sleep Facial Expressions
Facial Postures in Affect Space Open stance Low arousal fear accepting Negative valence tired unhappy content surprise Positive valence disgust stern High arousal anger Closed stance
Turn-Taking / Proto-Dialog • Naïve subjects • Told to “talk to the robot” • Engage in turn taking • No understanding (on either side) of content