430 likes | 597 Views
Portland Cyber Theatre. Marek Perkowski. Part 1. Graduate Seminar, Friday, May 7, 2004. Portland Cyber Theatre. Funded by Korea Institute of Science and Technology, Daejeon, Republic of Korea and Intel Corporation, Hillsboro. Contributors.
E N D
Portland Cyber Theatre Marek Perkowski Part 1 Graduate Seminar, Friday, May 7, 2004
Portland Cyber Theatre Funded by Korea Institute of Science and Technology, Daejeon, Republic of Korea and Intel Corporation, Hillsboro Contributors Martin Lukac, Jacob Biamonte, Stefan Gebauer, Robert Klug, Myron Machado, Normen Giesecke, Atsumu Iseno, Tsutomu Sasao, Michele Folgheraiter, Uland Wong, Mikhail Pivtoraiko, Jeff Morris, Chris Motch, Nicola Sian Rees, Ping Hang Cheung, Randall Borck, Ray Schmelzer, Steve Mbah,Yu Xia, Akashdeep Aulakh, Tyler Nguyen, Jeff Allen, Kevin Xue, Kevin Chen, Ben Xue
Or more scientifically A robot with many bodies, many personalities, quantum, fuzzy and logic brains or how to Use of Machine Learning based on Constructive Induction in Dialogs with Robotic Heads
Talking Robots • Many talking toys exist, but they are still very primitive • Actors for robot theatre, agents for advertisement, education and entertainment. • Designing inexpensive natural size humanoid caricature and realistic robot heads Dog.com from Japan We concentrate on Machine Learning techniques used to teach robots behaviors, natural language dialogs and facial gestures. Work in progress
Robot with a Personality? • Future robots will interact closely with non-sophisticated users, children and elderly, so the question arises, how they should look like? • If human face for a robot, then what kind of a face? • Handsome or average, realistic or simplified, normal size or enlarged? • The famous example of a robot head • is Kismet from MIT. • Why is Kismet so successful? • We believe that a robot that will interact with humans should have some kind of “personality” and Kismet so far is the only robot with “personality”.
Robot face should be friendly and funny The Muppets of Jim Henson are hard to match examples of puppet artistry and animation perfection. We are interested in robot’s personality as expressed by its: • behavior, • facial gestures, • emotions, • learned speech patterns.
Behavior, Dialog and Learning • Robot activity as a mapping of the sensed environment and internal states to behaviors and new internal states (emotions, energy levels, etc). • Our goal is to uniformly integrate verbal and non-verbal robot behaviors. • Words communicate only about 35 % of the information transmitted from a sender to a receiver in a human-to-human communication. • The remaining information is included in para-language. • Emotions, thoughts, decision and intentions of a speaker can be recognized earlier than they are verbalized.
Robot Head Construction Furby head with new control Jonas We animate various kinds of humanoid heads with from 4 to 20 DOF, looking for comical and entertaining values.
Robot Head Construction Skeleton Alien We use inexpensive servos from Hitec and Futaba, plastic, playwood and aluminum. The robots are either PC-interfaced, use simple micro-controllers such as Basic Stamp, or are radio controlled from a PC or by the user.
Technical Construction Details Marvin the Crazy Robot Adam
BUG (Big Ugly Robot) Max Image processing and pattern recognition uses software developed at PSU, CMU and Intel (public domain software available on WWW). Software is in Visual C++, Visual Basic, Lisp and Prolog.
Visual Feedback and Learning based on Constructive Induction
Mister Butcher Latex skin from Hollywood 4 degree of freedom neck
Virginia Woolf heads equipped with microphones, USB cameras, sonars and CDS light sensors
Professor Perky Professor Perky with automated speech recognition (ASR) and text-to-speech (TTS) capabilities • We compared several commercial speech systems from Microsoft, Sensory and Fonix. • Based on experiences in highly noisy environments and with a variety of speakers, we selected Fonix for both ASR and TTS for Professor Perky and Maria robots. • We use microphone array from Andrea Electronics. 1 dollar latex skin from China
Maria 20 DOF
location of head servos Construction details of Maria skull • location of controlling rods • location of remote servos Custom designed skin
The newest robot of Jake Biamonte and Jeff Allen has many sensors on the face
The hands do not move. The new, movelable hands are under design by Michele Folgheraiter, our collaborator from Italy.
The new robot is mobile. The new robot is controlled by a micro-controlled and a laptop. It will move randomly and talk about PSU greatness. See demo soon.
I can turn my body left and right towards the speaker or away from him
Figure 4: Latex skin on the robotic head Figure 2: Advanced construction of the robotic head, with servos inside the head, added are eyes and jaws. Also can be seen wires for future movements of cheeks, lips, eyebrows, chins and front. Figure 1: Empty skull of the robot Figure 3: Opened back head of the robot showing implacement of servos controlling the lower jaw, eyes, eye brows, cheeks and the chin.
Hahoe Robots On a grant from Korea Institute of Advanced Studies we are building a theatre of traditional korean masks
The Hahoe Theatre has 12 robots, automatically controlled stage, lights and smoke generators. Help needed to design more heads and program scripts.
The Hahoe robots will sing and dance. A long neck and springs.
Mechanisms of Braitenberg’s Vehicles for Quantum vehicles explained next