130 likes | 307 Views
Virtual Characters. Overview. What is a digital character? Why do would we want digital characters? Scope of the problem What we want to tackle How we want to tackle it. What is a Virtual Character?. Virtual character - a character who represents an executing system
E N D
Overview • What is a digital character? • Why do would we want digital characters? • Scope of the problem • What we want to tackle • How we want to tackle it
What is a Virtual Character? • Virtual character - a character who represents an executing system • In TRON (1982), humans and humans that represents software interacted within a world that represented the hardware.
What is a Virtual Character • We look to to have humans and human the represent software interact in the real world. http://movies.yahoo.com/shop?d=hv&id=1807432839&cf=trailer
Digital Characters • A new medium to interact with system information • Spectrum from the paper clip -> AIBO • Examples: • Agents (AI, NLP) • Robots (Robotics)
Life-Sized Virtual Characters • Virtual Characters as a way to interact with information • If virtual characters are presented with an adequate level of realism, would people respond to them as they would to other people? • Effective Interaction • Natural (> than keyboard and mouse) • 3D, Dynamic (augmentable) • Effective Collaboration • Non-verbal communication (60%) • High impact?
Comparing Human-Human Interaction Modalities N- None, L – Low, M – Medium, H – High
Digital Characters • Advantages: • Input: Non-Verbal, privacy • Output: Non-Verbal, dynamic • Efficacy: Impact, interaction • Logistics: Bandwidth, Cost • Disadvantages: • Input: Non-verbal fidelity • Output: Non-verbal fidelity • Efficacy: Interaction fidelity
Thinking Virtual Character Responding Perceiving Interaction • Each participant in a communication has three stages: perception, cognition, and response • Investigate: Display, perception, efficacy Thinking Responding Perceiving Interaction Perceiving Responding Thinking Participant
What we plan on studying • There are many components in digital characters • We will focus only on interaction • Input (perception) • How can we have the system capture non-verbal information? (emotion, gestures, eye-gaze, etc.) • Proposed solution: Initially straps -> advanced computer vision techniques • Output (response) • How do we display the digital character? • Proposed solution: Evaluate different display technologies • Eventually we will look at efficacy (future research)
How we plan on studying it • Perception: • STRAPS: Track head, arms, upper body, and objects (telephone). • Develop techniques to transmit eye-gaze and expressions • User Studies: Evaluate effectiveness of each component • Response: • Evaluate the display modality. User Studies: • Immersive vs Non-Immersive • Life-sized vs. Non-life sized • 2D vs 3D • Goal: TV + webcams + laptop
Projects underway • Interpersonal communication • Distributed acting rehearsal (DAS student) • Teaching • Deaf students • Future work: Universal Access • Disabled • Minorities • Rural communities
Recruiting • Work with • Cognitive Psychologists • Computer Scientists • Computational Geometry • Aesthetic computing • Simulation/modeling • Digital Arts and Science • Looking for • MS and PhD students • Equipment • Wide area 12’x12’ tracker • V8 HMD • 42” plasma TV • Cyberware Scanner • 6 data projectors (stereo) • Firewire cameras • High-end PCs, video