Virtual Environments – Including Virtual Reality

1. Virtual Environments – Including Virtual Reality

2. Virtual Environments • Virtual reality • Augmented reality • Situational awareness

5. Virtual Reality • Examples • Architecture – actually walk into building and look around (instead of more traditional direct manipulation looking at it from various directions and perspectives) • Possible - medicine • On the boundary – real flight simulator

6. Example:Firefighter Training • This system will simulate the progress of a fire in a single family dwelling • will respond to actions made by the user to rescue occupants and put the fire out. • The user of the VE will be a Fire Company Officer being trained or evaluated for his/her skills at commanding a fire crew. • In the VE, the user will speak commands that are translated by an operator into a predetermined animation sequence in the virtual environment. • As the fire company officer issues commands, the virtual fire crew will go through animations reflecting these commands, • fire burns in response to virtual crew actions.

7. Example:Meditation Chamber • The goal of this research is design and build an immersive virtual environment that uses visual, audio, and tactile cues to create, guide, and maintain a patient's guided relaxation and meditation experience.  • The use of meditation and guided imagery is well established as helpful in the treatment and prevention of a number of diseases • The possibility of increasing the effectiveness and repeatability of this type of therapy • This project is aimed at creating a working prototype of this system

8. Example:Virtual Geographic Information System • VGIS (Virtual Geographic Information System) is a large, multifaceted project to allow navigation of and interaction with very large and high resolution, dynamically changing databases while retaining real-time display and interaction. • The system allows users to navigate accurate geographies with sustained frame rates of 15-20 frames per second. • The user can not only see these terrains from any viewing angle but also buildings, roads, high resolution imagery draped on the terrain, and other features

9. Example:Virtual Reality Phobia Therapy • Virtual Reality Exposure involves exposing the patient to a virtual environment containing the feared stimulus in place of taking the patient into a real environment or having the patient imagine the stimulus, which is what traditional exposure therapy usually involves.

10. Example:Helping Burn Patients Cope with Pain • using immersive VR for pain control (in addition to pain medicine). • Their first virtual world used was SpiderWorld. Spiderworld was originally designed to treat spider phobics, but has also proved quite distracting for burn patients. • now developing several new virtual environments specifically designed for treating pain (e.g., especially attention-grabbing virtual environments). • SnowWorld has been developed with support from the Paul Allen Foundation for Medical Research. • Patients fly through an icy canyon with a river and frigid waterfall. Patients shoot snowballs at snowmen and igloos (with animated impacts). • Since patients often report re-living their original burn experience during wound care, SnowWorld was designed to help put out the fire.

11. Example:Virtual Gorilla Exhibit • being developed to explore techniques for using Virtual Reality to present information to users experientially that would otherwise be difficult for them to learn. • Based upon actual data from the Zoo Atlanta gorilla exhibit, • modeling an environment where the user can explore areas that are normally off limits to the casual visitor.

20. Virtual Reality Headgear

21. (1999)

22. Alternative to Headgear

23. Exploring using the CAVE

26. Virtual Environments • Successful virtual environments depend on the smooth integration of: • Visual Display • Head position sensing • Hand-position sensing • Force feedback • Sound input and output • Other sensations • Cooperative and competitive virtual reality

27. U Washington Virtual Reality Projects 31. Engineering Study of an Endoscope Design31. Virtual Mirrors31. Starship31. Human-Computer Symbiote31. Virtual Chess36. 4d mouse36. collaborative mixed reality36. VR Interaction Techniques39. Collaboration through Wearables39. Phobia Desensitization41. VRD 41. architecture and virtual reality 41. Multimodal Interfaces41. situation awareness41. Medical Robotic Interfaces46. VRD Emulator46. laparoscopic surgical simulator48. Flicker Sensitivity48. knowledge base project 48. /48. self-motion perception52. Design for a Low Vision Aid52. PRISM54. LIMIT54. Interface Sickness54. design for a low vision aid using a scanned laser display57. visual-inertial nulling: cross-over asymmetry57. design for a low vision aid57. Measures for Presence60. functional effects of refractive surgery on driving performance 1. Virtual Retinal Display (VRD)2. Shared Space3. Learning in Virtual Environments4. PAIN MAN5. Virtual Motion Controller6. Interactive VRD7. Virtual Pilot8. Greenspace9. Virtual Chess10. Starship11. New Media11. Expert Surgical Assistant13. Tactile Augmentation13. Geoscientific Visualization13. Motion Sickness16. FLIGHT17. Blocksmith18. SS Working Group19. Parkinson's Project20. SS Working Group21. Driving Simulator22. Two-Handed User Interface22. Motion Sickness24. Wearable Interfaces25. Virtual Classroom26. Situation Awareness27. CEDeS Lab27. Endoscopic Surgery Simulator27. Virtual Playground27. Virtual Reality Toolkit

28. Progress on Visual Display • The Virtual Retinal Display (VRD) team has been focused on developing improvements to the current prototype systems and on creating the parts needed for future prototypes. The VRD, based on the concept of scanning an image directly on the retina of the viewer's eye, was invented at the HIT Lab in 1991. The development program began in November 1993 with thegoal of producing a full color, wide field-of-view, high resolution, high brightness, low cost virtual display. • http://www.hitl.washington.edu/research/vrd/project.html

29. Progress on Movement Sensing • For some applications, a hands-free, body-operated walking interface is ideal; • the UW HIT Lab has been developing prototypes of "sufficient-motion" interfaces, which allow the user to interact by using a subset of the real-world kinesthetic inputs. • Though the ranges of motion are less than full, these inputs are sufficient to convince the user that he or she is moving in the virtual world. • Development of these interface devices is called the Virtual Motion Controller (VMC) Project.

30. Virtual Motion Controller • The HIT Lab's VMC working prototype measures body position over the working surface with an arrangement of four weight sensors • The curved working surface provides important feedback to the user about his or her physical location, and therefore body locomotion input to the device.

31. Progress on Cooperative Augmented Reality • The Shared Space interface demonstrates how augmented reality, the overlaying of virtual objects on the real world, can radically enhance face-to-face and remote collaboration. • For remote collaboration, system allows life-sized live virtual video images of remote user to be overlaid on the local real environment, supporting spatial cues and removing the need to be physically present at a desktop machine to conference. • computer vision techniques are used to precisely register virtual images with physical objects, extending the currently popular "Tangible Interface" metaphor. • work in the context of a collaborative card-game application that allows face-to-face and remote users to collaboratively interact with each other and virtual animations. • http://www.hitl.washington.edu/research/shared_space/

32. Science Fiction? • Most of this stuff won’t be in an office near you next year … • But the future comes quickly in computer science !

33. End Virtual Environments