1 / 27

Mobile Augmented Reality

Mobile Augmented Reality. Dieter Schmalstieg Graz University of Technology, Austria. Mobile Augmented Reality Lecture Overview. Motivation Hardware requirements Tracking Environmental modeling. Mobile AR – Motivation. Mobile, wearable computing opens up new possibilities

gannon-winters
Download Presentation

Mobile Augmented Reality

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Mobile Augmented Reality Dieter Schmalstieg Graz University of Technology, Austria

  2. Mobile Augmented RealityLecture Overview • Motivation • Hardware requirements • Tracking • Environmental modeling

  3. Mobile AR – Motivation • Mobile, wearable computing opens up new possibilities • location-aware/situated computing • Now, the interface is everywhere • AR is a powerful UI for this type of computing

  4. Mobile AR – Motivation • Mobile AR Applications: • Navigational aids • Communication aids • Personal situated information DB • General UI for appliances • Tourism • Journalism • Maintenance and construction • Military training and warfighting

  5. Desktop 3D, Desktop VR, Fishtank VR 3D Projection-based VR Head-mounted VR Mobile AR Mobile, Wearable, Handheld Situated Multi-Device, Pervasive Tangible, Embodied Mobile AR – Background • Post-WIMP interfaces: Multimodal Speech, Gestures, Audio, Haptic Ubiquitous Computing

  6. Computer Form Factor Room Wall Desk Box Laptop Palmtop Clothing Mobile AR – BackgroundSteps Toward Wearable Computing User Relationship Submit Share Sit at . . . and carry before/after Hold Wear

  7. Implications of Wearability(after S. Mann, B. Rhodes, T. Starner) • Mobility • usable/used indoors and outdoors • Intimacy • sense the wearer’s body, communicate privately • Context sensitivity • take into account changing environment • Constancy • Permeation of UI into wearer’s life

  8. Mobile AR – BackgroundSituated Computing • Ubiquitous computing (Weiser ’89) • PARCTab (1993) • Hull et al. (’97) state that • “situated computing concerns the ability of computing devices to detect, interpret, and respond to aspects of the user’s local environment”

  9. Mobile AR – BackgroundWorldBoard 1990s: many researchers started to co-locate information with physical space J. Spohrer 1996: What comes after the World Wide Web? Information in place. The world as a repository of information. (Imagined as a service Apple Computer, Inc. would provide.)

  10. What is Mobile AR?Ways of augmenting a mobile user’s environment • wearable display, no tracking whatsoever • body-stabilized wearable display (orientation tracking only) • location-dependent audio augmentation (with or without spatialized audio) • location-dependent screen-stabilized augmentation (possibly monocular) • location-dependent body-stabilized augmentation(on a projection cylinder/sphere surrounding the user) • stereo head-tracked, position tracked, AR with full overlay registration

  11. Ideal Mobile AR Device • + A pair of stylish sunglasses • + Hi-res stereo 3D graphics • + Built-in computer with wireless network • + Highly accurate 6DOF tracking • + All for $99.90 • - Doesn‘t exist (yet?)

  12. Challenges of Mobile AR • Challenges of mobile computing • Limited resources • Size, weight • Battery live • Ruggedness • Challenges of mobile AR • Tracking, 3D graphics, real-time performance • Challenges of outdoor environment • Lighting conditions • no instrumented environment possible

  13. Components of Mobile AR • Overview: • Computing platforms • Displays • Tracking

  14. Computing platforms • Mobile computer • form factors • Notebook • Tablet PC • Wearable PC • PDA • Smartphone

  15. AR Backpack Examples 1997 Rockwell vest (1999) AT&T Sentient AR (2001) Columbia Touring Machine (2002 )

  16. Minolta Forgettable Display Display platforms • Head-mounted display • Monocular, monoscopic, stereoscopic • Optical/video see-thru, see-around • Handheld display (PDA etc.) • Audio display MicroVision Nomad retinal scanning display Sony Glasstron Stereo optical see-thru MicroOptical EG 7

  17. Tracking • Requirements • Provide position and orientation (separately?) • Untethered, large working volume • Indoor vs outdoor • Indoor: Can instrument environment • Outdoor: Self-contained or satellite based

  18. Indoor Tracking • Ultrasonic beacon array • AT&T Bat, Intersense IS900 • Infrared LED array • UNC HiBall, MIT‘s locust swarm • Outside-in computer vision • Observer cameras + passive IR targets(e.g., ARTTrack - medium range) • Inside-out computer vision • Fiducials (e.g. ARToolKit at Uni.SA) • Instrument environment with fiducials • Dead-reckoning techniques

  19. Outdoor tracking • GPS, enhanced GPS • differential GPS • RTK • Pseudolites • Dead-reckoning • Inside-out computer vision • Natural features, e.g. USC, TU-Graz • Still challenges in performance + robustness • Orientation • Gyroscopes, magnetometers, inclinometers

  20. Some Pioneers of Outdoor AR • Columbia University: MARS ‘97 • Uni.SA: Tinmith Naval Research Lab: BARS

  21. Memory prod Case Study:AT&T Cambridge’s Sentient AR Receivers Sentient Computing Server Maintainence Receiver chain Inertial tracker VGA qinertial = [(qx, qy, qz), qw] Serial port Everywhere GUI

  22. Case Study:Studierstube Mobile AR System Indoor + outdoor Inertial sensor camera HMD tracked touchpad DGPS Wide Area Tracking - DGPS (outdoors) - ARToolKit (indoors) notebook WLAN GPRS modem

  23. Navigation & Browsing outdoors indoors

  24. Ergonomic Considerations How to make wearable AR ergonomically andsocially acceptable?

  25. Surprising Answer • We can start today! • „Handheld Augmented Reality“ • Platform: PocketPC • Fully self contained visiontracking + 3D graphics

  26. Environmental Modeling Unless we are attaching information to markers in the scene only, the computer needs a model of the environment • For annotating detailed infrastructure: needgeometrical model • Access to DB of environmental information

  27. Environmental Modeling • Model urban infrastructure from 2D topographic maps and aerial photographs • Modeling from laser range finder data • Modeling from a combination of a set of photographs and geometrical constraints (Berkeley Façade, Canoma)

More Related