1 / 25

Wearable Computers and Augmented Reality

Wearable Computers and Augmented Reality. David Mizell Intel Research Seattle Feb. 24, 2003. Outline. Wearable computers Overview Research issues Augmented reality Components Applications Research issues. Wearable Computers. Battery-powered PC on belt Head-mounted display

collin
Download Presentation

Wearable Computers and Augmented Reality

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Wearable Computers and Augmented Reality David Mizell Intel Research Seattle Feb. 24, 2003

  2. Outline • Wearable computers • Overview • Research issues • Augmented reality • Components • Applications • Research issues

  3. Wearable Computers • Battery-powered PC on belt • Head-mounted display • Speech input • Wireless communication

  4. Tool Model Application specific Worn only while doing a certain job Hands-free requirement Clothing Model Worn all day; used all day Wide variety of applications User sometimes unaware of application Application Premises

  5. Tool Model User interface design Speech input Eye tracking Development issue: creating/transforming application data Clothing Model Packaging; incorporating into clothing Battery life AI, agent technology Activity inferencing Image processing Design of keyboard or keyboard substitute Research Emphases

  6. Augmented Reality 6DOF tracker • Wearable computer • See-through head-mounted display • 6DOF head position/orientation tracker Superimposes and stabilizes computer-generated information upon specific coordinates of the real surroundings. image source beam splitter

  7. An example: aircraft wire bundle assembly at Boeing

  8. Formboard storage

  9. Formboard rework

  10. The AR “generic” formboard

  11. experiment in the Boeing Everett factory, summer 1997 • six-week experiment • wire shop & mockup shop workers • AR vs. traditional bundle forming • TriSen optical tracker & see-through HMD • Via II wearable computer (in vest)

  12. Summary of Results It worked. We could assemble bundles on the AR formboard, move them over to the traditional formboard, and they would pass QA inspection.

  13. Results… • Productivity was no higher. Clearly fault of the user interface. • Wide disparity of user acceptance levels. Women hated the HMD. • Intriguing anecdotal evidence of training benefits

  14. AR-for-Maintenance Lab Demo

  15. Applying Augmented Reality to Maintenance • Potential to guide minimally-trained mechanic through a complex maintenance procedure • The ultimate in “just-in-time” training -- occurs during the maintenance procedure, on the real item being maintained • Good fit for the military -- complex equipment, maintainers expensive to train, hard to keep – also for Space Station: on-orbit training for astronauts • Requires portable, easily-deployed & registered tracker system, comfortable see-through head-mounted display

  16. Also notice: • The “minimalist” nature of the annotations.

  17. AR research issues • Tracker design • At 50 Hz., track head xyz position to 1 mm., roll-pitch-yaw orientation to .1 degree • 2+ m. range (near term) • Robust • Portable • Easy to set up/calibrate • cheap

  18. Trackers – what’s available now • Magnetometers – AC and DC • Acoustic-inertial hybrid • Optical-inertial hybrid • Videometric • “ultimate” tracker: track against real environment; no fiducial marking

  19. AR research issues (2) • Authoring system • Use real object and AR • Use CAD model of object and VR • User interface • What to show the user • How user should give input to system • AR display design

  20. AR display design: optical see-through vs. video see-through video camera computer Courtesyof DigiLens, Inc.

  21. Optical Higher-resolution (now) Lightweight Higher frame rate (now) Video Work in image domain Pixel resolution Partial occlusion Eliminate “image rivalry” AR display design: advantages of optical see-through and video see-through

  22. AR research issues (3) • Registration: establish fixed relationship between tracker coordinate system and real-world coordinate system, and between tracker coordinate system, display, and user’s eye • Calibration: use objects in known world coordinates to adjust for systematic tracking or display errors • (these terms often blurred together in AR research, and referred to as “calibration”)

  23. VV = ( TVD TDS TSW ) VW Registration: the basic idea which pixel on display to illuminate point in real world coordinates world coordinates to tracker source coordinates – fixed at setup time detector to virtual screen of display dynamic – this is what tracker gives you Also needed: ev : coordinates of eye in virtual screen coordinates

  24. Summary • Inherently multi-disciplinary research • CS – interface design • Physics – tracker design • Physiology; optics – HMD design • And you get to wear funny hats!

More Related