1 / 22

Building the Augmented Classroom

Building the Augmented Classroom. Components for everyday mobile collaborative AR. The Augmented Classroom - Overview. Spontaneous collaboration of mobile users Optical Tracking, use of markers as tangible user interfaces. Standard User Equipment. Mobile AR System

yamin
Download Presentation

Building the Augmented Classroom

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Building theAugmented Classroom Components for everyday mobile collaborative AR

  2. The Augmented Classroom - Overview • Spontaneous collaboration of mobile users • Optical Tracking, use of markers as tangible user interfaces

  3. Standard User Equipment • Mobile AR System • Backpack with CPU& connectors • Optical See-throughHMD • Head mountedcamera

  4. User Equipment Enhancements • Pen is replaced by„Pinch Gloves“ • PIP is mounted to thewrist of the left hand • -> Both Hands are freeto interact with thereal world

  5. User Equipment Details (1/6)Pinch Gloves: Evolution • First Generation:Markers sewed onto glove

  6. User Equipment Details (2/6)Pinch Gloves: Evolution • Second Generation:Rigid structure carrying markers

  7. User Equipment Details (3/6)Pinch Gloves: Evolution • Second Generation:Rigid structure carrying markers Hypothesis: Constant offset in space

  8. User Equipment Details (4/6)Pinch Gloves: Evolution • Third Generation: • Finger-free • Cables covered • Only one button • Lightweight Version • 3 Buttons on thumb • Markers attachedseperately

  9. User Equipment Details (5/6)Modified PIP • Wrist-attached to keep hands free • Due to inacurate optical tracking, aTrack-pad is usedfor 2D input.

  10. User Equipment Details (6/6)Headset • Uses new Firefly FW camera with 4mm lens. • Nearly 90° FOV • Tracking area bigger than HMD FOV

  11. Table for overhead tracking • Lightweight table with camera for overhead tracking

  12. Software Enhancements • Improvements in usability introduced by • One-shot quick calibration for HMD & gloves • Shared tracking using multiple cameras

  13. Software Details (1/9)HMD Calibration • Optical tracking must be calibrated in ARToolkit • Remaining problem: offset between camera coordinate system and eye coordinate system. CCS ECS

  14. Software Details (2/9)HMD Calibration • SoCameraCalibrationKit: Calibration Marker Tracked position in overlay image Calibration reference Align marker with calibrationreference

  15. Software Details (3/9)HMD Calibration • SoCameraCalibrationKit: • Press Button -> Offset is calculated and writtento OT node for camera offset Marker and tracked position arenow aligned correctly.

  16. Software Details (4/9)Glove Calibration • A Similar tool is provided to calibrate the „Pinch Point“ of the gloves • The offset varies for every user, and can be configured with a single click

  17. Software Details (5/9)Shared Tracking • Optical tracking fails: • Marker (partially) out of FOV of camera • Marker occluded • Marker oriented away from camera • Marker not recognized

  18. Software Details (6/9)Shared Tracking • Solution / Improvement: • Use several cameras, sharing their tracking data over the network • Dynamically determine reference markers (seen by 2 or more cameras) • Calculate position ofhidden marker fromreference + remotecoordinates

  19. Software Details (7/9)Shared Tracking • Opentracker implementation (1/2):

  20. Software Details (8/9)Shared Tracking • Opentracker implementation (2/2):

  21. Software Details (9/9)Shared Tracking • Results:

  22. Thank you!

More Related