80 likes | 167 Views
Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems. Problem: Building mobile AR apps that work in realistic environments is too hard One key problem: spatial and temporal errors Project: Develop techniques/toolkits for building AR interfaces that adapt to changing errors
E N D
Adapting to Dynamic Spatio-Temporal Errors in Mobile AR Systems • Problem: Building mobile AR apps that work in realistic environments is too hard • One key problem: spatial and temporal errors • Project: Develop techniques/toolkits for building AR interfaces that adapt to changing errors • Enable more complex/realistic AR applications to be built
Scientific Issues • Quantify error in a way that is useful to toolkit and application programmers • Develop techniques to adapt interfaces based on these errors • Define a useful programming model for AR interfaces • Framework + components
Challenges • Understanding error of • various tracking technologies • a complete AR system (e.g., latency, calibration) • Developing a robust AR system • Calibration, performance • Developing realistic test applications
Technical Approach • Interative Design • Standard HCI Methodology • Repeat: {Design, Prototype, Generalize} • Simultaneous activities • Model error, augmentation characteristics • Design, build toolkit APIs • Develop prototype applications, infrastructure • Test and extend toolkits
Accomplishments:Presenting Error To Programmers • Compute registration error (pixels) for 3D locations • Provide appcontinuousvalue of reg. error Pose Error of Viewer’s Head Distance to point
AccomplishmentsAPI for Dealing with Changing Error • Low-level API: Level-of-Error (LOE) • Analogous to LOD • Change augmentation based on registration error Low Reg. Error (accurate outline) Larger Reg. Error (coarse outline) Large Reg. Error (refer to object, no outline)
AccomplishmentsIntegrating Video Actors in 3D AR • Tool to support complex content for AR • Integrate actions of video narrator (ie. tutor, guide) with real and virtual 3D objects Video editor for specifying actions Synchronize videopitcher’s throw withvirtual ball Synchronize videopoet’s words withcreation of fallingvirtual words
FY01 Goals • Develop a prototype of a complete toolkit • All components in place, most simplified • Develop better error models • Trackers (incl. vision-based), application data • Continue application development