160 likes | 268 Views
A Unified Multi-Surface, Multi-Resolution Workspace with Camera-Based Scanning and Projector-Based Illumination. Tyler Johnson and Henry Fuchs University of North Carolina – Chapel Hill. IPT/EGVE July 18, 2007 - Weimar, Germany. Multi-Projector Display. Previous Work. Workspace Configuration.
E N D
A Unified Multi-Surface, Multi-Resolution Workspace withCamera-Based Scanning and Projector-Based Illumination Tyler Johnson and Henry Fuchs University of North Carolina – Chapel Hill IPT/EGVE July 18, 2007 - Weimar, Germany
Encoded Structured Light Workspace Walls LCD Panel Calibration • Cameras pre-calibrated • Project structured light to determine • Projector calibration • Workspace geometry • RANSAC-based plane-fitting. [Quirk EDT ’06] • Also, display structure light with LCD • Calibrate as a projector
Projector Viewer Two-Pass Rendering • Determine image warping to remove distortion caused by surface geometry Display Surface
Single vs Multi-Surface Content • Two methods of display • Single vs. multi-surface
Single Surface Content • User selects region where the window should appear • Compute P-Matrix from 3D->2D corner correspondences • Choose arbitrary COP • Two-pass rendering determines what to project
Multi-Surface Content • Same as for single surface, except that COP is user viewpoint • Viewpoint can be obtained from separate tracking system
Projector-Based Illumination • Projection of imagery onto certain objects is often undesirable • Simple interface allows imagery to be replaced with illumination
Camera-Based Scanning • User selects copy area with selection window • Selection window rendered as a single-surface window
Camera-Based Scanning • Remove perspective distortion using two-pass rendering Selection window Selection window P-matrix Camera
Contributions • Two-pass rendering as a unifying framework for digital workspaces • Image generation • Rectified single surface imagery • Perspectively correct multi-surface imagery • Camera-based scanning • Removal of perspective distortion • LCD panel as a projector • Simplifies calibration/rendering
Future Work • Automatic object illumination • Camera-based detection of objects occluding projection • Improved scanning resolution • Trigger optical zoom, multi-camera super-resolution etc. • Continuous calibration • Online calibration monitoring and refinement
Thank You • Funding support: ONR N00014-03-1-0589 • DARWARS Training Superiority program • VIRTE – Virtual Technologies and Environments program