130 likes | 306 Views
Beyond the Surface : Supporting 3D Interactions for Interactive Surface With An Invisible Projection. Yi-Ping Hung Professor, Graduate Institute of Networking and Multimedia National Taiwan University. Motivation. On-Surface Interactions Multi-Touch Tangible Object Detection
E N D
Beyond the Surface : Supporting 3D Interactions for Interactive Surface With An Invisible Projection Yi-Ping Hung Professor, Graduate Institute of Networking and Multimedia National Taiwan University
Motivation • On-Surface Interactions • Multi-Touch • Tangible Object Detection • Beyond-Surface Interactions • Interactive 3D Viewer
IDEA: Using an Invisible Projection Location & Orientation : 6 degrees of freedom Color Projector IR Projector Mirror Mirror IR Cameras x 2
iLamp • Project high-resolution content on the surface, mimicking the use of a desk lamp.
iFlashlight • A mobile version of iLamp, facilitating information explorations and cooperative tasks.
iView • An intuitive tool to see 3D content or augmented information from different perspectives.
Marker Split and Merge • Adapting the maker size • Markers split, when camera at closeup • Markers merge, when at far distance
Marker On/Off • Marker on for camera positioning • Marker off for finger detection • Finger-ROI detection for marker on/off ROI Without Marker Off With Marker Off
Block Diagram Applications IR Camera of Mobile Device Real scene Smoothing IR Cameras KalmanFiltering Color Projector IR Projector Finger Touches Observed Image Foregrounds Layout Manager Simulated Background Tangible Objects ROI Prediction