210 likes | 370 Views
Shadow Multiplexing for Real-Time Silhouette Extraction. Expertisecentrum for Digital Media / Hasselt University { firstname.lastname }@ uhasselt.be. Introduction. Interaction between real and virtual objects 3D modeling Collision detection. Previous Work.
E N D
Shadow Multiplexing for Real-Time Silhouette Extraction Expertisecentrum for Digital Media / Hasselt University {firstname.lastname}@uhasselt.be
Introduction Interaction between real and virtual objects • 3D modeling • Collision detection
Previous Work [1] Hasenfratz et al. ESVR 2004 [2] Cuypers et al. GRAPP 2008 [3] Decker et al. GRAPP 2007 Silhouette based methods Creating Visual Hull Image Based Interaction
Previous Work [1] Hasenfratz et al. ESVR 2004 [2] Smith and Blinn. Siggraph 1996 Disadvantages: • Expensive Multi- camera setups • Large amount of data • Background subtraction
Previous Work [1] Savarese et al. ICCV 2001 [2] Yamazaki et al. ICCV 2007 [3] Lanman et al. Siggraph Asia 2008 Shadow Based Techniques: Shadow Carving Coplanar Shadowgrams Shield Fields
Our Approach • Single Camera • Power LEDs • Diffuser
Our Approach Advantages: Inexpensive setup Simple robust silhouette extraction No camera synchronization Limited amount of data to be captured and processed Full camera resolution available
Types of Multiplexing Time Multiplexing Space Multiplexing Color Multiplexing Intensity Multiplexing
Intensity Multiplexing X Render Equation
Optimal Light Source Configuration • Intensities • Positioning (light fall-off) • Far away from surface • Similar frequency close to each other
Hardware • Power LEDs ~ 2 meters • Calibration • Radiometric • Geometric [1] Yamazaki et al. ICCV 2007
Problems • Soft borders • Motion -> lower shuttertime (pulse) • Diffuser -> morphological operations • Camera noise • Object Materials
Results GPU implementation Nvidia GForce 8800 GTX Input 640 x 480 40 fps
Results Diffuse
Results Specular
Results Translucent
Results Low albedo
Applications Visual Hull Reconstruction Image-Based Collision Detection
Conclusions Efficient multiple silhouette extraction Single camera/single shot Full-resolution silhouettes No synchronization Less data acquisition / processing
Future Work Automatic LED calibration Multispectral cameras