1 / 49

Procam and Campro

Procam and Campro. Computer Science Columbia University. Shree K. Nayar. Support: NSF, ONR Procams 2006. PROCAMS. Shree K. Nayar ,. Cameras for Projectors (Campro): Display better or new images (Geometry, Shadows, Radiometry, Focus, Multi-Projectors). P. C.

kim-spears
Download Presentation

Procam and Campro

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Procam and Campro Computer Science Columbia University Shree K. Nayar Support: NSF, ONR Procams 2006 PROCAMS Shree K. Nayar,

  2. Cameras for Projectors (Campro): Display better or new images (Geometry, Shadows, Radiometry, Focus, Multi-Projectors) P C Projectors for Cameras (Procam): Capture better or new images (Quality, Matting, Relighting, Refocusing) P C Projectors & Cameras for Apps (ProCamApp): Enhance existing or create new application (Immersion, Augmentation, Navigation, Surgery) P C Convergence of Cameras and Projectors PROCAMS Shree K. Nayar,

  3. Electric Flashbub Vierkotter Gas Flame Ibbetson Flashbulb Chauffour Commercial Flashbub Ostermeier Digital Camera Flash 1893 1840 1925 2006 1930 Flash/No Flash Multi-Flash Flash Matting Brief History of the Flash PROCAMS Shree K. Nayar,

  4. 4D 4D Projector as a Programmable Flash Lighting Capture 2D 2D PROCAMS Shree K. Nayar,

  5. Projector as a Programmable Flash Depth from Projector Defocus Image-Complete Depth Maps (with Li Zhang, Siggraph 2006) Separation of Direct and Global Illumination Scattering Properties of Real Materials (with Krishnan, Grossberg, Raskar, Siggraph 2006) PROCAMS Shree K. Nayar,

  6. Camera Defocus Courtesy of Koesbong @ flickr.com PROCAMS Shree K. Nayar,

  7. Camera Defocus: Captured Depth from Camera Defocus Surface Focal Plane Camera ( Pentland 87, Subbarao 88, Darrell and Wohn 88,Nayar and Nakagawa 89, Ens and Lawrence 91, Bove 93, Nayar et al. 95, Watanabe et al. 98 ) PROCAMS Shree K. Nayar,

  8. Lamp Projector Defocus Focal Plane Projector PROCAMS Shree K. Nayar,

  9. Lamp Projector Defocus Surface Focal Plane Projector PROCAMS Shree K. Nayar,

  10. Projector Defocus: Projected Lamp Projector Defocus Surface Focal Plane Projector PROCAMS Shree K. Nayar,

  11. Projector Defocus: Projected Camera Defocus: Captured Camera Defocus vs. Projector Defocus PROCAMS Shree K. Nayar,

  12. Spectrum Depth Estimation: Temporal Defocus Method Surface Camera Focal Plane Projector Shift Lamp Projector Defocus Model: PROCAMS Shree K. Nayar,

  13. Half-mirror Projector Camera Experimental Setup Half-mirror Camera Projector PROCAMS Shree K. Nayar,

  14. PROCAMS Shree K. Nayar,

  15. Fence and Leaves: Complex Occlusions Depth Map Scene PROCAMS Shree K. Nayar,

  16. Fence and Leaves: Complex Occlusions Depth Map Scene 3D Model PROCAMS Shree K. Nayar,

  17. Refocusing PROCAMS Shree K. Nayar,

  18. Playing Cards: Object Insertion Scene Depth Map PROCAMS Shree K. Nayar,

  19. Playing Cards: Object Insertion Scene Depth Map Green Screen Capture Depth-based Composition PROCAMS Shree K. Nayar,

  20. Projector’s Narrow Depth of Field PROCAMS Shree K. Nayar,

  21. Focused Projection at Multiple Depths Multiple Projectors: (Bimber and Emmerling 2006) PROCAMS Shree K. Nayar,

  22. Focused Projection at Multiple Depths Single Projector: PROCAMS Shree K. Nayar,

  23. Projector Defocus: Three Plane Example 15 inches 15 inches PROCAMS Shree K. Nayar,

  24. Projector Defocus Compensation: Results Front Plane Middle Plane Back Plane Original Image Normal Projection Compensated Projection PROCAMS Shree K. Nayar,

  25. Separation of Direct and Global Illumination Scattering Properties of Real Materials (with Krishnan, Grossberg, Raskar, Siggraph 2006) Projector as a Programmable Flash Depth from Projector Defocus Image-Complete Depth Maps (with Li Zhang, Siggraph 2006)

  26. participating medium B D A C A : Direct B : Interrelection E C : Subsurface translucent surface D : Volumetric E : Diffusion Direct and Global Illumination surface source P camera

  27. Inverse Light Transport (Seitz et. al., ICCV 05) • Dual Photography (Sen et. al., Siggraph 05) T Related Work Fast Separation of Direct and Global Images PROCAMS Shree K. Nayar,

  28. j global BRDF and geometry radiance direct Direct and Global Components: Interreflections surface source i camera PROCAMS Shree K. Nayar,

  29. i + fraction of activated source elements High Frequency Illumination Pattern surface source camera PROCAMS Shree K. Nayar,

  30. i - + High Frequency Illumination Pattern surface source camera fraction of activated source elements PROCAMS Shree K. Nayar, PROCAMS Shree K. Nayar,

  31. Separation from Two Images direct global PROCAMS Shree K. Nayar,

  32. Other Global Effects • Subsurface Scattering • Volumetric Scattering • Diffusion PROCAMS Shree K. Nayar,

  33. Diffuse Interreflections Specular Interreflections Diffusion Volumetric Scattering Subsurface Scattering PROCAMS Shree K. Nayar,

  34. Direct Global Scene PROCAMS Shree K. Nayar,

  35. Real World Examples: Can You Guess the Images? PROCAMS Shree K. Nayar,

  36. Direct Global Eggs: Diffuse Interreflections PROCAMS Shree K. Nayar,

  37. Direct Global Wooden Blocks: Specular Interreflections PROCAMS Shree K. Nayar,

  38. Novel Images PROCAMS Shree K. Nayar,

  39. Source 3 Source 2 Source 1 Global Direct Photometric Stereo using Direct Images Bowl Shape Nayar et al., 1991 PROCAMS Shree K. Nayar,

  40. Direct Global Peppers: Subsurface Scattering PROCAMS Shree K. Nayar,

  41. Novel Images PROCAMS Shree K. Nayar,

  42. Direct Global Hand Skin: Hanrahan and Krueger 93, Uchida 96, Haro 01, Jensen et al. 01, Cula and Dana 02, Igarashi et al. 05, Weyrich et al. 05 PROCAMS Shree K. Nayar,

  43. Separation from a Single Image PROCAMS Shree K. Nayar,

  44. Face Direct Global Sum PROCAMS Shree K. Nayar,

  45. Skin Tone Control Skin Color and Lipids: Tsumura et al. 03 PROCAMS Shree K. Nayar,

  46. Depth from Projector Defocus Direct-Global Separation (Minimum Images: 3) (Minimum Images: 2) Coded Structured Light Shifted Sinusoids Summary PROCAMS Shree K. Nayar,

  47. Open Questions • What is Recoverable with a Projector and a Camera ? • How Many Illumination Patterns? • What are the Illumination Patterns? PROCAMS Shree K. Nayar,

  48. Convergence of Cameras and Projectors Cameras for Projectors Projectors for Cameras Projectors in 2006 Size Power Cost x 1/10 x 1/10 x 1/10 PROCAMS Shree K. Nayar,

More Related