1 / 68

Computational Cameras: Convergence of Optics and Software

Computational Cameras: Convergence of Optics and Software. Shree K. Nayar. Computer Science Columbia University. Support: NSF, ONR, Packard Foundation. detector. lens. image. Traditional Camera. image. detector. detector. lens. new optics. compute. image. Traditional Camera.

boothj
Download Presentation

Computational Cameras: Convergence of Optics and Software

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Computational Cameras:Convergence of Optics and Software Shree K. Nayar Computer Science Columbia University Support: NSF, ONR, Packard Foundation

  2. detector lens image Traditional Camera

  3. image detector detector lens new optics compute image Traditional Camera Computational Camera

  4. Multiple Cameras Catadioptric Imaging Examples: Rees 70, Charles 87, Nayar 88, Yagi 90, Hong 91, Yamazawa 95, Bogner 95, Nalwa 96, Nayar 97, Chahl & Srinivasan 97 Examples: Disney 55, McCutchen 91, Nalwa 96, Swaminathan & Nayar 99, Cutler et al. 02 Wide Angle Imaging

  5. (k > 2) mirrorz(r) Complete Class of Mirrors (k > 0) What’s the Mirror’s Shape ? (with Simon Baker, ICCV 98) camera scene lens z r viewpoint

  6. (courtesy RemoteReality)

  7. Flexible Mirror Sheet Camera System with a Flexible Field of View (with Sujit Kuthirummal, 2007)

  8. System with a Flexible FOV

  9. Flexible Field of View

  10. Off-Line Calibration: Mirror Boundary Descriptor D Mirror Spline Coefficients Boundary Descriptor D T Computing the 3D Mirror Shape

  11. Estimating 3D Mirror Shapes for a Sequence Captured Video Estimated Mirror Shapes

  12. Field of View

  13. High Low Resolution

  14. Mapping to an Equi-Resolution Image Captured Image IC Vertical Stretching Horizontal Stretching Horizontally Stretched Image IH Equi-Resolution Image

  15. Equi-Resolution Image Thin-plate Spline based Image Warp Mapping to a Rectangular Image Rectangular Image

  16. Street Monitoring

  17. Street Monitoring

  18. Panning Up

  19. Birthday

  20. Image Stitching AutoStitch (Brown and Lowe 2003)

  21. Seamless Mosaic

  22. Image Stitching with Parallax

  23. Mosaic

  24. Panography Group at Flickr.com Hockney Style Collage “Place Furstenberg,” by David Hockney, 1985

  25. Helmert Find Layout by Minimizing: image pairs features Scene Collage with Parallax Find SIFT Features in Images (Lowe 2004) Match Features using F Matrix and RANSAC Find Image Layering with Least Fragmentation (with Yoshi Nomura and Li Zhang 07)

  26. Scene Collage

  27. Photo Browsing with Scene Collages PhotoWalker (Tanaka et al. 03) Photo Tourism (Snavely et al. 06)

  28. Nested Scene Collages

  29. CMU Virtualized Reality Array Stanford Camera Array CMU Reconfigurable Array Maryland, Keck Lab Array

  30. Plastic Sheet for 2D Array Plastic Sheet for 1D Array Camera Modules (with Yoshi Nomura and Li Zhang 07)

  31. Dynamic Scene Collage

  32. Dynamic Scene Collage

  33. image image detector detector lens new optics compute image Traditional Camera Computational Camera detector new optics compute controller Programmable Imaging

  34. Camera with a Lens Scene Aperture Lens Image Detector

  35. Volumetric Aperture Lensless Camera with Volumetric Aperture Scene Image Detector (with Assaf Zomet, CVPR 2006)

  36. Pixel Brightness: Scene Transmittance Function Single Aperture Layer Scene Single Layer Aperture Image Detector f

  37. Multiple Aperture Layers Scene Multi-Layered Aperture j=1 j=2 . . Image Detector Pixel Brightness: Scene Transmittance Functions

  38. Initial Implementation: LCD Attenuator LCD Aperture Camera without Lens LCD Controller

  39. What Mappings are Possible? • 1D camera • Not all mappings Mare feasible image scene mapping

More Related