280 likes | 928 Views
Lensless Imaging with A Controllable Aperture. Assaf Zomet and Shree K. Nayar Columbia University. IEEE CVPR Conference June 2006, New York, USA. Plane in focus. Aperture. Image Detector. Cameras Today. Lens. Our Lensless Camera. Volumetric . Attenuating Aperture. Image Detector.
E N D
Lensless Imaging with A Controllable Aperture Assaf Zomet and Shree K. Nayar Columbia University IEEE CVPR Conference June 2006, New York, USA
Plane in focus Aperture Image Detector Cameras Today Lens
Our Lensless Camera Volumetric Attenuating Aperture Image Detector
Layered Aperture Multilayer Aperture Image Detector Attenuating apertures: Farid&Simoncelli ‘97, Nayar&Branzoi ‘03
Implementation Camera body Aperture: LCD LCD Control
Attenuating Layer Pinhole Image Detector Controllable Pinhole Attenuating Layer Pinhole Image Detector
Sharpness and brightness increase with FOV (image center). Limitations of Lensless Imaging Optimal pinhole (Raleigh): Brightness: f-number
Sharpness and brightness increase with FOV (image center). f and detector larger by factor k: Resolution/brightness by . Limitations of Lensless Imaging Optimal pinhole (Raleigh): Brightness: f-number
Collecting More Light: Coded Apertures Zand, 1992
Conventional View Desired View
Fov 2 Fov 1 Fov 3 Split Field of View: Implementation Attenuating Layers (2nd layer physical) Pinhole Image Detector
Split Field of View: Results Lens camera Our camera
Wasted pixels Finding Faces
Pinhole Attenuating Layers (2nd layer physical) Split Image: Computational Camera Correlation pattern Image Detector
Lens camera Normalized correlation: Image Pattern Computations in the Optics Our camera Correlation Pattern Noncoherent optical processing (Rogers 1977)
A Camera as a Mapping Camera Optics
Varying Zoom Conventional view L H L L H Desired view L
Varying Zoom Mapping Scene Desired view MX and MXare impossible to implement with 3 layers
Fov 2 Varying Zoom: Imaging (simulation) Captured Fov 1 Fov 3 Desired Attenuating Layers Pinhole Pinhole Pinhole Image Detector
Varying Zoom: Reconstruction Icapturted Icomputed
Summary Controllable Pinhole Split Field of View Computational Camera Spatially Varying Zoom Programmable cameras, Nayar, Branzoi & Boult 2004