1 / 30

Generalized Mosaics

Generalized Mosaics. Yoav Y. Schechner, Shree Nayar Department of Computer Science Columbia University. Processing. Mosaics. Redundant Measurements. Generalized Mosaicing : Yoav Schechner and Shree Nayar. Mantis Shrimp. C. Takata. Scanning with Less Redundancy.

karis
Download Presentation

Generalized Mosaics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Generalized Mosaics Yoav Y. Schechner, Shree Nayar Department of Computer Science Columbia University

  2. Processing Mosaics

  3. Redundant Measurements Generalized Mosaicing: Yoav Schechner and Shree Nayar

  4. Mantis Shrimp C Takata Scanning with Less Redundancy Different rows = Different optical characteristics

  5. Generalized Mosaicing Brightness Dynamic Range Spectrum Field of View Depth of Field Polarization camera Spatially varying filter Schechner, Nayar, Generalized mosaics

  6. 88 - 18,794 Mosaic + High Dynamic Range

  7. Fusion of Measurements Maximum-Likelihood Solution Schechner, Nayar, Generalized mosaics

  8. -2 -6 10 10 -2 1 -4 log M 2 -6 8 bits (almost) -8 x (pixels) 8 bit camera Dynamic range as 16 bits = 1 Log of the mask Generalized Mosaicing: Yoav Schechner and Shree Nayar

  9. M Consistency, Smoothness A average row consistency constraints x Mask Self-Calibration Unknown filter (vignetting) Schechner, Nayar, Generalized mosaics

  10. Image Registration Schechner, Nayar, Generalized mosaics

  11. Image Registration Bias towards “no motion” Schechner, Nayar, Generalized mosaics

  12. Uncertainty Image Registration Schechner, Nayar, Generalized mosaics

  13. motion of 2 pixels 5 pixels 4 pixels 10 pix 9 pix 18 pix 19 pix However, we need: multiscale UNCERTAINTIES Registration: Standard “Coarse to Fine” Schechner, Nayar, Generalized mosaics

  14. estimate -1 2 Maximum-Likelihood Pyramid At each levelL , for each pixel Schechner, Nayar, Generalized mosaics

  15. ML estimation Max-Likelihood Pyramid Gaussian Pyramid

  16. Generalized Mosaic log I log I frame Intensity range Intensity range frame x Spatial range Spatial range Mosaic x Schechner, Nayar, Generalized mosaics

  17. spectral y l x Variable Spectral Filter Generalized Mosaicing: Yoav Schechner and Shree Nayar

  18. MultiSpectral Mosaic 400 400 500 500 600 600 700 700 400 500 600 700 l l l Generalized Mosaicing: Yoav Schechner and Shree Nayar

  19. sunset fluorescent Rendering: Any Illumination Generalized Mosaicing: Yoav Schechner and Shree Nayar

  20. Illumination at a Glance Halogen Fluorescent y y l l x x Extra information • Illuminant spectrum

  21. Spatially Varying Polarizer Polarization Mosaicing: Yoav Schechner and Shree Nayar

  22. polarizance 1 90 o o polarizing angle 60 0.8 o 30 0.6 o 0 0.4 o -30 transmittance 0.2 o -60 o -90 0 Spatially Varying Polarizer Polarization Mosaicing: Yoav Schechner and Shree Nayar

  23. Raw images Polarization Mosaicing: Yoav Schechner and Shree Nayar

  24. reflected structure Schechner Shamir Kiryati JOSA-A 2000 transmitted painting Polarization Mosaic

  25. Insert aprismbehind the lens y = Depth x Spatially Varying Focus Generalized Mosaicing: Yoav Schechner and Shree Nayar

  26. All Focused Mosaic … and a Depth Map Generalized Mosaicing: Yoav Schechner and Shree Nayar

  27. Multi-dimensional Mosaics - Simultaneously What else? Dynamic Range & Spectrum & Polarization etc. Generalized Mosaicing: Yoav Schechner and Shree Nayar

  28. l • Signal undergoing LPF • “Band limited” signal • Minimizing aliasing • Nyquist sampling rate # samples M 11111111 1 1 1/2 2 1/4 3 9 11111111? length L 1 M 10111001?? bandwidth B 1011100??? resolution Dl 101110???? aperture D Sampling Criteria Number of samples per scene point 1011100101 Generalized Mosaicing: Yoav Schechner and Shree Nayar

  29. Mosaic Generalized Mosaic Dynamic range Spatially varying filter I Spectrum l 88 – 18,794 Polarization Depth + Focus Wide field of view

More Related