1 / 57

Agile Spectrum Imaging

Agile Spectrum Imaging. Ankit Mohan, Jack Tumblin Northwestern University. Ramesh Raskar MERL / MIT. CIE 1931 chromaticity diagram. Fixed color primaries. sRGB color space. G. Fuji Velvia 50 film. Nikon D70 camera. R. B. Outside the color gamut. G. R = ? G = ? B = ?. R. B.

liang
Download Presentation

Agile Spectrum Imaging

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Agile Spectrum Imaging Ankit Mohan, Jack Tumblin Northwestern University Ramesh Raskar MERL / MIT

  2. CIE 1931 chromaticity diagram

  3. Fixed color primaries sRGB color space G Fuji Velvia 50 film Nikon D70 camera R B

  4. Outside the color gamut G R = ? G = ? B = ? R B

  5. Colorimetric or Photometric mapping G R ≈ 0.0 G ≈ 0.2 B ≈ 0.8 R B

  6. 400nm 550nm 700nm Wider color gamut G λ “Best” primaries compromise: Wide Gamut vs. High Power R B

  7. Adaptive Color Primaries

  8. Agile Spectrum • How do we do this? • What new applications can we get?

  9. I x Ix λ 400nm 550nm 700nm Arbitrary white 1D signal C A B

  10. x I I x Pinhole Camera C A’ B B’ A C’ Object Image Pinhole

  11. x I C A’ B B’ C’ A Object Lens L1 Pinhole

  12. x I C A’ B’ B C’ A Object Lens L1 Prism Pinhole

  13. Prism λ A’ λ B’ x λ λ C’ x Spectral Light-Field

  14. Light-Field Placing a 1D screen in a 2D light-field gives a 1D projection in a direction perpendicular to the screen.

  15. x I Prism λ A’ λ B’ λ λ C’ x x I Screen p

  16. x I λ A’ λ B’ λ λ C’ x I p

  17. x I t = ∞ Prism p λ A’ λ B’ λ λ C’ I x t

  18. x C’’ B’’ I A’’ Lens L2 Prism λ A’ λ B’ x λ C’ tS

  19. x C’’ B’’ I A’’ Lens L2 λ A’ λ B’ x λ C’ tS t

  20. x C’’ B’’ I A’’ Lens L2 λ A’ λ B’ x λ C’ tS tR t

  21. C’’ B’’ A’’

  22. I p Sensor plane (t=ts) C’’ B’’ λ x A’’ tS t

  23. Rainbow plane (t=tR) p C’’ All rays of the a given wavelength, from all points in the scene, converge to a unique point in the R-plane. B’’ λ I x A’’ tR t

  24. I x Ix λ 400nm 550nm 700nm Rainbow plane (t=tR) p λ I x

  25. I x Rainbow plane (t=tR) p λ Ix λ I x 400nm 550nm 700nm

  26. Rainbow plane (t=tR) p I x λ IR λ I x 400nm 550nm 700nm IB λ 400nm 550nm 700nm

  27. Rainbow plane (t=tR) C’’ λ position B’’ A’’ tR t

  28. Mask in the Rainbow plane C’’ λ x B’’ X 0 A’’ λ 1 tR t x

  29. Mask in the Rainbow plane C’’ 0 B’’ λ x A’’ tR t

  30. I p Mask in the Rainbow plane C’’ 0 B’’ λ x A’’ tR tS t

  31. I p Mask in the Rainbow plane C’’ 0 B’’ λ x A’’ tR tS t

  32. I p Mask in the Rainbow plane C’’ B’’ λ 0 x A’’ tR tS t

  33. I p Mask in the Rainbow plane C’’ 0 B’’ λ 0 x A’’ tR tS t

  34. Rainbow plane (t=tR) Control the spectral sensitivity of the sensor by placing an appropriate grayscale masks in the R-plane. C’’ B’’ A’’ tR tS t

  35. Pinhole Sensor Lens L2 Lens L1 Scene C’’ A’ C B’ B B’’ C’ A A’’ R-plane mask Prism orDiffraction Grating

  36. Pinhole Lens L1 Sensor Lens L2 Lens L1 Scene R-plane mask Prism orDiffraction Grating

  37. Aperture and Lens L1 Sensor Lens L2 Scene R-plane mask Prism orDiffraction Grating

  38. DiffractionGrating R-plane mask Lens L1 Lens L2 Sensor

  39. Test Setup Spectral rainbow generator Agile Spectrum Camera

  40. m(λ) λ 400nm 550nm 700nm m(λ) λ 400nm 550nm 700nm m(λ) λ 400nm 550nm 700nm Two opaque stripes No Mask One opaque stripe

  41. m(λ) λ 400nm 550nm 700nm

  42. m(λ) λ 400nm 550nm 700nm

  43. DiffractionGrating R-plane mask Lens L1 Lens L2 Screen

  44. Metamers White Illumination Monochromatic Illumination

  45. Traditional three primary projector Agile-spectrumprojector

  46. Traditional three primary projector Py time

  47. Traditional three primary projector Py time

More Related