1 / 46

Image Destabilization: Programmable Defocus using Lens and Sensor Motion

Image Destabilization: Programmable Defocus using Lens and Sensor Motion. Ankit Mohan, Douglas Lanman, Shinsaku Hiura, Ramesh Raskar MIT Media Lab. MIT Media Lab Camera Culture. Defocus Blur. Lots of glass; Heavy; Bulky; Expensive. Image Destabilization. Camera. Lens. Sensor.

socorro
Download Presentation

Image Destabilization: Programmable Defocus using Lens and Sensor Motion

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Image Destabilization:Programmable Defocus using Lens and Sensor Motion Ankit Mohan, Douglas Lanman,Shinsaku Hiura, Ramesh RaskarMIT Media Lab MIT Media Lab Camera Culture

  2. Defocus Blur Lots of glass; Heavy; Bulky; Expensive

  3. Image Destabilization Camera Lens Sensor Static Scene

  4. Image Destabilization Camera Static Scene Sensor Motion Lens Motion

  5. Related Work f8 f/4 f/2 extrapolatedaperture f/1 [Hasinoff and Kutulakos 2007] [Bae and Durand 2007] [Vaish et al. 2004] [Hiura et al. 2009]

  6. Laminography Motion direction X-Ray Source Plane of focus X-Ray Sensor Motion direction Related technique: Time Delay and Integration (TDI)

  7. Lens based Focusing Lens Sensor B’ A A’ B

  8. Lens based Focusing Lens Sensor B’ A A’ B

  9. Smaller aperture  Smaller defocus blur Lens Sensor B’ A A’ B

  10. Pinhole: All In-Focus Pinhole Sensor B’ A A’ B

  11. Shifting Pinhole Pinhole Sensor vp A B’ B A’

  12. Shifting Pinhole Pinhole Sensor vp A B’ B A’

  13. Shifting Pinhole Pinhole Sensor vp B’ A A’ B

  14. Shifting Pinhole Pinhole Sensor vp B’ A A’ B

  15. Shifting Pinhole Pinhole Sensor vp B’ A tp A’ B da ds db

  16. Shifting Pinhole and Sensor Pinhole Sensor vp vs A B’ B A’ da ds db Focus Here

  17. Shifting Pinhole and Sensor Pinhole Sensor vp vs B’ A A’ B da ds db Focus Here

  18. Shifting Pinhole and Sensor Pinhole Sensor B’ vp vs A A’ B da ds db Focus Here

  19. Shifting Pinhole and Sensor Pinhole Sensor B’ vp vs A A’ B da ds db Focus Here

  20. A Lens in Time! Lens Equation: Virtual Focal Length: Virtual F-Number: Analogous to shift and sum basedLight field re-focusing.

  21. Our Prototype

  22. Adjusting the Focus Plane all-in-focus pinhole image

  23. Adjusting the Focus Plane focused in the front using destabilization (10 second exposure)

  24. Adjusting the Focus Plane focused in the middle using destabilization (5 second exposure)

  25. Adjusting the Focus Plane focused in the back using destabilization (10 second exposure)

  26. Adjusting the Virtual Aperture focused in the middle using destabilization (5mm pinhole translation)

  27. Adjusting the Virtual Aperture focused in the middle using destabilization (30mm pinhole translation)

  28. real focus virtual focus Shifting Lens and Sensor Defocus Defocus Exaggeration • Physical vs. synthetic focus • Similar physical and synthetic focus aperture sensor

  29. Defocus Exaggeration static lens with an f/2.8 aperture

  30. Defocus Exaggeration destabilization simulates a reduced f-number

  31. real focus Defocus Invariance • Differing physical and synthetic focus virtual focus aperture sensor

  32. [Nagahara et al. 2008] = * overall PSF virtual PSF real PSF = * overall PSF virtual PSF real PSF Defocus Invariance • Related work • [Nagahara et al. 2008] • [Cathey and Dowski 1995] • [Levin et al. 2008] • PSF not depth invariant • only size is depth invariant • Gaussian special case • depth invariant PSF • inversion is ill-conditioned

  33. Defocus Invariance depth-invariant blur size (horizontal slit + destabilization)

  34. Defocus Invariance Richardson-Lucy deconvolution result

  35. Tilted Sensor dC C D′ D C′ dD d′D d′C Scheimpflug intersection aperture plane sensor plane focus plane

  36. Tilted Sensor vp dC C vs? D dD aperture plane sensor plane focus plane

  37. Tilted Sensor vp vs dC C a a D dD d′C d′D D′ C′ aperture plane sensor plane focus plane

  38. Tuning the PSF real focus aperture sensor pinhole image (static f/22 aperture)

  39. Tuning the PSF real focus aperture sensor large aperture image (static f/2.8 aperture)

  40. Tuning the PSF virtual focus aperture sensor destabilized image using a pinhole (translated f/22 aperture)

  41. Tuning the PSF real focus virtual focus aperture sensor destabilized image using a large aperture (translated f/2.8 aperture)

  42. Tuning the PSF real focus virtual focus aperture sensor simulated aspheric lens using a vertical slit aperture and destabilization

  43. linear circular elliptical “figure 8” hypocycloidal trispiral Extension to 2D Displacements

  44. Large apertures with tiny lenses? Limitations • Coordinated mechanical movement required • Diffraction (due to small aperture) cannot be eliminated [Zhang and Levoy, tomorrow] [Our group: augmented LF for wave analysis] • Scene motion during exposure Benefits • No time or light inefficiency wrt cheap cameras • Exploits unused area around the lens • Compact design • With near-pinhole apertures (mobile phones) many possibilities

  45. Acknowledgements Gabriel Taubin Brown University Jaewon Kim MIT Media Lab Grace Woo MIT CSAIL Quinn Smithwick MIT Media Lab MIT Media Lab: Camera Culture

  46. SLRs with tiny lenses? Analysis of space of relative lens/sensor displacement Destabilization as virtual focusing mechanism Shallower depth of field than physical aperture Depth-independent defocus blur size

More Related