1 / 36

3D Photography: Beyond Perspective

3D Photography: Beyond Perspective. Steve Seitz Dept. Computer Science & Eng. University of Washington. Perspective Projection. Humans evolved with perspective eyes Capture light along rays that converge at a single point. Cameras also evolved with perspective optics.

zalman
Download Presentation

3D Photography: Beyond Perspective

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 3D Photography:Beyond Perspective Steve Seitz Dept. Computer Science & Eng. University of Washington

  2. Perspective Projection • Humans evolved with perspective eyes • Capture light along rays that converge at a single point

  3. Cameras also evolved with perspective optics • Optimized for humans, not computers!

  4. A non-perspective image

  5. The Blue Marble, NASA satellite image composite

  6. The Blue Marble, NASA satellite image composite

  7. The Blue Marble, NASA satellite image composite

  8. Cyberware Scanner

  9. Print Gallery, by M.C. Escher, 1956

  10. Panorama from Disney’s 1940 film Pinocchio(from Wood et al., SIGGRAPH 1997)

  11. general image What’s an Image? • An image is any 2D subset of rays in space • Actually, the light energy flowing along these rays • Any 2D “slice” of the plenoptic function perspective image

  12. Non-perspective Imaging • Issues: • What other types of images are possible? • Which images are useful? • How can we capture these images?

  13. Path Images

  14. Path Images

  15. Path Images y x t

  16. Path Images y x t

  17. Path Images • Pushbroom images • satellite • Bolles et al. [87] • EPI • Tsuji et al. [92] • omni-directional image • Peleg et al. [97] • manifold mosaic • Radamacher & Bishop [99] • MCOP • . . . y x t

  18. pushbroom images Linear Path • Video Cube Demo • application by Michael Cohen et al., Microsoft input

  19. circular EPI panorama (“concentric mosaic”) input image Circular Path

  20. Circular Path input video cube cyclographs

  21. What are these images good for? • Applications to computer graphics, computer vision?

  22. y x0-n x0 x0+n x q Circular Stereo I • [Ishiguro, Yamamoto, Tsuji, 92] • [Peleg and Ben-Ezra, 99] • [Shum, Kalai, Seitz, 99] • [Nayar and Karmarkar, 00]

  23. Stereo Panorama Disparity map result

  24. Stereo Panorama Dark--close, light--far

  25. Circular Stereo • Advantages • 360 degree scene reconstruction • Uniform accuracy, optimal

  26. y x0-n x0 x0+n x t Pushbroom Stereo

  27. y x0-n x0 x0+n x q Stereo Cyclographs

  28. Stereo Cyclograph Reconstruction • Computed from two cyclograph images • Using unmodified stereo matcher [Zitnick & Kanade]

  29. Stereo Path Images • Do these all produce stereo pairs? • two images with horizontal parallax Yes

  30. Stereo Path Images • How about this path? No • Yes if the camera path is a conic • line, circle, ellipse, parabola, hyperbola • Must capture rays lying on doubly-ruled quadrics • [Padja 2001], [Seitz 2001]

  31. perspective image parabolic panorama Stereo Parabolic Panoramas

  32. Beyond Perspective • Cameras for humans, not machines! • Need to rethink cameras • Image should suit the task • Future: cameras will evolve like CPU’s • First: task-specific cameras • Then: programmable cameras • FPGA  programmable camera arrays • Thanks to Jiwon Kim, Michael Cohen

More Related