1 / 29

Interactive Deformation of Light Fields

Interactive Deformation of Light Fields. Billy Chen Eyal Ofek Heung-Yeung Shum Marc Levoy. Image-based rendering. Levoy et al., 1996. Shum et al., 1999. Zitnick et al., 2004. Uyttendaele et al., 2004. Previous work.

Sophia
Download Presentation

Interactive Deformation of Light Fields

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Interactive Deformation of Light Fields Billy Chen Eyal Ofek Heung-Yeung Shum Marc Levoy

  2. Image-based rendering Levoy et al., 1996 Shum et al., 1999 Zitnick et al., 2004 Uyttendaele et al., 2004

  3. Previous work • Seitz, S., Kutulakos, K. N. “Plenoptic image editing,” In Proc. ICCV 1998. • Zhang, Z., Wang, L., Guo, B., Shum, H.-Y, “Feature-based light field morphing,” In Proc. SIGGRAPH 2002. • Weyrich, T., Pfister, H., Gross, M., “Rendering deformable surface reflectance fields,” In IEEE Transactions on Computer Graphics and Visualization.

  4. Light field deformation

  5. Outline • Coaxial light fields • Framework for deformation • Splitting • Deforming • Rendering • Results

  6. Outline • Coaxial light fields • Framework for deformation • Splitting • Deforming • Rendering • Results

  7. Coaxial light fields … …

  8. Outline • Coaxial light fields • Framework for deformation • Splitting • Deforming • Rendering • Results

  9. Splitting a light field • A sub-light field consists of • a bundle of rays • a deformation box s u

  10. Sub-light field example

  11. Projector-based light field segmentation

  12. …

  13. Outline • Coaxial light fields • Framework for deformation • Splitting • Deforming • Rendering • Results

  14. Deformation

  15. Ray warping • preserves mapping specified by the animator • preserves C0continuity of points • maps lines to lines

  16. Inverse view ray warping

  17. Inverse view ray warping

  18. Hardware accelerated warping front id map back id map deformation • 256 x 256 resolution texture map • anisoptric filter for mip-mapped texture • 64 x 64 triangles • real-time with a NVIDIA GeForce 3

  19. Outline • Coaxial light fields • Framework for deformation • Splitting • Deforming • Rendering • Results

  20. Rendering and visibility • For each camera pixel • Segment ray • Warp ray • Render ray • Mask ray

  21. Results

  22. Conclusion • A pipeline for deforming light fields • Light field segmentation • Ray warping • Rendering multiple light fields • Coaxial light fields • Enables interactive deformation of photo-realistic objects • Applications: photo-realistic rapid prototyping, games

  23. Thank you • Reviewers • NSF (IIS-0219856-001) • DARPA (NBCH-1030009) • Elizabeth Chen, Vaibhav Vaish, Gaurav Garg

  24. Failure cases

  25. Video of acquisition process

  26. Deformationand compositing

More Related