1 / 70

Surface Light Fields for 3D Photography

Surface Light Fields for 3D Photography. Daniel Wood Daniel Azuma Wyvern Aldinger Brian Curless Tom Duchamp David Salesin Werner Stuetzle. 3D Photography. Goals Rendering and editing Inputs Photographs and geometry Requirements Estimation and compression.

gene
Download Presentation

Surface Light Fields for 3D Photography

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Surface Light Fieldsfor 3D Photography Daniel Wood Daniel Azuma Wyvern Aldinger Brian Curless Tom Duchamp David Salesin Werner Stuetzle

  2. 3D Photography • Goals • Rendering and editing • Inputs • Photographs and geometry • Requirements • Estimation and compression

  3. View-dependent texture mapping Debevec et al. 1996, 1998 Pulli et al. 1997

  4. View-dependent texture mapping Debevec et al. 1996, 1998 Pulli et al. 1997

  5. Two-plane light field Levoy and Hanrahan 1996 Gortler et al. 1996

  6. Surface light fields Walter et al. 1997 Miller et al. 1998 Nishino et al. 1999

  7. Lumisphere-valued “texture” maps Lumisphere

  8. Overview Data acquisition Estimation and compression Rendering Editing

  9. Overview Data acquisition Estimation and compression Rendering Editing

  10. Scan and reconstruct geometry Range scans (only a few shown . . .) Reconstructed geometry

  11. Take photographs Camera positions Photographs

  12. Register photographs to geometry Photographs Geometry

  13. Register photographs to geometry User selected correspondences (rays)

  14. Parameterizing the geometry Map Scanned geometry Base mesh

  15. Sample base mesh faces Base mesh Detailed geometry

  16. Assembling data lumispheres Data lumisphere

  17. Overview Data acquisition Estimation and compression Rendering Editing

  18. Pointwise fairing Faired lumisphere Data lumisphere

  19. Pointwise fairing results Pointwise faired (177 MB) Input photograph

  20. Pointwise fairing Many faired lumispheres Many input data lumispheres

  21. Compression Small set of prototypes

  22. Compression / Estimation Many input data lumispheres Small set of prototypes

  23. Reflected reparameterization

  24. Reflected reparameterization

  25. Reflected reparameterization

  26. Reflected reparameterization Before After

  27. Median removal Reflected Median (“diffuse”) + + Median-removed (“specular”)

  28. Median removal Median values Specular Result

  29. Function quantization Input data lumisphere Codebook of lumispheres

  30. Lloyd iteration Input data lumispheres

  31. Lloyd iteration Codeword

  32. Lloyd iteration Perturb codewords to create larger codebook

  33. Lloyd iteration Form clusters around each codeword

  34. Lloyd iteration Optimize codewords based on clusters

  35. Lloyd iteration Create new clusters

  36. Function quantization results Function quantized (1010 codewords, 2.6 MB) Input photograph

  37. Principal function analysis Input data lumisphere Prototype lumisphere Subspace of lumispheres

  38. Principal function analysis Prototype lumisphere Approximating subspace

  39. Principal function analysis

  40. Principal function analysis

  41. Principal function analysis results PFA compressed (Order 5 - 2.5 MB) Input photograph

  42. Compression comparison Pointwise fairing (177 MB) Function quantization (2.6 MB) Principal function analysis (2.5 MB)

  43. Comparison with 2-plane light field(uncompressed) Pointwise-faired surface light field (177 MB) Uncompressed lumigraph / light field (177 MB)

  44. Comparison with 2-plane light field(compressed) Compressed (PFA) surface light field (2.5 MB) Vector-quantized lumigraph / light field (8.1 MB)

  45. Overview Data acquisition Estimation and compression Rendering Editing

  46. View-dependent level-of-detail

  47. Render texture domain and coordinates in false color

  48. Evaluate surface light field

  49. Interactive rendererscreen capture

  50. Overview Data acquisition Estimation and compression Rendering Editing

More Related