1 / 39

S tereoscopic 3D

S tereoscopic 3D. 2013/10/30. Stereoscopic Image Transforms to Autostereoscopic Multiplexed Image. Wei-Ming Chen, Chi- Hao Chiou and Sheng- Hao Jhang. Computer Science and Automation Engineering (CSAE), 2011. Outline. Introduction Related Work Proposed Method Experimental Results

balin
Download Presentation

S tereoscopic 3D

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Stereoscopic 3D 2013/10/30

  2. Stereoscopic Image Transforms to Autostereoscopic Multiplexed Image Wei-Ming Chen, Chi-HaoChiou and Sheng-HaoJhang Computer Science and Automation Engineering (CSAE), 2011

  3. Outline • Introduction • Related Work • Proposed Method • Experimental Results • Conclusion

  4. Introduction

  5. Introduction • 3D technologies have become popular in recent years. • Widely applied to movie, films and show. • In early 3D vision technology: • Anaglyph • Polarization • Shutter With special glasses

  6. Anaglyph Glass

  7. Polarization Glass Polarization Glass

  8. Shutter Glass

  9. Introduction • Autostereoscopic 3D display • Non-glass system • Propose a new technique for generating Autostereoscopic multiplexed content. Objective:

  10. Related Work

  11. Disparity • Vertical Parallax • Usually = 0 • focus on horizontal parallax • Horizontal Parallax • Identify the distance of the object

  12. Disparity retina

  13. Image Rectification • Zero Parallax Zero parallax plane

  14. Image Rectification • Simplified to one dimension - horizontal

  15. Image Rectification • Solution : All epipolar lines are parallel in the rectified image plane.

  16. Disparity toDepth • 3D coordinate of real scene: Epipolar line Baseline f : focal length b : the length of baseline d : disparity (u0, v0) : coordinate of image center (camera intrinsic parameter matrix K) (u, v) : pixel coordinate Du Xin, Zhu Yun-fimg, "A Flexible Method for 3D Reconstruction of Urban Building", ICSP 2008 proceedings.

  17. Wei-wei Ma, My-Ha Le, Kang-Hyun Jo, "3D Reconstruction and Measurement of Indoor Object Using Stereo Camera", The 6th International Forum on Strategic Technology, 2011. 3D Reconstruction

  18. Autostereoscopic3D display • Time-multiplexed • Switch rapidly (left and right images) • 2D & 3D : same resolution • Spatial-multiplexed • Parallax barrier • Lenticular lenses • Lower resolution for 3D

  19. Autostereoscopic3D display • Parallax barrier • Lenticular lenses

  20. ProposedMethod

  21. System Flow of Depth-map Generation Stereo matching

  22. Depth-map Generation Disparity between stereo images • 1) Feature point detection • Use SURF algorithm[5] (based on SIFT) • 2) Epipolar Geometry • Matching the feature points • 3) Interpolation • Estimate the pixels which is not feature points • 4) Graphcut • Grouping the close pixels (segmentation) [5] H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-Up Robust Features (SURF)," Computer Vision and Image Understanding, vol. 110, pp. 346-359, 2008.

  23. System Flow of Synthesis

  24. Zero-parallax setting • The most comfortably distance between user and display could be determined from Zc. • Zc(Base plane)： Zfar : the highest depth map value Znear : the lowest depth map value

  25. Pre-processing the Depth Map • Mean filter • Gaussian filter

  26. 3D-image Warping • Multi-View：Need large storage space • use depth map to create virtual views • Warping： Reference view → Virtual view warp

  27. 3D-image Warping • Multi-View：Need large storage space • use depth map to create virtual views Warping

  28. 3D-image Warping • Lenticular autostereoscopic display • DIBR

  29. 3D-image Warping • Issues[*]: • Disparity Range • Limitations of perception and technology • Disparity Sensitivity • More sensitive to nearby objects • Disparity Gradient • Disparity Velocity • Temporal information [*]:Lang, M., Hornung, A., Wang, O., Poulakos, S., Smolic, A. & Gross, M. (2010, July).  Nonlinear Disparity Mapping for Stereoscopic 3D. To appear in ACM Transactions on Graphics (Proc. SIGGRAPH).

  30. Disoccluded Regions-filling • DisoccludedRegions : regions without warped pixel warp Virtual view Reference view

  31. Disoccluded Regions-filling • Associated withDIBR: Similar to occlusion handling

  32. Disoccluded Regions-filling

  33. ExperimentalResults

  34. Experimental Results • DisoccludedRegions-filling: Previous Work Proposed

  35. Experimental Results The six warping views

  36. Experimental Results Synthesized result

  37. Conclusion

  38. Conclusion • 3D-image generation of stereo images with good 3D effect was proposed. • Future : using temporal information • Stereo images → Disparity map → 3D warping → Hole filling • Issues: • Zero-parallax setting • Disparity Range / Disparity Velocity • Hole filling

  39. Reference • Optical Design, Fabrication, and Measurement 3D Introduction and Project (Dept. of Photonics & Display Institute,NationalChiao Tung University) • Image Rectification (Stereo) , Guido Gerig • AGENCY1903 BLOG http://www.agency1903.com/blog/2010/8/18/z-axis-power • 基於3D顯示器格式之即時3D內容合成技術 (劉楷哲、吳其霖、黃偉豪、陳信榮、李錕、羅豐祥)

More Related