1 / 18

3D Video Generation and Service Based on a TOF Depth Sensor in MPEG-4 Multimedia Framework

3D Video Generation and Service Based on a TOF Depth Sensor in MPEG-4 Multimedia Framework. IEEE Consumer Electronics Sung- Yeol Kim Ji -Ho Cho Andres Koschan Mongi A. Abidi. Outline. Introduction Video-Plus-Depth Generation System Architecture Experimental Result Conclusion.

cerise
Download Presentation

3D Video Generation and Service Based on a TOF Depth Sensor in MPEG-4 Multimedia Framework

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 3D Video Generation and Service Based on a TOF Depth Sensor in MPEG-4 Multimedia Framework IEEE Consumer Electronics Sung-YeolKim Ji-Ho Cho Andres Koschan Mongi A. Abidi

  2. Outline • Introduction • Video-Plus-Depth Generation • System Architecture • Experimental Result • Conclusion

  3. Introduction(1/2) • 3D video is recognized as an essential part of the next-generation multimedia application • Questions: • How can we stream 3D video contents • How can we obtain high-quality 3D video

  4. Introduction(2/2) • The problems of depth images captured by TOF: • Optical noise • Unmatched boundaries • Lost depth data • Temporal depth flickering artifacts

  5. Video-Plus-Depth • Outer Boundary Matching • Inner Optical Noise Minimization • Recovery of Lost Depth Data • Temporal Consistency

  6. Outer Boundary Matching • Employ a closed form matting to find globally optimal alpha matte • Use alpha maps to compensate the depth image • Run a local iterative threshold selection

  7. Inner Optical Noise Minimization

  8. Recovery of Lost Depth Data • Detection of the lost depth dataregion • Recovery of the boundary • Estimation of the lost data(use quadratic Bazier curve to interpolate depth information)

  9. Temporal Consistency • Using block matching to find motion vector • Motion image • Detect the stationary regions • Stationary image • Enhanced depth image

  10. System Architecture

  11. Experiment Result • Test sequences are obtained from a TOF depth sensor • Resolution of both sequences was 720*480

  12. Experiment Result

  13. Experiment Result

  14. Experiment Result

  15. Reconstruction of dynamic 3D scenes

  16. Quality Evaluation

  17. 3D video content played by an MPEG-4 player

  18. Conclusion • Propose a new method to enhance depth images captured by a TOF depth sensor • Show the possibility of 3D video services based on video-plus-depth data in MPEG-4 multimedia framework

More Related