1 / 59

Overview on Scalable Video Coding - II

Overview on Scalable Video Coding - II. Chuan-Yu Cho. Outline. HHI and MS SVC Codecs Scalable Video Model 3.0. SVC: 68th meeting. 14 full proposals in two categories Category 1: MCTF/2D Wavelet Category 2: AVC based (incl. AVC/MCTF) Core Experiments (CE)

overton
Download Presentation

Overview on Scalable Video Coding - II

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Overview on Scalable Video Coding - II Chuan-Yu Cho

  2. Outline • HHI and MS SVC Codecs • Scalable Video Model 3.0

  3. SVC: 68th meeting • 14 full proposals in two categories • Category 1: MCTF/2D Wavelet • Category 2: AVC based (incl. AVC/MCTF) • Core Experiments (CE) • Reference model (software) = the best performing scheme in each category • Category 1: (MCTF/2DWT) Microsoft Research Asia • Category 2: (AVC/MCTF) HHI • Result of Core Experiments will be used for decision to adopt one complete codec architecture into the WD. From: NCTU 69th MPEG meeting report

  4. HHI and MS SVC Codecs Chuan-Yu Cho

  5. Motion Compensation Temporal Filtering (MCTF)

  6. Motion Compensation Temporal Filtering (MCTF)

  7. Wavelet tree with reduction of spatial size throughout the temporal levels

  8. Motion Adaptive Filtering

  9. Motion Compensation Temporal Filtering (MCTF)

  10. Adaptive vs Non-adaptive MCTF

  11. 3D Sub-band Video Coding using Barbell lifting • Status • Proposal • Source • MSRA Asia IM group, MS CMPT group • Authors • Jizheng Xu, Ruiqin Xiong, Bo Feng, Gary Sullivan, Ming-Chieh Lee, Feng Wu, Shipeng Li

  12. 3-D Wavelet/Subband (Interframe Wavelet) Method Temporal Scalability Spatial Scalibility

  13. Barbell lifting

  14. Lifting scheme Prediction stage Update stage

  15. L5: 512Kbps QCIF 15 L4: 256Kbps QCIF 15

  16. L3: 128Kbps QCIF 15 L2: 64Kbps QCIF 15 L1: 48Kbps QCIF 7.5

  17. Scalable Extension of H.264/AVC • Status • Proposal => SVM 3.0 • Source • Fraunhofer Institute for Telecommunications -Herinrich Hertz Institute (HHI) • Authors • Heiko Schwarz, Detlev Marpe, and Thomas Wiegand

  18. HHI Joint Scalability

  19. HHI Temporal Scalability

  20. HHI SNR Scalability

  21. HHI Joint Scalability

  22. 1 Layer 0 & 1 0 I B P B 48kbps I P 32kbps

  23. HHI Joint Scalability

  24. 2 1 (Up sample) P B

  25. HHI Joint Scalability

  26. 2 96Kbps Inter Prediction H L 1 Intra prediction for intra MB Intra prediction for intra MB

  27. HHI Joint Scalability

  28. HHI Joint Scalability

  29. 4 3 L22 SNR Scalability (QP) H00 Temporal Scalability (Motion Compensation) L21

  30. HHI Joint Scalability

  31. 4 3 H22 SNR Scalability (QP) H00 Temporal Scalability (Motion Compensation) H21

  32. Scalable Video Model 3.0 Tomas Wiegand Fraunhofer Institute for Telecommunications – Heinrich Hertz Institute (HHI) To be published in VCIP ‘05

  33. Outline

  34. Introduction

  35. MCTF using the Lifting Representation

  36. Motion model of H.264/MPEG-4 AVC

  37. Prediction and Update operators

  38. Derivation of Update Operators

  39. Temporal Coding Structure

  40. Temporal Decomposition Structure

  41. Impacts on H.264/MPEG-4 AVC

  42. Simulation Results for the MCTF Extension

  43. Simulation Results for the MCTF Extension

  44. SNR-Scalable Extension

  45. Adjustment of the Quantization Parameter

  46. Impacts on H.264/MPEG-4 AVC

  47. Results for Layered SNR-Scalability

  48. Results for Layered SNR-Scalability

  49. Spatial Scalability

  50. Spatial Prediction of Data

More Related