Cross-Layer Error Resilient Mechanism in Scalable Video Coding

1. Cross-Layer Error Resilient Mechanism in Scalable Video Coding Authors: Shu-Jhen Fan Jiang, Chia-Hung Yeh and Mei-Juan Chen Presenter: Shu-Jhen Fan Jiang National Sun Yat-Sen University, and National Dong-Hua University, Taiwan

2. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

3. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

4. Scalable Video Coding (SVC)

5. Architecture of SVC

6. Inter-Layer Prediction • Inter-layer motion prediction • Inter-layer intra prediction • Inter-layer residual prediction

7. Inter-Layer Motion Prediction

8. Inter-Layer Intra Prediction

9. Inter-Layer Residual Prediction

10. Error Concealment and Error Resilience • Error concealment • Error resilience

11. Whole Frame Loss in Base Layer Error Concealment Algorithm – Frame Copy

12. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

13. Previous work • Reversible data embedding [1] • High quality • Explore the redundancy in digital content to achieve reversibility • Error resilience algorithm [2] • Adopt reversible data embedding technique in H.264 • [1] J. Tian, “Reversible data embedding using a difference expansion,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, No. 8, pp. 890 – 896, August 2003 • [2] W.-N. Lie, T. C.-I. Lin, D.-C. Tsai and G.-S. Lin, “Error resilient coding based on reversible data embedding technique for H.264/AVC,” in Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1174 – 1177, July 2005

14. Review of Previous Work • Embedding • Extraction

15. Review of Previous Work • Embedding process • Inter : conceal mode • Intra : index of wavelet coefficient

16. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

17. Cross-Layer Error Resilient Mechanism • Recover whole frame loss in base layer • Reduce the distortion of inter-layer prediction • Protect 2 coding rules in SVC • Inter-layer intra prediction • Embed the wavelet coefficient of base layer • Inter-layer motion prediction • Embed the motion vectors of base layer

18. Inter-Layer Intra Prediction • Embedding process • 8 bits - band 0 • 1 or 4 bits - band 1 to 6

19. Inter-Layer Motion Prediction • Encoder • Embed 6 bits for each horizontal or vertical MV • 5 bits - half pixel precision MV • 1 bit - significant bit • Embed 2 bits for each 4×4 block

20. Flowchart of Proposed Algorithm at the Encoder Side

21. Flowchart of Proposed Algorithm at the Decoder Side

22. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

23. Simulation Settings • Parameter setting in JSVM9.12

24. Objective Comparison

25. Objective Comparison

26. Objective Comparison

27. Objective Comparison

28. Subjective Comparison PLR = 10 % Frame copy PSNR = 29.75 dB Proposed PSNR = 32.96 dB

29. Subjective Comparison PLR = 10 % Lost frame: 154th Current frame: 154th Frame copy PSNR = 20.61 dB Proposed PSNR = 32.27 dB

30. Subjective Comparison PLR = 10 % Frame copy PSNR = 27.01 dB Proposed PSNR = 30.40 dB

31. Subjective Comparison PLR = 5 % Lost frame: 19th Current frame: 19th Frame copy PSNR = 20.66 dB Proposed PSNR = 29.20 dB

32. Subjective Comparison PLR = 5 % Frame copy PSNR = 15.38 dB Proposed PSNR = 24.26 dB

33. Subjective Comparison PLR = 5 % Lost frame: 48th Current frame: 42th Frame copy PSNR = 14.78 dB Proposed PSNR = 26.50 dB

34. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

35. Conclusion • A new algorithm is proposed to reduce the distortion of inter-layer prediction when the whole frame is lost in lower layer • Experimental results show that a PSNR improvement is 6.76 dB in average and the maximum improvement is up to 10.28 dB when packet loss rate is equal to 20%.

36. Thank you for your attention!

37. Bitrate Analysis – 2-Layer

38. Training Wavelet Coefficient Akiyo, City, Football, and Foreman Bus, Mobile, and Table

39. Subjective Comparison – 3-Layer PLR = 5 % Lost frame: 400th, Layer 0 Current frame: 400th, Layer 2 Error free (43.72dB) Frame Copy (19.31dB) Proposed (33.01dB)

40. Error Resilient Mechanism for Multiple Layer • Inter-layer intra prediction • Embed the index of wavelet coefficient of lower layer • Inter-layer motion prediction • Embed the MV difference between the two lower layers

41. Objective Comparison – 3-Layer

42. Objective Comparison – 3-Layer

43. Subjective Comparison – 3-Layer PLR = 10 % Frame copy PSNR = 31.96 dB Proposed PSNR = 37.96 dB

44. Subjective Comparison – 3-Layer PLR = 15 % Frame copy PSNR = 22.51 dB Proposed PSNR = 35.79 dB

45. Flowchart of Proposed Algorithm at the Encoder Side

46. Flowchart of Proposed Algorithm at the Decoder Side

47. Bitrate Analysis – 3-Layer

48. Subjective Comparison – 3-Layer PLR = 10 % Lost frame: 404th, Layer 0 Current frame: 405th, Layer 2 Error free (38.81dB) Frame Copy (19.04dB) Proposed (34.67dB)