Error Concealment For Fine Granularity Scalable Video Transmission

1. Error Concealment For Fine Granularity Scalable Video Transmission Hua Cai; Guobin Shen; Feng Wu; Shipeng Li; Bing Zeng; Multimedia and Expo, 2002. Proceedings. 2002 IEEE International Conference on

2. Outline • Introduction • Temporal and Spatial Correlations • Proposed Error Concealment Method • Interleaving MBS • Experimental Result • Conclusion

3. Introduction • Bandwidth fluctuation • Network heterogeneity • Competitions among traffic Fine Granularity scalability (FGS) coding scheme • Transmission Error • Error Resilience • FEC, Data partition, Resynchronization mark • Error Concealment (EC)

4. Introduction (cont.) • Error Concealment • To be implemented at the decoder side • Enhancement layer packets • Contaminated regions

5. FGS encoded bitstream • Two Bitstream • Base layer and Enhance layerBitsB(f) = E。QB{DCT[O(f) – MC(RB(f-1))]} BitsE(f) = E。QE{DCT[O(f) – RB(f)]}

6. Temporal Correlation • Temporal correlation exists in the FGS bitstream RB(f)  RB(f-1) + DCT-1{Q[Enh(f-1)]} if O(f) = O(f-1) O(f) =RB(f-1) + DCT-1[Enh(f-1)] if O(f) = O(f-1)

7. Proposed Error Concealment Method • Temporal correlation could be used to improve the quality of contaminated regions •  is the interpolation ratio within the region [0,1] • It reflect the intensity of the temporal correlation • Intra coded block,  approaches 1

8. Optimal Interpolation Ratio 0 • For each 8x8 block, the optimal interpolation ratio 0 can be found by minimize the distortion between the origin and the interpolated one.

9. Optimal Interpolation Ratio 0 (cont.)

10. Spatial Correlation • It is impossible to find  at the decoder side • The spatial correlation could be used for predicting the contaminated regions’ temporal correlation

11. Spatial Correlation (cont.)

12. 1 31 2 32 3 33 4 34 5 35 6 56 80 57 81 58 82 59 83 60 84 61 7 36 8 37 9 38 10 39 11 40 12 62 85 63 86 64 87 65 88 66 89 67 13 41 14 42 15 43 16 44 17 45 18 68 90 69 91 70 92 71 93 72 94 73 19 46 20 47 21 48 22 49 23 50 24 74 95 75 96 76 97 77 98 78 99 79 25 51 26 52 27 53 28 54 29 55 30 The Packetizing order for QCIF sequence Interleaving MBS during Packetization

13. Experimental Result

14. Experimental Result (cont.)

15. Conclusion • This paper presents an efficient EC method for FGS video transmission. • Temporal redundancy is used to improve the quality of the contaminated regions. • The intensity of the temporal correlation is estimated exploiting the spatial correlation in the surrounding high-quality regions.