1 / 23

The SP- and SI-Frames Design for H.264/AVC

The SP- and SI-Frames Design for H.264/AVC. Marta Karczewicz and Ragip Kurceren. (Nokia Research Center). IEEE Trans. on Circuit and System for Video Technology, Vol.13, No. 7, July 2003. Outline. What’s SP- and SI-Frames Motivation Decoding and Encoding Processes for SP- and SI-Frames

giolla
Download Presentation

The SP- and SI-Frames Design for H.264/AVC

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The SP- and SI-Frames Design for H.264/AVC Marta Karczewicz and Ragip Kurceren (Nokia Research Center) IEEE Trans. on Circuit and System for Video Technology, Vol.13, No. 7, July 2003

  2. Outline • What’s SP- and SI-Frames • Motivation • Decoding and Encoding Processes for SP- and SI-Frames • Results

  3. What’s SP- and SI-Frames (1/2) • SP-frames make use of motion compensated predictive coding to exploit temporal redundancy in the sequence similar to P-frames. • The difference between SP- and P-frames is that SP-frames allow identical frames to be reconstructed even when they are predicted using different reference frames.

  4. What’s SP- and SI-Frames (2/2) • SP-frames can be usedinstead of I-frames in such applications as bitstream switching, splicing, random access, fast forward, fast backward, and error resilience/recovery. • SP-framesrequire significantly fewer bits than I-frames to achieve similar quality. • In some of the mentioned applications, SI-frames are used in conjunction with SP-frames. An SI-frame uses only spatial prediction as an I-frame and still reconstructs identically the corresponding SP-frame, which uses motion-compensated prediction.

  5. Frame types in the existing standards • I- , P-, and B-Frames P P I … I P P P P I B B … I B B P P

  6. Primary SP-frame Applications for SP- and SI-Frames(1) • Bitstream switching P2, n-2 P2, n-1 S2, n P2, n+1 P2, n+2 Bitstream 2 S 12, n Secondary SP-frame P1, n-2 P1, n-1 S1, n P1, n+1 P1, n+2 Bitstream 1

  7. Applications for SP- and SI-Frames(2) • Splicing and Random Access P2, n-2 P2, n-1 S2, n P2, n+1 P2, n+2 Bitstream 2 SI 2, n P1, n-2 P1, n-1 S1, n P1, n+1 P1, n+2 Bitstream 1

  8. Applications for SP- and SI-Frames(3) • Error Recovery/Resiliency P1, n-3 P1, n-2 P1, n-1 S1, n P1, n+1 S 21, n SI1, n

  9. Applications for SP- and SI-Frames(4) • Video Redundancy Coding • Sync frame 1 2 3 4 5 6 7 8 9 10 11 12 13 3 4 5 6 7 8 9 10 11 12 13 14 15 5 6 7 8 9 10 11 12 13 14 15 16 17

  10. + Decoding and Encoding Processes for SP- and SI-Frames Inverse Quantization Inverse Transform PQP Frame Memory MC Prediction Demultiplexing Intra Predition Motion Information Intra Prediction Mode Generic block diagram of decoding process.

  11. + Generic block diagram of decoding process for secondary SP- and SI-frames Inverse Quantization Inverse Transform lc lerr lrec drec lpred SPQP Frame Memory Quantization R P MC Prediction Demultiplexing SPQP Transform Intra Predition Motion Information Intra Prediction Mode

  12. + Generic block diagram of decoding process for primary SP-frames Inverse Quantization Quantization Inverse Quantization derr crec lerr lrec cpred SPQP PQP drec SPQP Inverse Transform lc Demultiplexing Transform Frame Memory R MC Prediction P Motion Information

  13. + Generic block diagram of encoding process for nonintra blocks in SP-frames Transform corig cerr Quantization lerr - PQP Inverse Quantization dpred Inverse Quantization derr PQP cpred + SPQP lpred Quantization Multiplexing Quantization lrec SPQP Inverse Quantization & Inverse Transform Transform Motion Estimation Frame Memory P R Motion Information

  14. + To generate secondary representation of the primary SP-frame lc Inverse Quantization Quantization Inverse Quantization derr crec lerr lrec cpred SPQP PQP drec SPQP Inverse Transform lc Demultiplexing Transform Frame Memory F1,n => F2,n R MC Prediction P Motion Information lerr,2= lrec – lpred,2

  15. + Generic block diagram of encoding process for nonintra blocks in SP-frames lerr,2 Transform corig cerr Quantization lerr - PQP Inverse Quantization dpred Inverse Quantization derr PQP cpred + SPQP lpred lpred,2 Quantization Multiplexing Quantization lrec SPQP Inverse Quantization & Inverse Transform Transform lc Motion Estimation Frame Memory P R lerr,2= lrec – lpred,2 Motion Information

  16. + Generic block diagram of decoding process for secondary SP- and SI-frames lerr,2 lc Inverse Quantization Inverse Transform lerr lrec drec lpred SPQP Frame Memory F2,n lpred,2 Quantization R P MC Prediction Demultiplexing SPQP Transform Intra Predition Motion Information Intra Prediction Mode lerr,2= lrec – lpred,2 lerr,2+ lpred,2= (lrec – lpred,2)+ lpred,2= lrec

  17. Results – coding efficiencies

  18. Results – coding efficiencies when inserted periodically

  19. Results – Comparison with S-Frame (Drifting effect)

  20. Results – Comparison with S-Frame (Size) 6.2 times The SP-frame is 3.4 times smaller than the S-frame in average.

  21. Results – PSNR and Total bits over 100 frames (4 switches) SP or I Frame rate = 1fs

  22. Results – PSNR and Total bits over 100 frames (no switches) SP or I Frame rate = 1fs

  23. ~ The End ~ Thank you!!

More Related