1 / 28

File Format for Scalable Video Coding Outline

File Format for Scalable Video Coding Outline. SVC Introduction Review of File Format Basics SVC File Format Examples of Use. CMPT 820 – 2008 Summer Presented by Jeff Jiang. File Format for Scalable Video Coding SVC Introduction. SVC Scalabilities and the Cube Model

aquene
Download Presentation

File Format for Scalable Video Coding Outline

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. File Format for Scalable Video CodingOutline • SVC Introduction • Review of File Format Basics • SVC File Format • Examples of Use CMPT 820 – 2008 Summer Presented by Jeff Jiang

  2. File Format for Scalable Video CodingSVC Introduction • SVC Scalabilities and the Cube Model • Bit-Stream Representation • Usage and Application Scenarios • SVC High-Level Syntax CMPT 820 – 2008 Summer Presented by Jeff Jiang

  3. File Format for Scalable Video CodingSVC Introduction – Scalability & Data Model • SVC Scalabilities and the Cube Model • Temporal, Spatial, and SNR (Fidelity/Quality) scalability • Cube data model • SVC Syntax Elements – PDTQ • Priority-id • Dependency_id • Temporal_id • Quality_id CMPT 820 – 2008 Summer Presented by Jeff Jiang

  4. File Format for Scalable Video CodingSVC Introduction – Bit-Stream Representation • Flexible Combined Scalability • Layered Scalability CMPT 820 – 2008 Summer Presented by Jeff Jiang

  5. File Format for Scalable Video CodingSVC Introduction – Usage and Application • Direct File Access • Adaptation Operation • Erosion Storage - Surveillance CMPT 820 – 2008 Summer Presented by Jeff Jiang

  6. File Format for Scalable Video CodingSVC Introduction – SVC High-Level Syntax CMPT 820 – 2008 Summer Presented by Jeff Jiang

  7. File Format for Scalable Video CodingOutline • SVC Introduction • Review of File Format Basics • SVC File Format • Examples of Use CMPT 820 – 2008 Summer Presented by Jeff Jiang

  8. File Format for Scalable Video Coding File Format Review – ISO Base Media File Format • The file structure is object-oriented and can be decomposed into its constituent objects easily • The files have • Logical structure – a set of time parallel tracks, “movie” • Time structure – sequence samples in time • Physical structure – separate logical and time structure data from media data themselves CMPT 820 – 2008 Summer Presented by Jeff Jiang

  9. File Format for Scalable Video Coding File Format Review – ISO Base Media File Format • Tracks alternative to each other – using the same nonzero alternate group number • Special samples: • Synchronization point ( I-frame) • Track sample dependency • Sample groups – used in SVC file format • File type box • The specifications to which the file complies • Permission for a reader CMPT 820 – 2008 Summer Presented by Jeff Jiang

  10. File Format for Scalable Video Coding File Format Review – ISO Base Media File Format CMPT 820 – 2008 Summer Presented by Jeff Jiang

  11. File Format for Scalable Video Coding File Format Review – AVC File Format • A sequence of access unit, each divided into a number of NAL units CMPT 820 – 2008 Summer Presented by Jeff Jiang

  12. File Format for Scalable Video CodingOutline • SVC Introduction • Review of File Format Basics • SVC File Format • Examples of Use CMPT 820 – 2008 Summer Presented by Jeff Jiang

  13. File Format for Scalable Video CodingSVC File Format – Design Principles • Extractor – Extract subsets that will be often extracted easily • Grouped into tiers which contain one or more scalability layers (Sample groups) • Have time-parallel data (Time parallel metadata track) CMPT 820 – 2008 Summer Presented by Jeff Jiang

  14. File Format for Scalable Video CodingSVC File Format – Extractor Tracks • Allow “Cookbook” construction, take the forms of tracks within the alternate group • 3 different ways to represent subset CMPT 820 – 2008 Summer Presented by Jeff Jiang

  15. File Format for Scalable Video CodingSVC File Format – Extractor Tracks ‘Continue CMPT 820 – 2008 Summer Presented by Jeff Jiang

  16. File Format for Scalable Video CodingSVC File Format – Sample Groups • Using sample groups • Structure of sample groups • A number of sets of description tables • A number of mapping tables CMPT 820 – 2008 Summer Presented by Jeff Jiang

  17. File Format for Scalable Video CodingSVC File Format – Metadata • Structured as a sequence of file format samples, just like a video track • Each metadata sample is structured as a metadata statement • Empty statement • Group of statements • Sequence of statements CMPT 820 – 2008 Summer Presented by Jeff Jiang

  18. File Format for Scalable Video CodingSVC File Format – Metadata ‘Continue SEI NALu Base-layer Slice NALu 1 aggregator NALu 2 containing { enhancement NALu 2.1, enhancement NALu 2.2 } another enhancement NALu 3 some statement about the whole sample sequenceOfStatements { empty statement about SEI NALu groupOfStatements: { NALu header 1 statement; some other statement about NALu 1 } groupOfStatements { aggregator statement sequenceOfStatements { NALu header 2.1 statement; groupOfStatements: { NALu header 2.2 statement another statement about NALu 2.2 } } } some statement about NALu 3 } CMPT 820 – 2008 Summer Presented by Jeff Jiang

  19. File Format for Scalable Video CodingSVC File Format – AVC Compatibility • AVC compatibility can be divided into two major areas: • File Format Compatibility • Video coding compatibility • Sample-entry name used by SVC track • Avc1 – Define for AVC, use no data extraction, fully back-ward compatible • Avc2 – use data extraction • Svc1 – No AVC compatible • It is recommended to store AVC base layer in a separated AVC base track. SVC enhancement layer data reference the AVC base track CMPT 820 – 2008 Summer Presented by Jeff Jiang

  20. File Format for Scalable Video CodingOutline • SVC Introduction • Review of File Format Basics • SVC File Format • Examples of Use CMPT 820 – 2008 Summer Presented by Jeff Jiang

  21. File Format for Scalable Video CodingExample I – Simple Extractor Tracks CMPT 820 – 2008 Summer Presented by Jeff Jiang

  22. File Format for Scalable Video CodingExample II – Base Track CMPT 820 – 2008 Summer Presented by Jeff Jiang

  23. File Format for Scalable Video CodingExample III – Aggregator Uasge • Including NAL units in an aggregator • Referencing NAL units by an aggregator CMPT 820 – 2008 Summer Presented by Jeff Jiang

  24. File Format for Scalable Video CodingExample IV – Reading Map and Group Information CMPT 820 – 2008 Summer Presented by Jeff Jiang

  25. File Format for Scalable Video CodingExample IV – Reading Map and Group Information CMPT 820 – 2008 Summer Presented by Jeff Jiang

  26. File Format for Scalable Video CodingExample IV – Reading Map and Group Information • Tiers • Tier T0: H.264/AVC base layer (QCIF at 15 fps). • Tier T1: spatial enhancement of T0 to CIF. • Tier T2: temporal enhancement of T1 to 30 fps. • Tier T3: spatial enhancement of T2 to 4CIF (including the MGS enhancement). • Groups • Group G0 Tier T0, primary definition; • Group G1 Tier T0, tier IDR; • Group G2 Tier T1, primary definition; • Group G3 Tier T1, tier IDR; • Group G4 Tier T2, primary definition; • Group G5 Tier T3, primary definition; • Group G6 Tier T3, tier IDR. CMPT 820 – 2008 Summer Presented by Jeff Jiang

  27. File Format for Scalable Video CodingExample IV – Reading Map and Group Information • Maps • Map M0: G1, G3, G3, G6, G6, G5, G5 (as in sample 0); • Map M1: G0, G2, G5, G5 (as in samples 1 and 2); • Map M2: G4, G5, G5 (as in samples 3 and 4). • Samples • Sample 0: M0; • Sample 1: M1; • Sample 2: M1; • Sample 3: M2; • Sample 4: M2. CMPT 820 – 2008 Summer Presented by Jeff Jiang

  28. File Format for Scalable Video CodingSummary • The SVC File Format defines techniques to describe operation points and the resulting grouping of bit stream elements • It describes the bit stream structure and the dependencies exited between bit stream elements • Defines 3 types of scalability assisance • Precomputed scalability assistance • Scalability assistance through tiers (mainly assistance for layered scalability) • Scalability assistance with parallel metadata CMPT 820 – 2008 Summer Presented by Jeff Jiang

More Related