1 / 13

JEG

JEG. Marcus Barkowsky. Agenda. Generation of HRCs Getting a database. Generation of HRCs. For the coding Fixed QP coding Variable QP coding, e.g. fixed bitrate QP changes for Macroblocks CABAC or CAVLC (does it effect the hybrid model?) Error conditions only on NALU level

dsylvester
Download Presentation

JEG

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. JEG Marcus Barkowsky

  2. Agenda • Generation of HRCs • Getting a database JEG / Meeting November 2010 Atlanta

  3. Generation of HRCs • For the coding • Fixed QP coding • Variable QP coding, e.g. fixed bitrate • QP changes for Macroblocks • CABAC or CAVLC (does it effect the hybrid model?) • Error conditions only on NALU level • Redundant slices, other parameters in the encoder configuration that tune the process of encoding towards error robustness, data partitioning (unequal error protection) – maybe not used very often in practice • Structure of the bitstream • GOP size (distance between IDR frames or I-frame in closed GOP structure) • Number of B-pictures • Different slice structures • Sequence dependent GOP structures (e.g. scene cut) • Number of reference frames • (go through the encoder.cfg file and identify more parameter) JEG / Meeting November 2010 Atlanta

  4. Generation of HRCs • Profiles and levels, conditions to include/exclude • interlaced – not fully tested for HMIX generation, hybrid model may include interlaced • 3D – simulcast and side-by-side • All profiles – maybe not extended profile, 10bit? YUV422? • FMO – only in the extended profile at the moment and not really used • Different encoder implementations • X264 • JM • TMPGEnc JEG / Meeting November 2010 Atlanta

  5. Generation of HRCs • For the network: • Realtime error conditions, e.g. ITU-T G.1050 (Margaret, Nicolas, Filippo), levels can or should be specified • Offline introduction of packet losses simulated precisely with QualNet / NS-2 / NS-3 • Articificial delay of packets (e.g. traffic shaping in order to smooth the peaks in the network, thus reducing the jitter), e.g. simulated by sirranon • Interleaving of packets (currently not part of our toolchain) • Reordering (currently not part of our toolchain) • Delay (Change of arrival time of packets) • Lost packets • Faulty network conditions (currently not part of our toolchain) • Duplicate packets, e.g. due to retransmissions • Erroneous informations in packet headers (time stamps, sequence numbers, …) JEG / Meeting November 2010 Atlanta

  6. Generation of HRCs • Possibility of introducing delay in the PVS due to • Decoder incapability (slow playback) • Realtime Playback system with capture • Offline simulation tool • Video Resolutions • VGA • HDTV 1080i 29.97fps (Margaret) • Other dimensions of HRC generation? JEG / Meeting November 2010 Atlanta

  7. Decoders • Software players • Vlc, ffplay, xine, Quicktime, mplayer (different operating systems and versions) • Software decoders • JM • Hardware systems • (multimedia harddisks?) • (settop boxes difficult to configure) JEG / Meeting November 2010 Atlanta

  8. Getting a training database • SRC sequences, e.g. CDVL, SVT, lower quality amateur video sequence (e.g. with tripod) • Identification of HRCs and their tools (Margaret, Nicolas, Kjell, Phil, Alex) • Creation of PVSs (Vittorio, Margaret, Savvas, Chulhee, Filippo, Nicolas) • Getting the HMIX files • Run several objective Full-Reference Models on the PVSs (which ones?) • Silvio: processing sequences or maybe giving model to one (or several) JEG members • Chris: maybe processing sequences • Chulhee: processing sequences • Identify which sequences are critical (e.g. high variance amongst the FR models) • Do subjective testing on those sequences • Develop the statistical analysis tools that allow for the analysis (Lucjan, Chulhee) JEG / Meeting November 2010 Atlanta

  9. Hybrid model • A first version with a lot of documentation is available at: • http://wiki.vqeg-jeg.org/index.php5?title=WP3:_Hybrid_Model • In order to allow contributions, we add a document numbering system which can be referenced as publications (similar to MPEG by Glenn) JEG / Meeting November 2010 Atlanta

  10. Individual contributions • Glenn: Document numbering system • Vittorio: Include logo, distinguish between input and output documents for meetings and working documents e.g. testplans • Introduction of such a system: 15 for, 0 against • Working group on document numbering and technical issues: Margaret, Filippo, Arthur, Glenn, Kjell, Nicolas, Steve, Marcus JEG / Meeting November 2010 Atlanta

  11. Individual contributions • Lucjan: « Intent of usage » to sign in order to further its development of H.264BitstreamGenerator • Lucjan: Matlab code for parsing XML files available • Lucjan: Program for offline packet loss introduction working on PCAP files • Savvas: similar program from T-Labs available only drops packets independent of its content • Martin: similar program available that allows to start later or to finish earlier than the end of the sequence • Savvas: List of modules that would help the hybrid model JEG / Meeting November 2010 Atlanta

  12. Towards a training dataset • Selection/Creation and preparation of SRC sequences • Appropriate for a training dataset • Martin, Alex, Kjell,Lucjan, Vladimir • e.g. splitting by content characterization • Identification of coding and transmission scenarios • Savvas, Nicolas, Glenn, Marcus • HRC generation toolchain GUI • Nicolas, Lucjan, Glenn, Marcus • Playback with timestamps and generate PVSs • Alex, Marcus JEG / Meeting November 2010 Atlanta

  13. Hybrid Model – Aspect • Image quality • PVS: AGH, IP-Label, NTIA, Acreo, IRCCyN • Bitstream: DT, IP-Label, AGH, Acreo • Image/Sequence characterisation • PVS / Bitstream: DT, NTIA, IRCCyN • Packet loss analysis • Bitstream: DT, Acreo, AGH • PVS: AGH, Yonsei • Saliency and visual attention • IRCCyN • Temporal visual attention • IRCCyN • Combination of indicators • NTIA, OPTICOM, AGH, U-Vienna JEG / Meeting November 2010 Atlanta

More Related