1 / 18

JEG Project: Overview of Ad-Hoc Group

JEG Project: Overview of Ad-Hoc Group. Marcus Barkowsky, Nicolas Staelens, Glenn Van Wallendael , Lucjan Janowski, Ulrich Engelke, Marie-Neige Garcia, Savvas Argyropoulos , Inigo Sedano, Shelley Buchinger, Werner Robitza Co- chairs : Alex Bourret , Kjell Brunnström, Patrick LeCallet.

butch
Download Presentation

JEG Project: Overview of Ad-Hoc Group

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. JEG Project: Overview of Ad-Hoc Group Marcus Barkowsky, Nicolas Staelens, Glenn Van Wallendael, Lucjan Janowski, Ulrich Engelke, Marie-Neige Garcia, Savvas Argyropoulos, Inigo Sedano, Shelley Buchinger, Werner Robitza Co-chairs: Alex Bourret, Kjell Brunnström, Patrick LeCallet

  2. Agenda • Current status • Presentations • Marcus: Currentstatementtothe patent situation • Nicolas, Marcus: Demonstration of HRC generation • Iñigo: Classificationofpublications, first hybrid model in python • Savvas: Implementationof „No-referencevideoqualityestimationbased on errorconcealmenteffectiveness“ Marcus Barkowsky: JEG Overview

  3. Objectives • From SRC to Bitstream-PVS • HRC Generation toolchain • HRC Validation Tools • From Bitstream/PVS to Hybrid Model input • Hybrid model input format • Tools for generating the Hybrid Model input format • Hybrid Model development • Hybrid model structure and framework • Hybrid model performance evaluation Marcus Barkowsky: JEG Overview

  4. Overview PVS HRC Subjective Experiment SRC PCAP MOS PCAP Parsing HMIX1 Annex-B H.264 Parsing HMIX2 Hybrid Model Training /Validation Objective Score Marcus Barkowsky: JEG Overview

  5. Progress since the last meeting • Shell scripts for the toolchain automation (encoding) • Preparation of HDTV pool 2 sequences in JEG format • XStreamer module to drop packets as specified in an offline file (Nicolas) • Enhanced version of TracesPlay • NALU counter implemented (Damian, Lucjan) • H.264 Annex-B output improved • Enhanced version of JM decoder • output of the two HMIX files (Nicolas, Glenn) • subpicture XML element included for interlaced/SVC/MVC compatibility • Charter • First version in wiki on http://wiki.vqeg-jeg.org Marcus Barkowsky: JEG Overview

  6. Ongoing work • Merging of HMIX files into a single file • Hybrid model • First model implementation using HMIX as input and QP as quality indicator (Inigo) • Table of publications (Inigo, Werner, Shelley) • Implementation of „No-reference video quality estimation based on error concealment effectiveness“ (Savvas) • Work on „Method of detecting freezes and dropped frames and mapping to quality of experience in pixel domain“ (Kjell) • Work towards visual attention and foreground/background segmentation (Werner) Marcus Barkowsky: JEG Overview

  7. Establishing sub-groups • Generation of a Hypothetical Reference Circuit (HRC): • Nicolas Staelens, Marcus Barkowsky • Creation of the Hybrid Model Input XML file (HMIX) files: • Lucjan Janowski, Nicolas Staelens • Hybrid Model: • Inigo Sedano, Shelley Buchinger • Training • Subjective data sets for training and validation Marcus Barkowsky: JEG Overview

  8. Statement to patent situation This text is preliminary and may be incorrect. It is published in order to prevent repetitive discussions on patents. The JEG group is a cooperative approach. Patents do not necessarily conflict with cooperative approaches. If a member of JEG wants to file a patent on a particular idea, he cannot discuss it openly, e.g. by using the mailing list, before the idea is filled. He first has to develop the idea, file a patent, get it accepted and then he can discuss it openly and propose it to the JEG for inclusion. When it is known that a proposed algorithm part is patented, this information should be shared within JEG. This applies to both self-owned and third party patents. In case two or more members of the JEG group wish to have a common patent, the same rules as above apply: They cannot reveal their idea by an open discussion on the mailing list. Practical problems may arise from the fact that patents can usually only be filed by a legal entity and cross-country issues may appear due to different laws. Marcus Barkowsky: JEG Overview

  9. Statement to patent situation The purpose of the JEG group is to develop an outstanding objective quality metric. In order to achieve this goal, all algorithm enhancements will be evaluated on an objective basis. This involves, for example, comparing the model performance increase to the computational cost. Patented algorithms will neither be rejected nor preferred. The JEG group is aware that the (final) developed model will need to be evaluated regarding the patented parts of the algorithm before it can be commercially exploited. It is expected that more than one party is involved. In this phase, a shared solution is advised, e.g. by forming a patent pool. As it is expected that patent owners outside the group need to be contacted, it is welcomed to also have patented parts of the algorithm owned by members of the group in order to facilitate the negotiations. Please note, that this is the last stage of the project and following the current schedule may be expected after 2012. It was decided on 11th of March 2010 that the topic of patents will only be discussed when there is new relevant information not contained in this text. Marcus Barkowsky: JEG Overview

  10. HRC generation • Overview: • Graphical program to generate a set of shell scripts from templates • Execution of shell scripts, preferably on a distributed system (gridengine) Marcus Barkowsky: JEG Overview

  11. HRC generation – example for encoding • Subdirectory encode_jvt • execute_it.sh • The main shell script to execute • src_filelist.txt • Contains the list of SRC • 0000_start.sh • Contains settings like paths etc. • 0001_foreach_srclist.sh • 0002_convert_avi_to_yuv.sh • 0003_iterate_parameter.sh • Iterates through the QPs • 0004_codec_h264.sh, 0004_template_encoder.cfg • Writes the encoder.cfg and executes the JM encoder Marcus Barkowsky: JEG Overview

  12. HRC generation – example for encoding • src_filelist.txt • lamp_blowup_flower_s1920x1080p25n250v0.avi • lamp_blowup_flower_s1920x1080p25n250v1.avi • rhinevalley576p720x576_fireworks_s1024x576p25n250v0.avi • rhinevalley576p720x576_fireworks_s1024x576p25n250v1.avi • 0000_start.sh • export EVAL_SRCSEQ_ABSDIRECTORY= /home/raid5//sequences_3d/Sequences_left_right_views • export EVAL_EXECUTION_MODE="gridengine" • # export EVAL_EXECUTION_MODE="immediate" • export PATH="`pwd`/../scripts:${PATH}„ • … Marcus Barkowsky: JEG Overview

  13. 0000_start.sh 0001_foreach_srclist.sh …  macroshow1080p_lamp_blowup_flower_s1920x1080p25n250v0  0000_start.sh  0002_convert_avi_to_yuv.sh  dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0.yuv  dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh  dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.e1091 … qp26  0000_start.sh  0004_cache.md5 dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_ip32_qi26_qp26_qb26.264  dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_ip32_qi26_qp26_qb26.yuv  qp26_dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh  qp26_dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.e1162 …  qp30  qp32 … macroshow1080p_lamp_blowup_flower_s1920x1080p25n250v1 macroshow1080p_balloon_dart_drop_s1920x1080p25n250v0 macroshow1080p_balloon_dart_drop_s1920x1080p25n250v1 … Marcus Barkowsky: JEG Overview

  14. HRC generation – additional files programs programs/JM programs/JM/bin programs/JM/bin/ldecod.exe programs/JM/bin/lencod.exe scripts scripts/add_execution_script.sh scripts/eval_error.sh scripts/get_avi_filedata.sh scripts/parse_vqeg_jeg_filenamesyntax.sh scripts/replace_bashstyle_cfgfile.sh Marcus Barkowsky: JEG Overview

  15. Marcus Barkowsky: JEG Overview

  16. 0000_start.sh 0001_foreach_srclist.sh 0002_convert_avi_to_yuv.sh 0003_iterate_parameter.sh 0004_codec_h264.sh 0004_encoder.cfg 0004_template_encoder.cfg execute_it.sh src_filelist.txt + macroshow1080p_lamp_blowup_flower_s1920x1080p25n250v0 + 0000_start.sh + 0002_convert_avi_to_yuv.sh + 0003_iterate_parameter.sh + 0004_codec_h264.sh + 0004_encoder.cfg + 0004_template_encoder.cfg + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0.yuv + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.e1091 + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.e1397 + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.e1677 + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.e696 + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.o1091 + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.o1397 + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.o1677 + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.o696 + + qp26 + + 0000_start.sh + + 0004_cache.md5 + + 0004_codec_h264.sh + + 0004_encoder.cfg + + 0004_template_encoder.cfg + + data.txt + + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_ip32_qi26_qp26_qb26.264 + + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_ip32_qi26_qp26_qb26.yuv + + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_ip32_qi26_qp26_qb26_stat.txt + + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_ip32_qi26_qp26_qb26_stderr.txt + + dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_ip32_qi26_qp26_qb26_stdout.txt + + leakybucketparam.cfg + + log.dat + + qp26_dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh + + qp26_dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.e1162 + + qp26_dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.e867 + + qp26_dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.o1162 + + qp26_dzignlight1080p1920x1080_car_engine_s1920x1080p24n240v0_s_execute_it.sh.o867 + qp30 + qp32 + qp34 + qp36 + qp38 + qp40 + qp44 macroshow1080p_lamp_blowup_flower_s1920x1080p25n250v1 macroshow1080p_balloon_dart_drop_s1920x1080p25n250v0 macroshow1080p_balloon_dart_drop_s1920x1080p25n250v1 Marcus Barkowsky: JEG Overview

  17. Open problems • HRC generation • Automatic network configuration • Graphical user interface • Update and synchronisation of software • Definition of common format for video databases • Search for golden sample video sequences (~10), and silver samples (~100) • HRC checking (and recalibration) programs Marcus Barkowsky: JEG Overview

  18. Virtual Box Image coverage PVS HRC Subjective Experiment SRC PCAP MOS PCAP Parsing HMIX1 Annex-B H.264 Parsing HMIX2 Hybrid Model Training /Validation Objective Score Marcus Barkowsky: JEG Overview

More Related