110 likes | 221 Views
JEG Project: Overview of Ad-Hoc Group. Marcus Barkowsky, Nicolas Staelens, Yves Dhondt, Lucjan Janowski, Ulrich Engelke, Marie-Neige Garcia, Savvas Argyropoulos. Objectives. From SRC to Bitstream-PVS HRC Generation toolchain HRC Validation From Bitstream-PVS to Hybrid Model input
E N D
JEG Project: Overview of Ad-Hoc Group Marcus Barkowsky, Nicolas Staelens, Yves Dhondt, Lucjan Janowski, Ulrich Engelke, Marie-Neige Garcia, Savvas Argyropoulos
Objectives • From SRC to Bitstream-PVS • HRC Generation toolchain • HRC Validation • From Bitstream-PVS to Hybrid Model input • Hybrid model input format • Tools for generating the Hybrid Model input format • Towards Hybrid Model development • Hybrid model structure and framework • Hybrid model performance evaluation Marcus Barkowsky: JEG Overview
Overview PVS HRC Subjective Experiment SRC PCAP MOS Hybrid Model Training /Validation Objective Score Marcus Barkowsky: JEG Overview
Improvement • Disadvantage of PCAP as input to Hybrid Model • Difficult to parse because of different formats for • Transmission protocols • Multiplex • Encoders • Flexibility achieved by Hybrid Model Input Format • XML structure • Contains mandatory and optional fields • Independent of Protocols Marcus Barkowsky: JEG Overview
Overview PVS HRC Subjective Experiment SRC PCAP MOS HMIX extractor HMIX Hybrid Model Training /Validation Objective Score Marcus Barkowsky: JEG Overview
Overview PVS HRC Subjective Experiment SRC PCAP MOS PCAP Parsing HMIX1 Annex-B H.264 Parsing HMIX2 Hybrid Model Training /Validation Objective Score Marcus Barkowsky: JEG Overview
Common working system • Easy installation and portability • Everything inside a VirtualBox Installation of „Computer“ within 5 minutes • Linux operating system to avoid licensing issues • All necessary video/image tools included • Data is stored on the host system • Purpose • HRC generation • graphical user interface • common scenarios predefined • easy distribution of work over a set of computers • HMIX generation • Hybrid model execution • Training • Evaluation of model performance Marcus Barkowsky: JEG Overview
Virtual Box Image coverage PVS HRC Subjective Experiment SRC PCAP MOS PCAP Parsing HMIX1 Annex-B H.264 Parsing HMIX2 Hybrid Model Training /Validation Objective Score Marcus Barkowsky: JEG Overview
Individual presentations • Nicolas: HRC generation system • Lucjan: Generation of Annex-B and HMIX1 from PCAP • Nicolas: Generation of HMIX2 from Annex-B • Savvas, Marcus: Overview of a hybrid model Marcus Barkowsky: JEG Overview
Open problems • Software development for the Hybrid model: • Advantages of common data format • Free choice of programming language for each lab • Non-open-source program parts possible • No software coordinator necessary • Implicit caching structure • Advantages of a common source code • Easy to apply to images • The reference software may become normative Marcus Barkowsky: JEG Overview
Open problems • HRC generation • Automatic network configuration • Graphical user interface • Update and synchronisation of software • Definition of common format for video databases • Search for golden sample video sequences (~10), and silver samples (~100) • HRC checking (and recalibration) programs Marcus Barkowsky: JEG Overview