1 / 19

Video Subgroup Report Friday Plenary 76 th MPEG Meeting, Montreux

Video Subgroup Report Friday Plenary 76 th MPEG Meeting, Montreux. Co-Chairs: Jens-Rainer Ohm, Gary Sullivan MPEG-7 Visual: Miroslaw Bober. New Colour Spaces. Support for new wide-gamut color spaces (and more aspect ratios in case of AVC) Text of ISO/IEC 13818-2:2000/FPDAM 2 ( N8006 )

madge
Download Presentation

Video Subgroup Report Friday Plenary 76 th MPEG Meeting, Montreux

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Video Subgroup ReportFriday Plenary76th MPEG Meeting, Montreux Co-Chairs: Jens-Rainer Ohm, Gary Sullivan MPEG-7 Visual: Miroslaw Bober

  2. New Colour Spaces • Support for new wide-gamut color spaces (and more aspect ratios in case of AVC) • Text of ISO/IEC 13818-2:2000/FPDAM 2(N8006) • Text of ISO/IEC 14496-2:2004/FPDAM 3 (N8007) • Text of ISO/IEC 14496-10:2006/FPDAM 1 (N8010) • All in very good shape (not any comments in ballot votes)

  3. AVC + SVC • Video SG approved documents produced by JVT • Text of ISO/IEC 14496-10:2006/COR 2 + DoC (N8009/N8008) • Study Text of ISO/IEC 14496-10:2006/PDAM 3 Scalable Video Coding(N8014) • Joint Scalable Video Model (JSVM) 6(N8015) • JSVM 6 Software(N8016) • SVC adoptions • Simplification and improvements of FGS • Interlaced tools • Simplified color upsampling • Simplified upsampling position calculation • Various high-level syntax issues

  4. Multiview Video Coding - CE • Description of Core Experiments in Multiview Video Coding (N8019) • CE1: View-temporal prediction structures • CE2: Illumination compensation • CE3: View interpolation prediction • CE4: Disparity vector prediction • CE6: Improved de-blocking filter (new) • All performed on basis of JSVM software • >15 participating companies and universities

  5. Multiview Video Coding - AVC • Technology under Study for Buffer Management and High-level Syntax in Multiview Video Coding (N8018) • Software provided for further study • Request for 14496-10:2006/Amd.4 Multiview Video Coding (N8017) • Timeline: WD 06-07, PDAM 07-01, FPDAM 07-07, FDAM 08-01 • Continuation of work within JVT appears most reasonable and is desired by participants

  6. MPEG-7: Key work items • New technology for Version 3 – Core Experiments • MAF Photo Player work • Some Extensions: support for metadata only item • Metadata organisation and linking • Schema • Study of CD • Joint meetings with Requirements • CB search • MAF’s under consideration • Joint meeting with MDS – linking mechanisms • Preparation of the Output documents

  7. Seriesof CE’s Visual tools and DS for image or photo- libraries • Objectives: to develop new visual Description Schemes and other algorithms for use with digital image libraries, such as personal collections of photos from digital cameras. • Functionalities: • Situation/view based image clustering • Categorisation into broad classes, such as Beach/Sea/River/Indoors. (classes to be determined) • Subject-Face-based automatic annotation • Search for copies or modifications of an image/photo using visual identifiers (signatures) • Multi-shot detection. Detection of multiple similar shots (signatures) • Query by example • Query by sketch (from memory) • Query/search based on objects, such as “my dog” or “my car” • Retrieval by objects present (more generic that 7, any object)

  8. Core Experiments – new technology for Visual Version 3 • VCE-3 on person identity-based photo classification Objectives: to evaluate and improve performance of the identity-based clustering on typical family photos (using existing tools) • VCE-4 – Robust Face Recognition technology This CE shall explore what technologies, if any, are superior to the current AFRD, especially in the context of recognition of facial images in video content and images acquired with digital cameras. The main focus is on robustness to significant variations in pose, illumination and facial expression.

  9. Core Experiments – new technology for Visual Version 3 • VCE-5 – Evaluation of MPEG-7 Face Recognition Technology on IR Images IR visual data is becoming more widely used in many applications, such as surveillance video or medical images. We will asses the performance of the existing MPEG tools on this type of data. • VCE-6 Visual Identifiers This CE shall explore what technologies, if any, are superior to the current MPEG-7 visual descriptors, for the task of identifying original images and their modified versions (Visual Identifies or Fingerprints)

  10. MAFPhoto Player • Implemented all NB ballot comments • Significant improvements to the specification text • Schemas completed (item-level and collection-level) • Now supports metadata only Photo player files (link to external data) • Solved Collection-level metadata and Item-level metadata organisation in the file an linking (maybe merged into a single schema) • We would like to support both BIM-based and bitstream-level defined binarisation • PP MAF document to include also conformance and software • Software development plan defined

  11. MPEG-7 Visual Output Documents (I) • Defect Report on ISO/IEC 15938-3/Amd.1(N8020) • MPEG-7 Visual XM Document version 28.0(N8021) • Description of Core Experiments for MPEG-7 New Visual Extensions(N8022) • Defect Report on ISO/IEC 15938-6/Amd.1(N8023) • Request for ISO/IEC 15938-6/Amd.2 (Perceptual 3D Shape)(N8024) • Working Draft of ISO/IEC 15938-6/Amd.2 (Perceptual 3D Shape)(N8025) • Request for ISO/IEC 15938-7/Amd.3 (Perceptual 3D Shape) (N8026) • Working Draft of ISO/IEC 15938-7/Amd.3 (Perceptual 3D Shape) (N8027)

  12. MPEG-7 Visual Output Documents (II) • Study Text of ISO/IEC TR 15938-8:2002/DAM2(N8028) • Request for ISO/IEC TR 15938-8/Amd.3 (Technologies for digital photo management using MPEG-7 visual tools)(N8029) • Working Draft version 1.0 of ISO/IEC TR 15938-8/Amd.3(N8030) • Dispositions of Comments on ISO/IEC CD 23000-3(N8031) • Text of ISO/IEC FCD 23000-3(N8032) • Reference Software for ISO/IEC 23000-3: Development Workplan(N8033)

  13. 23002-2 Fixed-Point DCT/IDCT • Good work on establishing software testbed and defining test scenarios • Evaluation process turns out to be more difficult than expected, because different proposals fulfill different criteria differently well – Requirements t.b.c. • No new version of WD • Description of Core Experiments in Fixed-point DCT/IDCT (N8035) • Software Testbed for fixed-point DCT/IDCT V 3.0 (N8036)

  14. 23002-3 Auxiliary Video Data Representation • Request for Subdivision: 23002-3 Auxiliary Video Data Representation (N8037) • Text of ISO/IEC CD 23002-3 Auxiliary Video Data Representation (N8038) • Encoding of pixel-related data by using conventional video codecs • Currently, two types (disparity and parallax maps) supported, extensible • White Paper: Auxiliary Video Data Representation (N8039)

  15. Reconfigurable Video Coding • Call for Proposals on Reconfigurable Video Coding • Description languages and tools that allow definition of decoder configurations • Accessing library of video coding tools • Accompanied by 3 documents • Study of Reconfigurable Video Coding V2.0 (N8040) • Textual Description of Reconfigurable Video Coding V2.0 (N8041) • Software of Reconfigurable Video Coding V2.0 (N8042)

  16. Extended Decoder Description Bit - stream Decoder Decoder MUX Description RVC codec RVC : Use Case & Concept

  17. Wavelet Video Coding Exploration • Status Report on Wavelet Video Coding Exploration (N8043) with visual tests indicating • Combined scalability (spatial/temporal/SNR): Significantly worse performance than JSVM • Standalone SNR scalability: Comparable / slightly worse performance than JSVM • Combined scalability is mandatory requirement for universally scalable codecs • Currently, no application scenario is evident where WVC would be advantageous over emerging AVC-SVC standard

  18. Wavelet Video Coding Exploration • Resolution: “Considering the visual performance results reported in N8043, the video subgroup has come to the conclusion that wavelet video coding solutions currently are not mature enough to be considered for standardization in scalable video coding. It is therefore recommended to discontinue the exploration on wavelet video coding at this time. The video subgroup encourages future contributions showing evidence about the usefulness of wavelet video coding in any standardization framework.”

  19. AHGs recommended by Video • AHG on Video IDCT Specification(N8044) • AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance(N8045) • AHG on Multiview Video Coding (N8046) • AHG on Reconfigurable Video Coding (N8047) • AHG on Maintenance of MPEG-7 Visual related Documents, Reference Software and Conformance(N8048) • AHG on MPEG-7 Visual and Photo Player MAF (N8049)

More Related