210 likes | 310 Views
62 nd MPEG Meeting Shanghai, 21.-25.10. 2002. Jens-Rainer Ohm RWTH Aachen, Institute of Communication Engineering (slides partially provided by Andreas Hutter, Siemens CT). JVT (ITU/MPEG Joint Video Team) – Geneva meeting 1 week before MPEG.
E N D
62nd MPEG MeetingShanghai, 21.-25.10. 2002 Jens-Rainer Ohm RWTH Aachen, Institute of Communication Engineering (slides partially provided by Andreas Hutter, Siemens CT)
JVT (ITU/MPEG Joint Video Team) – Geneva meeting 1 week before MPEG • Common text as ITU-T Rec. H.264 and ISO/IEC 14496-10 (AVC) • Final Committee Draft under ballot (FCD 07 / 2002, final: 12 / 2002) • Cleanup of technology going on (ABT skipped; CABAC, MAFF (interlace) and others need improvement of specification) • 3 Profiles and several levels each defined: • Baseline (now w/o Interlace) • Main (TV): B-Frames, CABAC, ..., • Profile X (Streaming): w/ data partitioning, S/P frames, B-frames, ... • Discussions on licensing and patent pool (two groups) • MPEG-LA and others • Polycom and others • Work on File Format, RTP Payload Format, MPEG-2 Transport • Phase 2 unclear
AVC testing, new test sequences • New HD test sequences (N5125) • 720p usage for any standardization purposes • 1080i for AVC testing only • Draft verification test plan (N5124) • includes concrete schedule to have first results with selected sequences available in Awaji
MPEG-1 Video • MPEG-1 • Request for 11172-2:1993 Cor.3 (N5155) • 11172-2:1993 DCOR3 (N5156) • Miscellaneous items, mainly in Annex D • Correction of 2D DCT equation • Correction of 2 errors in VLC code tables • Clarification of ambiguous formulations and wrong references
MPEG-4 Visual (part 2) • 14496-2:2001 DCOR2 DoC (N5157) • 14496-2:2001 COR2 (N5158) • Corrects and clarifies miscellaneous items in • 14496-2:2001 • 14496-2:2001 Amd.1 (Studio Profiles) • 14496-2:2001 Amd.2 (Streaming Video Profiles FGS) • includes changes due to NB comments relating to the last meeting's Study of DCOR • Planned to incorporate these changes in next year's new edition along with all amendments
MPEG-4 Visual (part 2) • 14496-2:2001 FDAM3 (N5159) • "New Levels and tools" • Accompanied by software 14496-5:2001 FPDAM3 • Conformance FPDAM expected for next meeting • WD 2.0 on Error Resilience in Scalable Enhancement Layer (N5160) • Industry support has been shown • All PDAMs expected for next meeting: Normative Text, Software, Conformance • MPEG-4 Visual List of Problems reported (N5161)
MPEG-4 Optimized Reference Software • Request for 14496-7 PDAM1 (N5162) • Text of 14496-7 PDAM1 (N5163) • Optimized Software for Simple Profile • Fast encoding and decoding software • Optimized Software for Error Resilience Tools • Error resilience and concealment processing at the decoder with much more functionality as compared to 14496-5 reference software • Input received on optimized motion estimation for AVC – to be further discussed with JVT
MPEG-4 Visual maintenance • New edition of Visual part planned for March 2003 • Plan for upcoming software bug fixing has been developed based on 'Problems Report' • More support for maintenance of MPEG-4 Visual Conformance is needed • Resources of Video Subgroup are limited • Input from M4IF is highly welcome
MPEG-7 Visual • Work towards Version 2 going on • PDAM planned for December • Prospective technology: • Color Temperature Descriptor • Illumination invariant Color Descriptor • Shape Sequence Descriptor • Face Recognition Descriptor • Time Sequence Container • Visual-only Description Scheme(s)
Video Explorations – Scalable Coding • MCTF-Wavelet (Motion Compensated Temporal Filtered Wavelet) - quality near AVC-codec • Decision to merge Interframe Wavelet and Scalable Coding AHG activities • Not much interest in 'Advanced FGS' any more • Breakout group has worked on • Draft Testing Procedures for Evidence of Scalable Video Coding Technology (N5167) • Description of Exploration Experiments in Scalable Video Coding (N5168) • Applications and Requirements of Scalable Video Coding (N5242)
Video Explorations – Scalable Coding • Test bed for media streaming experimentation is donated by NCTU and planned to be available before Awaji (N5260) • Draft testing Procedures • Test Suite A: Behaviour of scalable coding in a network environment • Related to experimentation in the context of the test bed • Test Suite B: Coding Efficiency of Scalable Coding • Defines ranges of spatial/temporal scalability levels and rates • Formats ranging from QCIF to HD
Video Explorations – Scalable Coding • Exploration Experiments defined with emphasis on methods to explore the value of scalable technology • EE1: Comparison methodology for scalable coding • EE2: Combined SNR/spatial/temporal scalability • EE3: Testing of scalable coding under various network conditions • EE4: Exploration experiments on interframe wavelet coding
Video Explorations - 3D AV Coding • Breakout group has worked on • Description of Exploration Experiments in 3DAV (N5169) • Status of Exploration on 3DAV (N5170) • Experiments re-defined to achieve more clear evidence on the value of each technology • Definition of unified test material started • Definition of quality measures one important goal of the experiments
Video Explorations - 3D AV Coding • EE1: Evaluation of usage of mesh objects for omni-directional video • Explore best method for data representation • EE2: Free viewpoint video • Explore benefits of generic approach for viewpoint adaptation from arbitrary number of camera views • EE3: Stereoscopic video coding using MAC • Explore benefits of disparity-compensated coding • EE4: Depth/disparity coding for 3D-TV • Explore benefits of simple viewpoint adaptation based on stereo video and depth/disparity
Video Explorations – Digital Cinema • Main topic presently is definition of test procedures and test material • New test paradigm: Visual lossless quality • Tentative plan for new test in 2003
MPEG Audio • MPEG-4 BWE (Bandwidth Extension to AAC) • FCD under ballot • MPEG-2 Part 7 Amd on embedding BWE (FCD under ballot) • MPEG-4 Parametric Coding (status: still immature) • MPEG-7 Audio V.2 (FCD status) and V.3 (WD status) • Lossless coding as new work item: • Requirements settled and CfP issued • MPEG-21 Adaptation • Work started on: User Characteristics, User Preference, Audible natural environment Description, Audio terminal capabilities
MPEG-2 Systems • Amd on Metadata over MPEG-2 TS completed • New Part 11 on MPEG-2 IPMP (FCD under ballot)& necessary Amd in part 1 (FCD under ballot) MPEG-4 Systems • New organisation of File Format specifications • ISO File Format (Base) , MP4 FF, JPG2K FF in separate parts • MUW & AFX FCD under ballot • Advanced Text and Graphics: • Streamed Text (CE phase) • Font representation and font compression (CfP)
MPEG-7 Systems & General • MPEG-7 Systems V2 (XML Compression & Transport): • improved compression, referncing, multiple streams, schema coding • MPEG-7 Visual V2: • e.g. face recognition: still improvements • MPEG-7 MDS V.2 (FCD status) • Profiles: Approach now defined using restrictions on types, occurrences • Increasing interest in interoperability of Metadata: MXF as driver, also check w/ 3GPP
MPEG-21: Current Status • Overview and Concept: • Part 1 - Technical Report: V.1 completed, V.2 started • Part 2 - DI Declaration and Part 3- DI Identification : completed • Progress on Reference SW • IPMP: • Part 4 - IPMP Architecture: re-issued as WD • RDD CD under ballot (final: 07 /2003) • REL CD issued (final: 07 /2003) • Persistent Association of DI and Information: Requirements collected and TR inpreparation • DI Adaptation • Working Draft (planned CD in 12 / 2002, final: 12/2003) • Other work: DI Processing (Draft CfP status) and Event Reporting
MPEG-21- The integrated view Client / Receiver Server / Sender MM Content MPEG-1/2/4 Decoder MPEG-1/2/4 Encoder MM-Data Communication Filtering and Search MPEG7 Content Description (XML) MPEG7 Content Description (XML) MPEG-7 Decoder MPEG-7 Encoder MPEG-7 Communication MPEG21 Product Structure and Licensing MPEG21 Usage Info Licensing / Protection Tools MPEG-21 Decoder MPEG-21 Encoder MPEG-21 Communication