“3D test activities in MPEG”

1. “3D test activities in MPEG” Vittorio Baroncini Fondazione Ugo Bordoni Rome Italy Vittorio Baroncini VQEG - June 2011

2. 3DV • 3 D Video for multi - view source material • Compression • Stereo views synthesis from: • 2 views • 3 views • 3D active display • Auto - stereo display Vittorio Baroncini VQEG - June 2011

3. Schedule 2011/01/28: Draft Call for Proposals (public) 2011/03/25: Final Call for Proposals 2011/03/25: Formal registration opens 2011/06/15: Formal registration period ends 2011/09/01: Test material @ test sites 2011/10/01: Subjective test starts 2011/11/21: Data processing and report 2011/11/26: Results to 98th MPEG meeting Vittorio Baroncini VQEG - June 2011

4. Video data sets Video data sets have: • Linear camera arrangement & rectified • Progressively scanned • 4:2:0 color sampling (8 bits per sample) • Depth data, Camera parameters for view synthesis and rendering are provided • Depth maps have the same pixel resolution and bit - depth as the video data • Other depth maps NOT permitted as additional input to the encoder Vittorio Baroncini VQEG - June 2011

5. Source video material (preliminary) Test Classes Class A:(1920x1088, progressive, 25fps)"Poznan_Street", "Poznan_Hall2", "Undo_Dancer", "GT_Fly" Class C:(1024x768, progressive, 30fps)"Kendo", "Balloons", "Lovebird1", “Newspaper" Vittorio Baroncini VQEG - June 2011

6. Test Scenarios and Categories Test Scenarios 2 - view: refers to the 2 - view input configuration 3 - view: refers to the 3 - view input configuration Test Categories AVC - Compatible:submissions in which the compressed data format satisfy the requirement on forward compatibility with AVC [5] HEVC - Compatible & Unconstrained:submissions in which the compressed data formats satisfy the requirement on forward compatibility with HEVC, or …submissions without any compatibility constraints Submissions • either or both of the test categories. • for each test category: all test classes and test scenarios for all rate points Vittorio Baroncini VQEG - June 2011

7. Coding conditions AVC - compatible Vittorio Baroncini VQEG - June 2011

8. Coding conditions HEVC - compatible & unconstrained Vittorio Baroncini VQEG - June 2011

9. Input Views Vittorio Baroncini VQEG - June 2011

10. Ouput data(synthesized output views from 2 view) Vittorio Baroncini VQEG - June 2011

11. Ouput data(synthesized output views from 3 view) Vittorio Baroncini VQEG - June 2011

12. Ouput data(synthesized output views from 3 view) Vittorio Baroncini VQEG - June 2011

13. Coded test material submission Deadline: 2011 Sept. 1 (17:00 CET) Files to be provided: • Bitstreams • Decoded and synthesized sequences • Binary decoder executable. • Checksum files Vittorio Baroncini VQEG - June 2011

14. Decoded and synthesized sequences • 33 views for S01-S06 • 49 views for S07-S08 • 2-view test scenario (stereo display):package the stereo pair as a single AVI file (separate YUV files must be provided) • 3-view test scenario (stereo display):(separate YUV files must be provided) one fixed stereo pair and one randomly selected stereo pair will be evaluated • fixed stereo pair: centre stereo pair • randomly selected stereo pair: (test coordinator) • selection of the stereo pair • production of the AVI file (from the provided YUV files) • 3-view test scenario (auto-stereo display):test facilities will package 28 views from the provided views Vittorio Baroncini VQEG - June 2011

15. Logistics 2 - view case requires for each test point Output = 6 files for each test point • 3 video files • 3 depth maps • 1 stereo AVI file 3 - view case requires for each test point Output = 21 files for each test point • 17 (views) YUV video files • 3 depth maps • 1 stereo AVI file Another stereo AVI file is derived from two synthesized files after a random selection of the centre view Vittorio Baroncini VQEG - June 2011

16. SRC video material 2 view: original views are available Source stereo AVI file can be produced 3 - view: views are all synthesized Source stereo AVI file cannot be produced Solution: SRC AVI files: non compressed synthesized (or original) input files Vittorio Baroncini VQEG - June 2011

17. Test method Stereo SRC video files available: Double Stimulus (RCR) test method Stereo SRC video files not available : Single Stimulus (ACR) test method VQEG activity shows that SS methods provide similar results compared to DS methods Time and resources Vittorio Baroncini VQEG - June 2011

18. Video test player Window Media Player (old version) Simple scripts Video clips with messages Shift parameters: t.b.d. Vittorio Baroncini VQEG - June 2011

19. Display • Stereo monitor: Hyundai 46” (passive glasses) Model: S465D • Auto-stereo monitor:Dimenco 52” (no glasses)Model: BDL5231V3D Vittorio Baroncini VQEG - June 2011

20. Subjects & results reliability • Pre - screening • Stereo vision check • Fatigue measurement • Possible solutions: • Involve many laboratories • Few test sessions for each laboratory • Redundant sessions Vittorio Baroncini VQEG - June 2011

21. Independent Laboratory Group • Three areas (Region 1, 2 and 3) • Two/three laboratories for each Region • Current support received from: • Region 1: UBC, CRC • Region 2: EPFL, ACREO, Nantes, TUM, … • Region 3: Yonsei • Volunteers welcome … Vittorio Baroncini VQEG - June 2011

22. So what … What MPEG offers • Become member of the ILG • Get a (modest) financial support What MPEG needs • your experience testing “best practice” • which could be the best test method? • support in logistics • test site features and availability • 3D “test oriented” player Vittorio Baroncini VQEG - June 2011