1 / 18

5C1 – Digital Media Systems

5C1 – Digital Media Systems. Dr. David Corrigan. Aims. What is this course about? Large Focus on Compression (4C8 Part Deux ) We will be looking at some more modern compression standards. H.264/H.265 and VP8/VP9 Focus on evaluating the quality of compressed videos.

simone
Download Presentation

5C1 – Digital Media Systems

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 5C1 – Digital Media Systems Dr. David Corrigan

  2. Aims • What is this course about? • Large Focus on Compression (4C8 Part Deux) • We will be looking at some more modern compression standards. • H.264/H.265 and VP8/VP9 • Focus on evaluating the quality of compressed videos. • Subjective Testing and Objective Metrics

  3. Compression (4C8 Revision !!!) Lossless Lossy Lossless Lossless

  4. Coding Efficiency Qstep = 15

  5. Subjectively Weighted Quantisation

  6. Motion Estimation

  7. Frame 1 Frame 2 Frame 3 Frame 4 P - frame P - frame P - frame I - frame I - frame B - frame P - frame B - frame

  8. Rate-Distortion Curves Decreasing File Size Increasing Quality Improving Performance

  9. Aims • What is this course about? • Large Focus on Compression (4C8 Part Deux) • We will be looking at some more modern compression standards. • H.264/H.265 and VP8/VP9 • Focus on evaluating the quality of compressed videos. • Subjective Testing and Objective Metrics

  10. What is 5c1 about? • Energy Minimisation Frameworks for Solving Complex Image and Video Processing Problems – • Interactive Segmentation

  11. Energy Minimization Frameworks • Alpha Matting

  12. Energy Minimization Frameworks • Mosaicking/Panorama Image Stitching

  13. Energy Minimization Frameworks • Image Editing

  14. What is 5c1 about? • Gaining practical experience in implementing video processing algorithms on an industry platform • Plugin Development for NUKE (C++) • Node-Based Compositor. • Developed in-house by Digital Domain in the 90’s and taken over by the Foundry in ‘07 • Used in all leading post-production companies including WETA, ILM, Digital Domain, Framestore • Used for movies such as Oz, Tron, King Kong, Avatar etc.

  15. What is 5C1 about? • Gaining practical experience in implementing video processing algorithms on an industry platform • Plugin Development for NUKE (C++) • Matlab is good for prototyping but too slow for practical use • C++ code interfaces with the Host API • Imperfect documentation & support, learn by example, figure it out as you go along. • Nuke’s is much simpler compared to Adobe’s API. • Apply principles of Unit Testing and Test Driven Development • Used in industry to spot errors in implementations of complex algorithms. • Allows quick localisation of errors where changes are made at a later date. • Allows bottom up approach to testing.

  16. Lectures and Labs • Two Lecture Slots per week: • Part 1 (a): Image and Video Quality Assessment (Dr. David Corrigan) • Part 1 (b): Advanced Video Compression (Prof. Anil Kokaram) • Part 2: Energy Minimisation Frameworks (Dr. David Corrigan) • Guest Lecturers • Labs – 3 hour slot each week in the printing house • Labs start week 1 • Lectures and Labs are front loaded and should finish before the start of the final assignment.

  17. Assessments (100% CA) • Part 1 (a) • Class Test (10 %) • Nuke plugin assignment (20%) • Part 2 • Class Test (10 %) • Nuke plugin assignment (20%) • Part 1 (b) • Video Coding Lab (10%) • Final Assignment (Parts 1 (a) and 1 (b)) (30 %) • Mini project • 4 page paper

  18. Reading Material • Markov Random Fields for Vision and Image Processing. Edited by A. Blake, P. Kohli and C. Rother, MIT Press, 2011. ISBN: 978-0-262-01577-6 • The Essential Guide to Video Processing. A. Bovik, Academic Press, 2009. ISBN: 978-0-12-374456-2 • The Essential Guide to Image Processing. A. Bovik, Academic Press, 2009. ISBN: 978-0-12-374457-9 There are many other text books on Image and Video Processing and Computer Vision available in the library which you may wish to consult. Google scholar and IEEE Xplore are essential resources for the research papers you will access over the duration of the module. The library also has paper versions of many relevant journals and maintains a list of digital collections for which it has a subscription.

More Related