200 likes | 683 Views
Comparison and Performance Analysis of H.264, AVS-China, VC-1 and Dirac. - by Jennie G. Abraham. EE5359 – Multimedia Processing, Fall 2009 EE Dept., University of Texas at Arlington. Disclaimer.
E N D
Comparison and Performance Analysis of H.264, AVS-China, VC-1 and Dirac - by Jennie G. Abraham EE5359 – Multimedia Processing, Fall 2009 EE Dept., University of Texas at Arlington
Disclaimer This is a proposal; to be used as a roadmap toward fulfilling the objectives of the project as part of course requirement for EE5359 – Multimedia Processing, Fall 2009 This powerpoint is not a comprehensive documentation on the subjects and topics mentioned. - Jennie G Abraham
Outline • Introduction • Multimedia Network • Home Media Ecosystem • Motivation • Project Detail • Example project elements • Architecture Comparison • Design Level Analysis • Feature Comparison • Algorithmic Comparison • Performance Comparison • Expected Outcomes • Project Timeline • References
Introduction • What? • Video compression standards aiming at high quality • Some standards leave the implementation open and only standardize the syntax and the decoder. • Optimization beyond the obvious • Complexity reduction for implementation • Who? • H.264 : ITU-T VCEG together with the ISO/IEC MPEG • AVS China : Audio Video Coding Workgroup of China • VC-1 : developed by Microsoft, released by SMPTE • Dirac : BBC • Why? - Different companies, different countries, different application, royalty fees, better algorithms
Home Media Ecosystem • A case for seamless integration of video coding standards
Motivation • Possibly identify new areas of research Exploit redundancies, develop cross platform applications etc. • Familiarize with the codecs : H.264, AVS China, VC-1, Dirac • Availability of the codecs in MPL @ UTA • Lack of comprehensive documentation for these codecs
Overview of each standard Implementation of each codec Compile and tabulate the developers, timeline of release, royalty/patents Architecture Analysis and Comparison Encoder/Decoder Block Diagram Design Level Analysis and Comparison Profiles levels intended applications for each of the profile/standard Feauture Analysis and Comparison Integer sizes MB sizes Partition sizes Modes Format Algorithmic Element comparison Prediction Motion Vector Precision Transform In Loop filters Entropy coding.. And so on Performance Comparison Bit rate PSNR MSE Compression Complexity ssim Test Sequences Different test sequences Different formats - QCIF/CIF/SD/HDTV Documentation The study and results Codec user manual Project Detail The project is detailed as follows:
Codec Architecture Comparison For Example : H.264 Codec AVS China Codec
Design Level Analysis Example of specific coding parts for H.264 profiles
8x8, 4x8, 8x4, 4x4adaptive block transform • Frequency-independent de-quantization scaling • 4 tap bi-cubic filters for MC • Relatively-simple loop filter • Overlap intra filtering • Range reduction/expansion • Resolution reduction/expansion • 8x8 and 4x4adaptive block transform • Frequency-dependent de-quantization matrix • Long filters for MC • Complex loop filter • Spatial intra prediction • Multi-picture arbitrary-order referencing • Intra PCM Block motion 16-bit integer transforms Bit-exact spec Fading prediction Loop filter Feature Comparison For example: H.264 VC-1 Overlap in feature sets is a major reason why many companies are currently integrating both codecs into the same chip.
Algorithmic Comparison • Example : …. and more of similar comparison
Performance Comparison • Simulation with different test sequences • Bit Rate • Quality • PSNR • MSE • SSIM • Compression Ratio • Complexity • Encoding Time • Decoding
Expected Outcome • The different facet of the project is aimed at bringing out these outcomes…. • Familiarity with these standards • Simulation of the codecs • Modes of Configuration • Modification of Parameters • Input sequence specifications • Analyze the codec output • Identify areas of research and unexplored problems • Document a resourceful detailed ‘how to’ manual on each reference codec • Create a ‘how to’ format to draw on for other softwares available in MPL and future • Efficient use of time and re-use of knowledge
Timeline IMPLEMENTATION: • Project proposal –------------------------------------------------- Oct 1 AVS China Implementation-----------------by Oct 7 Dirac, H.264 –---------------------------------- by Oct 14 VC-1 Implementation ---------------------- by Oct 21 DOCUMENTATION: Tabulation of initial results –------------------------------------ by Oct 28 Interim Report and Presentation ------------------------ Oct 29 Start documentation ---------------------------------- by Oct 31 Submit draft of final report -------------------- Nov 19 Start user manual documentation---- Nov 20 FINAL Final project report and presentation ------------------------- Dec 3
References DIRAC REFERENCES: [1] T. Borer, and T. Davies, “Dirac video compression using open technology”, BBC EBUTechnical Review, July 2005 [2] BBC Research on Dirac: http://www.bbc.co.uk/rd/projects/dirac/index.shtml [3] The Dirac web page: http://dirac.sourceforge.net [4] T. Davies, “The Dirac Algorithm”: http://dirac.sourceforge.net/documentation/algorithm/, 2005. [5] Dirac developer support: Overlapped block-based motion compensation: http://dirac.sourceforge.net/documentation/algorithm/algorithm/toc.htm [6] “Dirac Pro to bolster BBC HD links”: http://www.broadcastnow.co.uk/news/multi-platform/news/dirac-pro-to-bolster-bbc-hd-links/1732462.article [7] Dirac software and source code: http://diracvideo.org/download/dirac-research/ [8] Dirac video codec - A programmer's guide: http://dirac.sourceforge.net/documentation/code/programmers_guide/toc.htm [9] Daubechies wavelet: http://en.wikipedia.org/wiki/Daubechies_wavelet [10] Daubechies wavelet filter design: http://cnx.org/content/m11159/latest/ [11] Dirac developer support: Wavelet transform: http://dirac.sourceforge.net/documentation/algorithm/algorithm/wlt_transform.xht [12] Dirac developer support: RDO motion estimation metric: http://dirac.sourceforge.net/documentation/algorithm/algorithm/rdo_mot_est.xht
H.264 REFERENCES: [13] T.Wiegand, et al “Overview of the H.264/AVC video coding standard”, IEEE Trans. on Circuit and Systems for Video Technology, Vol.13, pp 560-576, July 2003. [14] T. Wiegand and G. J. Sullivan, “The H.264 video coding standard”, IEEE Signal Processing Magazine, vol. 24, pp. 148-153, March 2007. [15] D. Marpe, T. Wiegand and G. J. Sullivan, “The H.264/MPEG-4 AVC standard and its applications”, IEEE Communications Magazine, vol. 44, pp. 134-143, Aug. 2006. [16] S.K.Kwon, A.Tamhankar and K.R.Rao, “Overview of H.264 / MPEG-4 Part 10” J. Visual Communication and Image Representation, Vol 17, pp.186-216, April 2006. [17] A. Puri, X. Chen and A. Luthra, “Video coding using the H.264/MPEG-4 AVC compression standard”, Signal Processing: Image Communication, vol. 19, pp. 793-849, Oct. 2004 [18] H.264 AVC JM software: http://iphome.hhi.de/suehring/tml/ [19] H.264/MPEG-4 AVC: http://en.wikipedia.org/wiki/H.264 [20] M.Fieldler, “Implementation of basic H.264/AVC Decoder”, seminar paper at Chemnitz University of Technology, June 2004 [21] H.264 encoder and decoder: http://www.adalta.it/Pages/407/266881_266881.jpg [22] R. Schäfer, T. Wiegand and H. Schwarz, “The emerging H.264/AVC standard”, EBUTechnical Review, Jan. 2003. [23] H.264 reference software download : http://iphome.hhi.de/suehring/tml/ [24] D. Marpe, T. Wiegand, and S. Gordon, "H.264/mpeg4-avc fidelity range extensions: tools, profiles, performance, and application areas," in, IEEE International Conference on Image Processing, vol. 1, pp. I-593-6, 2005. [25] S. Saponara, C. Blanch, K. Denolf, and J. Bormans, "The JVT advanced video coding standard: complexity and performance analysis on a tool-by-tool basis," in Packet Video Workshop, Nantes, France, April 2003.
VC-1 REFERENCES: [26] VC-1 technical overview - http://www.microsoft.com/windows/windowsmedia/howto/articles/vc1techoverview.aspx [27] Microsoft Windows Media: http://www.microsoft.com/windows/windowsmedia [28] http://en.wikipedia.org/wiki/VC-1 [29] Sridhar Srinivasan, et al, “Windows Media Video 9: overview and applications”, Signal Processing: Image Communication, Volume 19, Issue 9, October 2004, Pages 851-875 AVS CHINA REFERENCES: [31] AVS Video Expert Group, “Information technology – Advanced coding of audio and video – Part 2: Video (AVS1-P2 JQP FCD 1.0),” Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1538, Sep. 2008. [32] AVS Video Expert Group, “Information technology – Advanced coding of audio and video – Part 3: Audio,” Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1551, Sep. 2008. [33] Lu Yu et al., “Overview of AVS-Video: Tools, performance and complexity,” SPIE VCIP, vol. 5960, pp. 596021-1~ 596021-12, Beijing, China, July 2005. [34] Liang Fan, Siwei Ma and Feng Wu, “Overview of AVS video standard,” IEEE Int’l Conf. on Multimedia and Expo, ICME '04, vol. 1, pp. 423–426, Taipei, Taiwan, June 2004. [35] Wen Gao et al., “AVS – The Chinese next-generation video coding standard,” National Association of Broadcasters, Las Vegas, 2004. [36] Special issue on 'AVS and its Applications' Signal Processing: Image Communication, vol. 24,pp. 245-344, April 2009. [37] AVS China software : ftp://159.226.42.57/public/avs_doc/avs_software
PERFORMANCE COMPARISON REFERENCES: [38] K. Onthriar, K. K. Loo and Z. Xue, “Performance comparison of emerging Dirac video codec with H.264/AVC”, IEEE International Conference on Digital Telecommunications, Vol. 06, Page: 22, Issue: 29-31, Aug. 2006. [39] X. Wang, D. Zhao "Performance comparison of AVS and H.264/AVC video coding standards" J. of computer science and technology, May 2006, Vol. 21, No. 3, pp. 310-314 [40] Comparison of H.264 and VC-1:http://en.wikipedia.org/wiki/Comparison_of_H.264_and_VC-1 [41] Alejandro A. Ramirez Acosta, et al. "MPEG-4 AVC/H.264 and VC-1 codecs comparison used in IPTV video streaming technology," Electronics, Robotics and Automotive Mechanics Conference, 2008, pp.122-126 [42] Comparison between AVC/H.264, VC-1 and MPEG-2 - http://www.ebu.ch/en/technical/trev/trev_302-sunna.pdf [43] H. Kalva, J.B Lee, “The VC-1 and H.264 video compression standards for broadband video Services”, Springer, 2008 SSIM REFERENCES: [44] Z. Wang, et al “Image quality assessment: From error visibility to structural similarity”, IEEE Trans. on Image Processing, vol. 13, pp. 600-612, Apr. 2004. [45] SSIM index for image quality assessment: http://www.ece.uwaterloo.ca/~z70wang/research/ssim/ [46] Z. Wang, et al“Multi-scale structural similarity for image quality assessment,” IEEE Asilomar Conference on Signals, Systems and Computers, Nov. 2003. [47] SSIM: http://en.wikipedia.org/wiki/SSIM VIDEO TEST SEQUENCES: [48] Video test sequences (YUV 4:2:0): http://trace.eas.asu.edu/yuv/index.html [49] Video test sequences ITU601: http://www.cipr.rpi.edu/resource/sequences/itu601.html