1 / 34

EE 5359 MULTIMEDIA PROCESSING FINAL PROJECT PRESENTATION

EE 5359 MULTIMEDIA PROCESSING FINAL PROJECT PRESENTATION. STUDY AND IMPLEMENTATION OF PARALLELING TECHNIQUES IN HEVC. Unde r the guidance of Dr. K. R. Rao. By: Karthik Suresh (1000880819). Objective.

chandra-vaikunth
Download Presentation

EE 5359 MULTIMEDIA PROCESSING FINAL PROJECT PRESENTATION

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EE 5359 MULTIMEDIA PROCESSINGFINAL PROJECT PRESENTATION STUDY AND IMPLEMENTATION OF PARALLELING TECHNIQUES IN HEVC Under the guidance of Dr. K. R. Rao By: Karthik Suresh (1000880819)

  2. Objective The main intent of the project is to observe the impact of parallelization in video coding. Firstly, comparison is done between H.264 and HEVC using two standard test sequences. The main observation is the total encoding time taken. Then, the WaveFrontSynchro parameter and Fastsearch parameter is changed to observe the change in encoding time.

  3. Parametersconsidered • WaveFrontSynchro: WaveFrontSynchro causes the changes to the bitstream (entry points on each row, with cabac flushes), to allow those aspects of wavefrontcoding to be assessed for quality, bitrate etc. • FastSearch: This parameter is present in the Motion Search set. When set to 1, it uses TZ Search. If it is 0, it uses Full search algorithm.

  4. Config file #=========== Motion Search ============= FastSearch: 1 # 0:Full search 1:TZ search SearchRange: 64 # (0: Search range is a Full frame) HadamardME: 1 # Use of hadamard measure for fractional ME FEN : 1 # Fast encoder decision FDM : 1 # Fast Decision for Merge RD cost #============ WaveFront ================ WaveFrontSynchro : 0 # 0: No WaveFrontsynchronisation (WaveFrontSubstreams must be 1 in this case). # >0: WaveFrontsynchronises with the LCU above and to the right by this many LCUs.

  5. Test sequences used BasketballDrill_832x480_50.yuv

  6. Test sequences used RaceHorses_416x240_30.yuv

  7. Test sequences used BQSquare_416x240_60.yuv

  8. Test sequences used Kimono_1920x1080_60.yuv

  9. Test sequences used KristenAndSara_1280x720_60.yuv

  10. Test Conditions • Initially the test sequences are encoded with H.264 and H.265 to compare the metrics. • Metrics considered are PSNR, bitrate, encoding time. • QP is varied from 22 to 37 in steps of 5. • 20 frames are encoded in each of the sequences.

  11. Results obtained

  12. Results obtained

  13. Comparison Graph

  14. Comparison Graph

  15. Comparison Graph

  16. Comparison Graph

  17. Result obtained

  18. TZ Search Flowchart

  19. Comparison Graph

  20. Comparison Graph

  21. Comparison Graph

  22. Comparison Graph

  23. Tabulation Parameter legend: 0 -> WaveFrontSynchro = 0 1 -> WaveFrontSynchro = 1 2 -> WaveFrontSynchro = 4

  24. Tabulation Parameter legend: 0 -> WaveFrontSynchro = 0 1 -> WaveFrontSynchro = 1 2 -> WaveFrontSynchro = 4

  25. Tabulation Parameter legend: 0 -> WaveFrontSynchro = 0 1 -> WaveFrontSynchro = 1 2 -> WaveFrontSynchro = 2 3 -> WaveFrontSynchro = 4

  26. Tabulation Parameter legend: 0 -> WaveFrontSynchro = 0 1 -> WaveFrontSynchro = 1 2 -> WaveFrontSynchro = 2 3 -> WaveFrontSynchro = 4

  27. Tabulation Parameter legend: 0 -> WaveFrontSynchro = 0 1 -> WaveFrontSynchro = 1 2 -> WaveFrontSynchro = 2 3 -> WaveFrontSynchro = 4

  28. Conclusion & Future work • Comparison between HEVC and H.264 clearly shows us the improvements in encoding times and the respective PSNRs and bitrates for defined QPs. • By modifying the WaveFrontSynchro and Fast Search parameter, we observe the changes is encoding time. • Comparison between TZ search and Full search shows that Full search is extensive and takes more computation time than TZ search. We observe that there are no changes in bitrate or PSNR while these are compared. • Future work would be to investigate the positive and negative impacts of the modifications in WaveFrontSynchro and Fast Search parameters and understanding of its working to further improve the encoding time.

  29. References • [1] G.J. Sullivan et al, “Overview of the high efficiency video coding (HEVC) standard”, IEEE Trans. CSVT, vol. 22,pp.1649-1668, Dec.2012. • [2] C.C.Chi et al, “Parallel scalability and efficiency of HEVC parallelization approaches”, IEEE Trans. CSVT, vol. 22, pp.1827-1838, Dec.2012. • [3] M.A.Mesa, et al., "Parallel video decoding in the emerging HEVC standard“, ICASSP 2012, pp. 1545 - 1548, March 2012. • [4] Intel tutorial on OpenMP https://www.youtube.com/watch?v=FQ1k_YpyG_A&list=SPLX-Q6B8xqZ8n8bwjGdzBJ25X2utwnoEG.

  30. References (contd) • [5] Ngai-Man Cheung, et al., "Video coding on multicore graphics processors", Signal Processing Magazine IEEE, Vol 27 Issue 2, pp. 79 - 89, March 2010. • [6] Thesis by SudeepGangavati on Complexity reduction of H.264 using parallel programming. http://www-ee.uta.edu/Dip/Courses/EE5359/index.html • [7] Project by Valay Shah on Study and optimization of Deblocking filter in H.265 and its advantages over H.246/AVC. http://www-ee.uta.edu/Dip/Courses/EE5359/index.html • [8] N.M. Cheung, et al, "Video coding on multicore graphics processors", IEEE Signal Processing Magazine, vol 27, Issue 2, pp. 79 - 89, March 2010.

  31. References (contd) • [9] E. Kalali, et al, "A High Performance And Low Energy Intra Prediction Hardware For HEVC Video Decoding“, DASIP 2012, pp. 1 - 8, Karslruhe, Germany, Oct. 2012. • [10] K. Miyazawa, et al, "Real-Time Hardware Implementation of HEVC Encoder for 1080p HD Video", IEEE PCS 2013, pp. 225 - 228, San Jose, California, USA, Dec 2013. • [11] S. Kim, et al, "A Novel Fast and Low-complexity Motion Estimation for UHD HEVC", IEEE PCS 2013, pp. 105 - 108, San Jose, California, USA, Dec 2013. • [12] F. Bossen, et al, ” HEVC Complexity and Implementation Analysis”, IEEE Trans. on CSVT, vol.22, no.12, pp.1685-1696, Dec. 2012. • [13] K.R. Rao, D.N. Kim and J.J. Hwang, "Video Coding Standards: AVS China, H.264/MPEG-4 Part10, HEVC, VP6, DIRAC and VC-1", Springer, 2014.

  32. References (contd.) • [14] G.J. Sullivan, et al, "Standardized Extensions of High Efficiency Video Coding (HEVC)", IEEE Journal of Selected Topics in Signal Processing, vol. 7, Issue 6, pp. 1001 - 1016, Dec. 2013. • [15] G.J. Sullivan, et al, "HEVC Range Extensions Draft 5", JCT-VC, version 1, Geneva, Nov. 2013. • [16] M. Jakubowski and G. Pastuszak, “Block-based motion estimation algorithms – a survey”, Opto-Electronics Review, vol 21, Issue 1, pp. 86 – 102, March 2013. • [17] Access to HM 13.0 Reference Software: https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/branches/HM-13.0-dev/

  33. References (contd.) • [18] Access to HM Software Manual: https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/branches/HM-13.0-dev/doc/ • [19] B. Bross et al, “High Efficiency Video Coding (HEVC) Text Specification Draft 10”, Document JCTVC-L1003, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC), Mar. 2013 available on http://phenix.it-sudparis.eu/jct/doc_end_user/current_document.php?id=7243 • [20] Special issue on emerging research and standards in next generation video coding, IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, pp. 1646 – 1909, Dec 2012. • [21] Special issue on emerging research and standards in next generation video coding, IEEE Transactions on Circuits and Systems for Video Technology, vol. 23, pp. 2009 – 2142, Dec 2013.

  34. References (contd.) • [22] IEEE Journal of Selected Topics in Signal Processing, vol. 7, pp. 931 – 1151, Dec 2013. • [23] H.Zhang and Z.Ma, “Fast intra mode decision for high efficiency video coding(HEVC)”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 24, pp. 660 – 668, April 2014.

More Related