1 / 36

Multimedia Processing Lab NH 140

Multimedia Processing Lab NH 140. Advisor : Dr. K.R. Rao Phone : (817) 272-3478 Email : rao@uta.edu Website: http://www-ee.uta.edu/dip. Multimedia Network. Home Media Ecosystem. A case for importance of research in multimedia. Video Redundancy – An Example. The need for video compression.

jana
Download Presentation

Multimedia Processing Lab NH 140

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Multimedia Processing LabNH 140 Advisor :Dr. K.R. RaoPhone :(817) 272-3478 Email :rao@uta.edu Website:http://www-ee.uta.edu/dip

  2. Multimedia Network

  3. Home Media Ecosystem • A case for importance of research in multimedia

  4. Video Redundancy – An Example

  5. The need for video compression • Video signal : Sequence of frames (images) related among temporal dimension • TV video quality: 704x576 pixels per frame, 12 bpp, 25 frames per second - > 121 Mbps • Too much data for video transmission or storage • Increasing importance of multimedia communication t NEED FOR VIDEO COMPRESION

  6. H.265(?) 2010 Coding Efficiency Network awareness + implementation? 2005 SVC HDTV mobile H.264 2003 Mobile TV MPEG4 1999 Hand PC Video Conferencing MPEG2 H.263 Mobile Phone 1994 1992 MPEG1 Year Research Focus Areas 2009 MVC Blue ray DVD

  7. Research : Image, Video, Audio

  8. Video Compression Standards

  9. Latest Video Codecs

  10. Comparison of various video compression standards

  11. Comparison of various video compression standards

  12. Comparison of various video compression standards

  13. Audio Compression Standards

  14. Mobile Applications Development of virtual lab platform for mobile software application Developing a low complexity video codec for mobile application Complexity reduction Complexity reduction in existing video codecs Complexity reduction in existing audio codecs Quality Improvement Optimizing existing video codecs using perceptual coding techniques Improve Robustness Error Resilience of video streams in a Lossy Wireless Environment Error concealment techniques for wireless video transmission Transcoders Video transcoders : VP6 to H.264, H.264 to VC-1, Wyner Ziv to H.264, H.264-to-AVS China transcoders Video/Audio Integration AVS China – Audio/Video codec – Multiplex/demultiplex and lip sync DIRAC video codec and AAC - Multiplex/demultiplex and lip sync Current Research Activities of MPL

  15. Virtual lab. Platforms for Mobile SW Applications

  16. Low complexity Codec Applications SensorCamPillCamWearableCamDisposable cam.ScanCam

  17. Transcoding Applications Low complexity Decoder Low complexity Encoder The transcoding platforms handle the high complexity decoding on one side and high complexity encoding on the other (right) side

  18. An application scenario for transcoding

  19. Error Concealment in Lossy Wireless Environment Reconstruct lost information Source Destination Original Information Information lost due to lossy wireless network Typical situation of 3G/4G cellular telephony

  20. Multiplexing of Audio/Video AVS – Audio Video Standard of China

  21. A quick view on H.264

  22. Profiles in H.264

  23. Intra Prediction 4x4

  24. Intra Prediction 8x8

  25. Intra Prediction 16x16

  26. Motion Estimation/Compensation Sizes

  27. Sub pixel accuracy

  28. Scanning Zig-zag scan Alternate scan

  29. SVC Extensions

  30. HDR video output (HDR storage/display) HDR video input 10, 12, 14 bits/pixel Bit Depth Scalable Coder LDR video output (conventional display) + + HDR range = 8-bit range Tone Mapping Future Standards Activities – Bit depth Scalability • LCD dynamic range – 500:1 • HDR displays: Sharp “Mega-contrast”, LG.Philips - 1,000,000:1, Dolby – 250,000:1

  31. Consumer Electronics auto-stereoscopic display, 10+ views required Digital Cinema polarized glasses, 2 views sufficient 3D Video (3DV)/Free View-Point Video (FVV) effort initiated in MPEG. Similar concept to MPEG-C. Any number of views can be recreated using depth map in the decoder. 2D video data + depth Future Standards Activities – 3D Video

  32. Future Standards Activities – 3D Video • Paramount Pictures' Beowulf is benefiting from theaters utilizing next-generation 3D technology (grossed approximately $23.4 million of a total domestic gross over 79.4 million.” • “U2 3D, the first live-action movie to be shot, produced, and screened exclusively with digital 3-D technology • DreamWorks Animation is joining the digital 3-D wave • Studio plans to release all its pics in 3-D starting in 2009.”

  33. Original and compressed Lena image with different methods • Original Lena • (51251224) (b) AIC: 0.22bpp, PSNR=28.84dB (c) JPEG2000: 0.22bpp, PSNR=29.57dB

  34. Compressed Lena image with different methods(contd.) (d) M-AIC: 0.22bpp, PSNR=29.02dB (e) JPEG: 0.22bpp, PSNR=24.29dB

  35. Current Interns & Alumni Network Current & Recent Grads: Vineeth Shetty Kolkeri (M.S) -interned @ Qualcomm, job @ Apple Subrahmanya MV (M.S.) – intern @ Qualcomm, job @ Qualcomm Jay R Padia (M.S) - Intern @ Intel, job@intel Vidhya Vijayakumar (M.S) - Intern at Adobe, job@panasonic Att Kruafak (Ph.D) – job @Engineer CAT, Thailand Sangseok Park (Ph.D) – job @ DiaLogic Swaroop intern@ericsson Sadaf intern@ericsson Jennie Abraham intern@Ericsson Muniyappa intern@RIM Radhika Veerla (Aug 08) - Nokia Seimens   Theju Jacob (Aug 08) - Fast VDO Pooja Agawane (Aug 08) - Intel Leena Agarwal (Dec 07) - Intel Rahul Panchal (May 07) - Qualcomm Harishankar Murugan (May 07)- NVidia Sreejana Sharma (May 07)- Intel Hitesh Yadav (August 06)- Intel Basavaraj S. M. (May 06)- Fast VDO Rochelle Pereira (Dec 05)- NVidia Sandya Sheshadri (Dec 05) - Microsoft Tarun Bhatia (Dec 05)- FastVDO

  36. Explore the field of multimedia processing in MPL @ - Dr. K.R. Rao (817) 272-3478 rao@uta.edu NH 140 http://www-ee.uta.edu/dip

More Related