1 / 11

Multimedia Technology Research in HKUST

Multimedia Technology Research in HKUST. Oscar Au (PhD, Princeton University) Dept. of ECE, HKUST Clearwater Bay, Hong Kong Tel: +852 2358-7053 Email: eeau@ust.hk www.ee.ust.hk/~eeau. Oscar Au’s background. BA Sc - Toronto (82-86), MA/PhD/Postdoc - Princeton (86-92)

katherinebell
Download Presentation

Multimedia Technology Research in HKUST

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Multimedia Technology Research in HKUST Oscar Au (PhD, Princeton University) Dept. of ECE, HKUST Clearwater Bay, Hong Kong Tel: +852 2358-7053 Email: eeau@ust.hk www.ee.ust.hk/~eeau

  2. Oscar Au’s background • BA Sc - Toronto (82-86), MA/PhD/Postdoc - Princeton (86-92) • Professor, HKUST (1992 to now). • Director, Multimedia Technology Center, HKUST. • Associate Editor of 6 journals: IEEE TCSVT, IEEE TIP, IEEE TCAS-1, JSPS, JMM, JFI • Chair of IEEE CAS MSATC, Vice Chair/Chair of IEEE SP MMSP TC, member of IEEE CAS VSPC/DSP TC, IEEE SP IVMSP TC, IEEE ComSoC MMTC • Steering Committee of IEEE TMM/ICME. IEEE Fellow/DLP. • General Chair, PCM 2007/PV 2010/ICME 2010. • Host MPEG in 1/2005. • 320 technical papers. 80 patents filed. 9 granted. 3 book chapters. • 67 MPEG/HEVC/AVS contributions. Several accepted into MPEG4, AVS and HEVC. • Forensic expert. 7 press conferences. Talks/media interviews.

  3. My multimedia expertise • Video: coding (MPEG-1/2/4, H.261/3/4, AVS), transcoding, enhancement, error resilience/concealment, denoising, deinterlacing, HDR, SVC, MVC, 3DTV, DVC, GPU video processing, depth estimation, view interpolation, subpixel rendering, white balancing, color demosaicking, compressive sensing, light weight encryption, watermarking, motion estimation, rate control, perceptual quantization • Image: coding (JPEG, JPEG2000), watermarking, restoration, enhancement, processing • Audio/speech: coding, watermarking, processing • Special achievement: Our fast motion estimation technology was accepted into MPEG-4. Up to 8000 times faster with same quality. First ever in Hong Kong and China.

  4. Video Processing • Standard-based image/video compression for SDTV/ HDTV: MPEG-1/2/4, H.261/3/4, AVS, HEVC, etc. • Patented technologiesaccepted into standard: 1 for MPEG-4, 2 for AVS, 2 for HEVC • Video transcoding, ITF, HKD 4,000,000, contract research • Watermarking, light-weight encryption, forensics: ~10 patents, ITF, HKD 7,000,000. • Fast motion estimation, ~5+ patent, HKTIIT, HKD 10,000,000 • 3DTV, free viewpoint TV, distributed/scalable Video coding • Denoising, deinterlacing, error resilience, enhancement • Hardware-friendly algorithms for GPU and ASIC, Vision chip • ~80 patents, IEEE Fellow, Associate Editors

  5. Image Processing Capture / Display - subpixel processing (contract + GRF, HKD 1,000,000) • High dynamic range (HDR) imaging • Subpixel rendering • Automatic white balancing (AWB) • Color interpolation (demosaicing) • Denoising, enhancement, restoration • Watermarking, data hiding, forensic • Halftone image • Texture synthesis • Segmentation,

  6. Video coding (encoder optimization) • Fast motion estimation, PMVFAST • Fast subblock ME • Fast multi-frame ME • Subpixel ME • Fast intra-prediction • Luma/chroma coding • Rate control (block level), R-D modeling • Rate allocation (frame level)

  7. Video coding related issues • Denoising – temporal, spatial, inter-color • Deinterlacing • Deblocking • Color processing • Transcoding • Error resilience

  8. GPU/Hardware • GPU-based processing • ME, intra prediction • Hardware architecture (SW/HW co-design) • ME, deblocking, demosaicking, • Filtering, subpixel rendering • Data dependency, data loading, data re-use, low power, low latency, reconfigurability

  9. Beyond simple video coding • Scalable video coding • Distributed video coding • Multiview video coding • Intra-prediction • Subblock motion estimation • Multiple reference frame motion estimation • Subpixel motion estimation • Rate control • JPEG2000 optimization

  10. Imaging • Demosaicking • Automatic white balancing • Color correction • Subpixel rendering • High dynamic range imaging • Compressive sensing • Audio: variable speed playback • Audio: coding, MP3, AAC HE, SBR • Speech: recognitions

  11. Security/forensics/others • Image/halftone watermarking • Attacks and steganography • Capacity estimation • Image forensics • Light-weight encryption • Encrypted domain processing

More Related