1 / 14

Shape-Adaptive Transforms for Coding Arbitrarily Shaped Objects and Interactive Streaming

Shape-Adaptive Transforms for Coding Arbitrarily Shaped Objects and Interactive Streaming. Shaan Patel Eric Lin Hyungsik Shin. Outline. Motivation Video Object Coding Various Shape-Adaptive Transform Methods Interactive Streaming Goal. Motivation. Compression efficiency

king
Download Presentation

Shape-Adaptive Transforms for Coding Arbitrarily Shaped Objects and Interactive Streaming

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Shape-Adaptive Transforms for Coding Arbitrarily Shaped Objects and Interactive Streaming Shaan Patel Eric Lin Hyungsik Shin

  2. Outline • Motivation • Video Object Coding • Various Shape-Adaptive Transform Methods • Interactive Streaming • Goal

  3. Motivation • Compression efficiency • Better Motion Estimation • Applications: • Image Compositing • Dynamic Allocation of Bits for Objects • Simpler Video Editing • Better Interactivity with Scene Content

  4. Video Object Coding • Object Segmentation • Code Objects separately

  5. Binary Shape Information

  6. Shape Adaptive DCT (SA DCT)

  7. Standard SA DCT • Drawback: • Mean Weighting Defect • DCT’s of different sizes

  8. Low Pass Extrapolation Padding • MPEG-4 recommended • Drawback: Increase number of DCT coefficients

  9. Extension Interpolation (EI) • Scheme • Step 1: Apply K-point DCT for each column/row in boundary block • Step 2: (N-K) zeros are appended to end of DCT coefficient vector • Step 3: Apply N point IDCT on the padded vector from previous step. • Drawback: Computationally demanding and complexity

  10. NewPad+DCT Algorithm • Achieve shape-adaptivity using the normal N x N DCT • Guarantee the highest N – K coefficients are ZERO • Better coding gain thanLPE

  11. Coding Multiple Objects • Extra Overhead • Reduction of high frequencies between objects • Object correlation information is isolated

  12. Interactive Streaming • Extend interactive video browsing to video object coded streams • Can choose objects of interest and view only those objects while using interactive streaming

  13. Goals • Investigate how compression efficiency is affected by coding more and more objects in a video independently of the rest of the video for different schemes • Design an interactive streaming application where objects of interest can be selected or deselected

  14. References • [1] T. Sikora and B. Makai, "Shape-adaptive DCT for generic coding of video," IEEE Transactions on Circuits and Systems for Video Technology (CSVT), vol. 5, no. 1, pp. 59-62, Feb. 1995. • [2] G. Shen, B. Zeng and M. L. Liou, "An efficient hybrid arbitrarily shaped object coding technique," IEEE International Symposium on Circuits and Systems (ISCAS), Geneva, Switzerland, May 2000. • [3] Chuo-Ling Chang, Xiaoqing Zhu, Prashant Ramanathan, and Bernd Girod, "Shape Adaptation for Light Field Compression," Proc. IEEE International Conference on Image Processing, ICIP-03, Barcelona, Spain, Sept. 2003, vol. 1, pp. 765-768. • [4] T. Ebrahimi and C. Home, “MPEG-4 natural video coding—An overview,” Signal Process. Image Communication., vol. 15, no. 4, pp. 365–385, 2000.

More Related