1 / 40

Efficient MPEG Compressed Video Analysis Using Macroblock Type Information

Efficient MPEG Compressed Video Analysis Using Macroblock Type Information. Soo-Chang Pei, Yu-Zuong Chou IEEE TRANSACTIONS ON MULTIMEDIA, DECEMBER,1999. Introduction. We develop a novel method for video analysis using the macroblock(MB) type information of MPEG compressed video bitstreams.

kiana
Download Presentation

Efficient MPEG Compressed Video Analysis Using Macroblock Type Information

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Efficient MPEG Compressed Video Analysis Using Macroblock Type Information Soo-Chang Pei, Yu-Zuong Chou IEEE TRANSACTIONS ON MULTIMEDIA, DECEMBER,1999

  2. Introduction • We develop a novel method for video analysis using the macroblock(MB) type information of MPEG compressed video bitstreams. • Only a simple analysis on MB types of frames is needed to achieve efficient scene change, flashlight, and caption detection. • The advantages of this novel approach are its direct extraction from the MPEG bitstreams after VLC decoding, very low complexity analysis, frame-based detection accuracy and high sensitivity.

  3. Proposed Method • SGOP(subgroup of pictures) • SGOP1are denoted as Pf Bf Br Pr • SGOP2are denoted as P Bf Br i • SGOP3are denoted as i Bf Br P

  4. x Pattern of MB Types of SGOP’s with Abrupt Scene Changes • SCPI (Scene change at a P frame or an I frame) • Most MB’s in the two B frames are forward motion compensated (F mode) • A significant number of MB’s in Pr are Intra-coded(I mode)

  5. Pattern of MB Types of SGOP’s with Abrupt Scene Changes(cont.) • SCFB (Scene change at front B frame) • Most MB’s in the two B frames are backward motion compensated (B mode) • There are many I mode MB’s existing in Pr

  6. Pattern of MB Types of SGOP’s with Abrupt Scene Changes(cont.) • SCRB (Scene change at rear B frame) • Most MB’s in Bf will be F mode predicted to Pf, and most MB’s in the Br will be B mode predicted to Pr .

  7. We define the MB in a specific position (x,y) of each frame of a SGOP to form a MB group(MBGxy). • If the pattern of the MB types in a MBGxy follows the above pattern of SCPI,SCFB or SCRB, we can say there is a changing MB in the position (x,y) laying at Pf , Bf , or Br.

  8. Example of gradual scene changes

  9. Pattern of MB Types in SGOP’s with Gradual Scene Changes • Dissolve • scene S0 to scene Sn in the transition sequence, length n+1 • If S0 =0 ,fade-in. • If Sn =0 ,fade-out. • The luminance of B frames in SGOP1 (PBBP) operated by the dissolve effect can be approximately written as

  10. Pattern of MB Types in SGOP’s with Gradual Scene Changes(cont.) • When bidirectional motion compensation is applied to B frames, the compensated frames of three compensation modes(F, B, FB) can be written • It is found that the variance of FB compensated error is smaller than that of F or B compensated error. • B frames in dissolve video sequence are inclined to be interpolative(FB mode) motion compensated.

  11. x • SFPI(starting frame lies at Pr or I frame) • A significant number of MS’s in Pr are I mode because the change of content. • MB’s in B frames are inclined to be F mode • The pattern of MB types of SFPI is very similar to the pattern of SCPI • SFFB (starting frame lies at Bf ) • Most MB’s in both B frames are FB mode since the frames of this SGOP form a Complete Dissolve SGOP. • SFRB (starting frame lies at Br) • the MB’s of Bf are inclined to be F mode and those of Br are inclined to be FB mode.

  12. A significant number of MB’s of Pr in a dissolve video sequence are I mode in both SFFB and SFRB. • The patterns of the MB types of the SGOP including ending frames(EFPI,EFFB,EFRB) are similar and symmetric to that including starting frames. • There are nine combinations.

  13. x

  14. Video sequence involving camera motion • Zooming operation is slow for the purpose of comfortable watching, and can be easily tracked as a special kind of movement and will not greatly affect the MB types of frames. • Slow panning operations would be judged as overall movement of the frame and the MB type information would not show some specific characteristic. • The speeding of fast panning exceeds the tracking ability of motion compensation,so a significant number of MB’s in the P frame are I mode. • The detection process may confuse fast panning operation with dissolve operation because of the similarity.

  15. x

  16. Example of flashlight in news experiment sequence

  17. Pattern of MB Types in SGOP’s with Flashlights

  18. Experimental Result • There are 24 abrupt scene changes, five gradual scene change transitions,f our shots involving camera motion(two fast panning and two zooming sequences) in the test sequence. • Each frame of the sequence is in SIF (352*240) format, which yields 330 (22*15) MB’s in a frame. • The frame structure is IBBPBBPBBPBBPBB (M=3,N=15) . • Total bit rate is 1.5 Mbps

  19. Abrupt scene change detection

  20. Locations of changing MB’s in the test sequence(frame 1 to 100)

  21. Experimental results of abrupt scene change detection ( Tmb = 280)

  22. Gradual scene change detection

  23. Remaining P frames with significant I mode MB’s

  24. Number of FB mode MB’s in B frames

  25. Flashlight detection

  26. Flashlight detection using news experiment sequence

  27. Caption detection

  28. The locations of changing MB’s in the caption sequence

  29. Abrupt scene change detection Caption detection with eliminating the abrupt scene changes

  30. Experiments Using Real Video Sequence of Movies and News

  31. Discussion • Influence of Bit Rates

  32. Taking the forward motion compensated MB for instance, the attribute of MB’s change from “Not coded” or “Coded, Larger Quantizer Scale” to “Coded, Default” to obtain better residue data reconstruction instead of changing FB to Intra mode. • The change of the bit rates just very slightly affects the occurrences of I,B,F,FB modes is found. • The detection algorithm exploiting the MB types is not affected by bit rates.

  33. Modification of Proposed Method Corresponding to Different GOP Structure

  34. Advantage of Proposed Method • The MB type information can be directly extracted from the bit streams of compressed video after VLC decoding. • Detecting process is quite simple as compared to current DCT methods that require more operations. • Its detection accuracy is on the frame scale, and we can precisely indicate which frame the scene change occurs.

  35. Conclusion • We have developed a novel video analysis method using MB type information,and satisfactory detection precision and speed is obtained. • The method using MB type information benefits from easy data extraction from the bitstream, very simple analysis, frame-based accuracy and high sensitivity to avoid miss detection.

More Related