VIDEO ANALYSIS AND COMPRESSION ON THE STI CELL BROADBAND ENGINE PROCESSOR

1. Platform Based Design VIDEO ANALYSIS AND COMPRESSION ON THE STI CELL BROADBAND ENGINE PROCESSOR Alvaro Oceguera V. Manickavasagam.S.A Dr. Bart Mesman, Prof. dr. Henk Corporaal

2. Contents • Paper.. • Introduction • System Architecture • Algorithm and Architecture of BGS ON Cell Broadband Engine • Low Complexity H.264 Mode-Selection • Summary

3. Paper.. • Video Analysis and Compression on the STI Cell Broadband Engine ProcessorLurng-kuo Liu; Kesavarapu, S.; Connell, J.; Jagmohan, A.; Leem, L.; Paulovicks, B.; Sheinin, V.; Lijung Tang; Hangu Yeo;Multimedia and Expo, 2006 IEEE International Conference on9-12 July 2006 Page(s):29 - 32 Digital Object Identifier 10.1109/ICME.2006.262506 IBM T.J. Watson Research Center

4. Introduction • Heightened concerns about • Terrorism • Fuel Storage Depots • Commercial Airport Why is increasing?

5. Introduction • Associated Hardware cost for cameras, interconnectivity and storage have been steadily dropping, making the installation more affordable.

6. Introduction • The paper….

7. System Architecture • System Architecture based on IBM’s intelligent surveillance system called S3-MILS. (Middleware for Large Scale Surveillance)

8. Algorithm and Architecture of BGS ON Cell Broadband Engine • Find Objects by looking for moving regions against a stationary background • Normalize to keep the system from detecting spurious objects resulting from • Differences induced by camera color variations • Swaying of the camera in the wind • Noise Introduced by video compression BGS, How does it works?

9. Algorithm and Architecture of BGS ON Cell Broadband Engine • Build and maintain the reference background • When there are moving objects in the field of view • Slowly updated in the case of weather changes • Sun angle progression • Moving objects sometimes stop and persist a long time in the place

10. Algorithm and Architecture of BGS ON Cell Broadband Engine • Statically Assign ‘n’ SPEs to ‘m’ BGS • Statically assigning SPEs prevent the system from dynamically adaptation to workload changes

11. Algorithm and Architecture of BGS ON Cell Broadband Engine • Each SPE assigned to complete a module and then ready to be reassigned • PPE inquires for an available SPE • Update its command control block and pass the command to the SPE • SPE update its code module • Start the Process of the module

12. Algorithm and Architecture of BGS ON Cell Broadband Engine

13. Algorithm and Architecture of BGS ON Cell Broadband Engine • DMA bring in a small block of data to SPE LS • SPE process the data in LS • Write the processed data back to PU memory

14. Algorithm and Architecture of BGS ON Cell Broadband Engine • Overhead of DMA operations can be hide by • Double-buffering • Data dependency or Unpredictable: • Buffer in LS as soft cache for the data in PU system • DMA request only if there is a cache miss

15. H.264 - is a standard for Video Compression. Features: • Efficient compression for bit-rates from 1-3 Mbps • Variable Frame Rate and Resolution which is well suited for Surveillance Applications • Restricted to the use of 16×16 Macroblocks for non Intra-coded frames • Lower computational complexity

16. H.264 Encoding on CBE 3 Basic Modules • Motion Estimation (ME) • Transform and Quantization (PI) • Context-adaptive binary arithmetic coding (CABAC)

17. Performance Results Processing times for one SPE on 2.4 GHZ Cell Broadband Engine for Cell encoding functions 2 SPEs can do SD video coding at 30 fps 3 GHz Pentium IV Processor can encode at most 1 SD video sequence at 5-6 fps 1 CBE = 20 x Pentium IV

18. Summary A full capacity blade center with 7 Blades each carrying 2 CBE can handle 28 streams of Video Hence the proposed architecture can be used to serve as the core of large scale surveillance system Issues: SPU did not have much program memory