1 / 33

Implementing Video Systems Using the Altera Video Framework

Implementing Video Systems Using the Altera Video Framework. AGENDA. What is the Video Framework? Overview VIP Core Details Boards/Reference Designs. Altera Video Framework. Building block IP cores to speed up development (VIP suite)

kael
Download Presentation

Implementing Video Systems Using the Altera Video Framework

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Implementing Video Systems Using the Altera Video Framework

  2. AGENDA • What is the Video Framework? • Overview • VIP Core Details • Boards/Reference Designs

  3. Altera Video Framework • Building block IP cores to speed up development (VIP suite) • Open, low-overhead interface standard to mix-and-match custom or off-the shelf IP blocks • Format conversion reference designs that showcase silicon capability, provide a starting point for design • System Level Tools and design methodology • Variety of development boards/kits for rapid design prototyping

  4. The Video IP framework – The IP • Building block IP to speed up development • Interfaces (SDI, DVI, etc), High Performance Memory Controllers, Nios • Video IP suite: library of interoperable Video IP blocks using common standards and protocols • Openinterface standard to mix-and-match custom or off-the shelf IP • Avalon Memory-Mapped and Avalon-Streaming Video protocol • Open Source HDL Template to facilitate integration of custom IP into framework Avalon-ST Video (over Avalon-ST) Avalon-MM Clocked Video Input Output interface Clocked Video Input Input interface Altera VIP 1 Altera VIP 2 Custom IP Memory controller Nios Video in Video out

  5. The Video IP framework – Design Tools Quartus II SOPC Builder 1080p reference designs: out-of-the-box ASSP-level capabilities and/or great starting points V-series, M-series, partner designs Pin mapping, Interface IP, Top-level HDL Abstract design capture Switch fabric generation IP Catalogue tool Nios II IDE Nios II IDE / Quartus II Software library to control the cores of the VIP Suite and for interrupt servicing • Development boards/kits for rapid design prototyping • Stratix II GX, Cyclone III • Stratix IV GX PCIe, Arria II GX Software control and configuration Debug (Nios II & SignalTap)

  6. AGENDA • What is the Video Framework? • Overview • VIP Core Details • Boards/Reference Designs

  7. Color plane sequencer Frame buffer 2D FIR filter Scaler Image clipper Deinterlacer Deinterlacer II 2D median filter Switch Gammacorrection Chroma resampler Color space converter Control Sync Scaler II Frame Reader Avalon ST video  BT 656 Test pattern generator Alpha blending mixer Video Image Processing (VIP) Suite BT 656  Avalon ST video v10.1 v11.0 Half a dozen hardware verified video processing reference designs using these functions Available TODAY!

  8. New Cores in VIP Suite (2011) • Scaler II • Reduces area and improves performance • Compared to first-generation scaler • Supports 4:2:2 chroma data sampling rate • Further reduces area used • Deinterlacer II • Supports 3:2 cadence detection • Supports low-angle edge detection • Delivers lower latency

  9. VIP Function Details Chroma Resampler • This function allows you to change between 4:4:4, 4:2:2 and 4:2:0 sampling rates • For 4:2:2  4:4:4, the filtered algorithm uses a 4-tap filter with fixed Lanczos-2 coefficients • For 4:4:4  4:2:2, the filtered algorithm uses a 7-tap filter with fixed Lanczos-2 coefficients

  10. VIP Function Details Color Space Converter • This function provides a flexible and efficient means to convert image data from one color space to another • You can select from a list of common color space conversion • Or choose a custom color space

  11. VIP Function Details Deinterlacer/ Deinterlacer II (motion adaptive) Choose the deinterlacing algorithm – bob, weave, motion adaptive Select the input image height and width The weave and motion adaptive algorithms require external frame buffering

  12. DDR2 Understanding Algorithmic Constraints Deinterlacer (motion adaptive) • Motion adaptive deinterlacer requires five (master) accesses to the DDR memory • 1 field write • 2 field reads • 1 motion vector write • 1 motion vector read • Calculating DDR memory bandwidth • Input format: 1080i, 60 fields/sec, 10-bit color • 1920 × 1080 × 30bits × 60/2 = 1.866Gbit/s • Output format: 1080p, 60 frames/sec, 10-bit color • 1920 × 1080 × 30bits × 60 = 3.732Gbit/s • Motion format: Only use 10bits for the motion values • 1920 × 1080 × 10bits × 60/2 = 0.622Gbit/s • Memory access: • 1 × write at input rate: 1.866Gbit/s • 1 × write at motion rate: 0.622Gbit/s • 1 × read at motion rate: 0.622Gbit/s • 2 × read at output rate: 7.464Gbit/s • Total: 10.574Gbit/s 4:4:4 Mode, Motion Bleed is ON Deinterlacer (MA) 4:4:4 Mode

  13. DDR2 Understanding Algorithmic Constraints Deinterlacer (motion adaptive) • Motion adaptive deinterlacer requires five (master) accesses to the DDR memory • 1 field write • 2 field reads • 1 motion vector write • 1 motion vector read • Calculating DDR memory bandwidth • Input format: 1080i, 60 fields/sec, 10-bit color • 1920 × 1080 × 20bits × 60/2 = 1.24Gbit/s • Output format: 1080p, 60 frames/sec, 10-bit color • 1920 × 1080 × 20bits × 60 = 2.48Gbit/s • Motion format: Only use 10bits for the motion values • 1920 × 1080 × 10bits × 60/2 = 0.622Gbit/s • Memory access: • 1 × write at input rate: 1.24Gbit/s • 1 × write at motion rate: 0.622Gbit/s • 1 × read at motion rate: 0.622Gbit/s • 2 × read at output rate: 4.96Gbit/s • Total: 7.44Gbit/s 4:2:2 Mode, Motion Bleed is ON Deinterlacer (MA) 4:2:2 Mode, 30% reduction in DDR bandwidth

  14. Requires progressive 4:4:4 input VIP Function Details Scaler Select the input and output image sizes Choose the scaling algorithm – number of taps/phases Choose from a selection of pre-built filter functions or choose a custom function

  15. VIP Function Details Scaler II – Utilizes Fewer Resources • Reduces area and improves performance • Compared to first-generation scaler • Supports 4:2:2 chroma data sampling rate • Further reduces area used • Algorithm supports • Linear and polyphase with run-time coefficient load • New core in HDL • More efficient in using resources

  16. VIP Function Details Alpha Blending Mixer Select the size of the image Select the number of layers to be mixed The level of blending is controlled by the number of alpha bits (up to 8)

  17. VIP Function Details Generate a color bar test pattern

  18. BT656  Avalon ST Video • The Clocked Video Input MegaCore function converts from clocked video formats (such as BT656 and DVI) to Avalon-ST Video • It strips the incoming clocked video of horizontal and vertical blanking, leaving only active picture data • No conversion is done to the active picture data • The color plane information remains the same as in the clocked video format.

  19. BT656  Avalon ST Video • The Clocked Video Output MegaCore function converts from Avalon-ST Video to clocked video formats (such as BT656 and DVI) • It formats Avalon-ST Video into clocked video by inserting horizontal and vertical blanking and generating horizontal and vertical sync information • No conversion is done to the active picture data • The color plane information remains the same as in the Avalon-ST Video format.

  20. Frame Buffer

  21. Run-time Control of the Video Chain • Build video signal chains that can be updated on-the-fly without changing the HDL or bit-stream • Using the streaming interface protocol: Avalon ST Video • Using an embedded processor

  22. Video function 1 Video function 1 Avalon ST READY DATA VALID SOP EOP Run-time Control of the Video Chain • Avalon-ST Video protocol is a packet-oriented way to send video and control data • First packet contains a frame of video data • Second packet contains control information that applies to the subsequent video packet/frame Examples of Avalon-ST Video Control Packets

  23. Run-time Control of the Video Chain Video function 1 • Most video functions permit run-time control of some aspects of their behavior, using a common type of Avalon-MM slave interface • Each slave interface provides access to a set of control registers which must be set by an embedded processor/logic • Generally, a function can be updated on a frame boundary Avalon MM control plane Avalon MM Master port Processor

  24. Start the IP cores NIOS Control: Cyclone III Example Design Initialize daughter card Initialize daughter card Control the mixer and Scaler parameters at run-time

  25. AGENDA • What is the Video Framework? • Overview • VIP Core Details • Boards/Reference Designs

  26. Video Development Kits Cyclone III FPGA, $1,895 Cyclone IV FPGA, $1,295 StratixIV FPGA, $4,995 Arria II GX FPGA, $2,995 $495 $795 Cyclone III FPGA, $2,995

  27. New Demo in 2011 (VEEK) • Demo # 1 – Simple Video Format Conversion • Demo # 2 – Camera Input Scaling Download Design Files on Altera Video Wiki www.alterawiki.com/wiki/Videoframework

  28. New Demo in 2011 (VEEK) • Demo # 3 – Picture in Picture (PiP) • Demo # 4 - Multi-view Watch Demo of VIP Suite

  29. New Low Cost UDX Reference Design • C4GX150 board • Develop in Quartus II software v11.0 using Qsys • Available at end of July • 1 channel UDX design • SDI / DVI input switch • SDI / DVI output • Resolution supported • 1920 x 1080P 50/59.94/60Hz • 1280 x 720P 50/59.94/60Hz • Text overlay and testing pattern

  30. Video Reference Designs Broad Portfolio of Reference Designs to Help You Get Started

  31. Summary • Altera video framework enables rapid development • Mix and match existing IP – Leverage Altera’s open interface standard • Automatically integrate embedded processors and arbitration logic • Leverage building block IP provided by Altera • Use existing reference designs as starting points • And rapid prototyping • Implement design using the appropriate development boards • Test the design with actual video signals

  32. Next Step • Coming Video Framework Workshop, please contact Altera Sales orDistributors for more information • Provide an introduction to Video and Image Processing suite including the cores, reference designs, roadmap, video framework, etc. • For information on: • DDR-based Memory controllers • http://www.altera.com/education/training/courses/IMEM210 • http://www.altera.com/technology/memory/mem-index.jsp • SOPC Builder • http://www.altera.com/education/training/courses/OEMB1115 • http://www.altera.com/literature/lit-sop.jsp • System Console • http://www.altera.com/education/training/courses/OEMB1117 • http://www.altera.com/literature/ug/ug_system_console.pdf • NIOS-II Flow • http://www.altera.com/education/training/courses/IEMB115 • http://www.altera.com/literature/lit-nio2.jsp • Video and Image Processing Suite • http://www.altera.com/products/ip/dsp/image_video_processing/m-alt-vipsuite.html • http://www.altera.com/end-markets/broadcast/1080p/bro-1080p.html • http://www.altera.com/support/refdesigns/sys-sol/broadcast/ref-format-conversion.html • On-chip Debugging, including SignalTap-II • http://www.altera.com/education/training/courses/ODSW1164 • http://www.altera.com/support/software/debugging/sof-qts-debugging.html

  33. Backup

More Related