1 / 18

High Definition Video Transcoding for Consumer Markets

High Definition Video Transcoding for Consumer Markets. Paul Greenfield, CEO. CONFIDENTIAL. IP license. Customer ASICs. “Q” Transcoder 65nm Toshiba. New Architecture optimised for advanced video encoding/decoding. ASProCore V8. "Q" Mobile. Low cost/power ASSP

aysel
Download Presentation

High Definition Video Transcoding for Consumer Markets

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. High DefinitionVideo Transcoding for Consumer Markets Paul Greenfield, CEO CONFIDENTIAL

  2. IP license • Customer ASICs “Q” Transcoder 65nm Toshiba • New Architecture optimisedfor advanced videoencoding/decoding ASProCore V8 "Q" Mobile • Low cost/power ASSP • High quality 720p encode/decode • Camera/phone market Sampling Linedancer HD130nm NXP/UMC ASProCore V7 Sampling Accelera 5xxx • High Performance Extreme Processor • Embedded Professional Image Processing Production Production • PCIe Plug-In-Card • Realtime HD Video Compression • Studio Quality H.264 / VC-1* / MPEG-2 ASProCore V6 Linedancer 1130nm NXP Accelera 2xxx/3xxx • High Performance Extreme Processor • PC-based Professional Image Processing • PCI-X / PCIe Plug-In-Card • Realtime / Offline HD Video Compression • Studio Quality H.264 / VC-1* / MPEG-2 Product Roadmap • General Purpose architecture forhigh performanceimageprocessing Professional Markets * porting subject to customer demand

  3. Realtime HD encoding (1920x1080p30/i60) 4x SD encoding (720x480i30 / 576i25) H.264/AVC: Baseline/Main/High Profiles VC-1/WM9: Simple/Main/Advanced Profiles MPEG-2: Main/High Profiles All resolutions up to 1920x1080i60 Video DRAM System DRAM Flash Secure OTP HD Compression Engine System StreamProcessor (RISC)MUX, DRM, Output, System Control Customer programmable, standard RTOS HDCP Keystore Rate Control AES / 3DES Motion Estimation Macroblock Engine: Transform Quantize RDO Entropy Coding & Stream Generation DVI / HDMI GPIO / TS Compressed A/V output Uncompressed A/V in Intra Mode Prediction 8/10 bit ITU-656 RGB/YUV 1 x HD / 4 x SD PCI Express 10/100/1G MAC Video PreprocessorScaling, Color Space Conversion, De-interlacing, Noise reduction, Watermarking, Logo insertion Video Decode Engine Audio DSP I2S Audio x 4 USB 2.0 Memory Card "Q" Transcoder • Optional Video Decode Engine for transcoding • Audio encoding/transcoding for all major standards (AAC, HE-AAC, AC-3, WMA) • Customer-programmable stream processor for application-specific mux/output formats & DRM

  4. Scalable to meet any price / performance point Scalable number of Macroblock SIMD PUs (Decides performance) System Control CPU (ARM, MIPS, DSP, etc) Control Unit Scalable number of SAD Motion Estimation accelerators (Decides Quality) AMBA AHB Interface SIMD Instruction bus SAD Accelerator SAD Accelerator Entropy Coding Accelerator Macroblock Processing Unit Macroblock Processing Unit Macroblock Processing Unit Macroblock Processing Unit

  5. Market for HD Video Encoding Devices (IN-STAT 2007) Also validated by independent strategy consultant - Dr Handel Jones (Excludes PC Market)

  6. Competitive Advantages • Higher performance & quality - based on Studio Quality Algorithms • 2 channels of 1080i encode / 1080p60 encode / 10-bit / 4:2:2 support • “Anything in, anything out” transcoding • Flexible software-programmable engines • Multi-codec decode + encode • Advanced Security Features • Emerging as a strong customer care-about • “Q” has comprehensive encryption/transcryption features • e.g. encrypting data when passed to external memory • Secure on-chip memory for keys & boot images • Flexible front-end video preprocessor • Advanced noise reduction, scaling & deinterlacing • Highly Scaleable - no software rewrites required - easy to create variants • “HD Encoder” – Camcorders, Blu-Ray recorders / “SD Encoder” – Slingbox-type applications • “Mobile” – High end (720p) cameraphone / “Lite” – Low end (VGA) cameraphone • “Wireless HDMI” – Low latency for UWB, etc

  7. Additional Material Use Cases IP Overview Software Development Environment

  8. Wireless HDMI solution (H.264 option) HDMI 1.2 Q-based Decoder Rate control • Low latency I-frame only encode • H.264 (can use standard/modified TV decoder) • 50-200 Mbps compression • Dynamic rate control adapts to wireless link quality • Quantization, 4:4:4/4:2:2/4:2:0, 8/10/12 bpp, block sizes, etc • Can also drop down to long-GOP at 5-10 Mbps • Using standard TV/STB Decoder • Multi-room coverage with the same solution USB 2.0 OTG 802.11n or UWB USB 2.0 OTG HDMI 1.2 HDMI 1.2 Q-based encoder Wireless USB TX Wireless USB RX TV/STB Decoder 480 Mbps PHY 50-200 Mbps AES encrypted stream 1920x1080i60 24/30/36 bpp RGB / YCrCb 1.5 – 3.0 Gbps Link quality feedback

  9. Integrated TV “Pause Button” Plasma/LCD Panel Video RAM 32Mx16 DDR2-667 Serial Boot / ID Flash • Store video from broadcast, HDMI or analogue sources • Encode and/or transcode and/or downscale video • Integrated solid state NAND flash storage • Longer lifetime & higher reliability than Hard Disk • 8GB Flash gives ~4 hrs (HD), ~20 hrs (SD) • Support external SD/MMC or USB key for placeshifting & sideloading • Transcode to portable devices, e.g. iPod, Zune, Mobile phone • Add Digital Rights Management to protect content NAND Flash Storage Cable/Satellite/ Terrestrial Tuner inputs TV Decoder SoC Aspex Q-based Encoder/ Transcoder HDMI or Digital YUV SD/MMC SD or MMC socket for memory card Transport Stream USB 2.0 HDMI inputs USB socket for Removable Flash Drive

  10. Networked digital TV Portable Device Second TV PC Plasma/LCD Panel Video RAM 32Mx16 DDR2-667 Serial Boot / ID Flash • Add home networking chipset • Wireless, Ethernet, Powerline, MOCA, HomePNA, etc • Use DLNA to publish content to networked devices • Industry standard for media servers • Secure reformatting for placeshifting, sideloading & internet streaming • Streaming to second TV, PC, portable device, or internet (“Slingbox”) • Reduce bitrate and/or resolution to meet bandwidth or device constraints • Transcode to other codecs (e.g. Windows Media) for client devices • Add Digital Rights Management (e.g. Microsoft DRM) to control content Home Network WiFi, Powerline, Ethernet, MoCa, etc Cable/Satellite/ Terrestrial Tuner inputs TV Decoder SoC Aspex Q-based Encoder/ Transcoder HDMI or Digital YUV Transport Stream HDMI inputs Home Networking Chipset Broadband Modem Internet Laptop or Mobile Device

  11. Blu-Ray recorder / DVR Video RAM 32Mx16 DDR2-667 Serial Boot / ID Flash Blu-Ray/HD-DVD recordable drive • Record from SD or HD analogue sources • Full 1920x1080 resolution in H.264, VC-1 or MPEG-2 • Choice of bitrates and resolutions for control of recording time • Transcode broadcast streams • Ensure compatibility with Blu-Ray/HD-DVD codec constraints • Reduce bitrate to extend recording time • Transcoding from AVCHD/HDV Camcorder inputs • “Long play” recording Cable/Sat/Terr in Tuner / Demod Transport Stream Aspex Q-based Encoder/ Transcoder Blu-Ray Decoder SoC Transport Stream HDMI HDMI Component in Video ADC Digital Y Cr Cb Hard Disk Drive Stereo audio in I2S Audio ADC

  12. PCI Express plug-in card PCI 32/33 • 1 Lane PCI Express (desktop) or ExpressCard (laptop) form factors • H.264 SD or HD encode from component or HDMI inputs • Any resolution & bitrate from 1..20 Mbps, Baseline (Quicktime) or Main / High Profile • Transcode from off-air MPEG-2 HD to H.264 (HD or SD) • Free-to-air or using Cablecard/DVB-CI Conditional Access smartcard • Can transcode multiple SD streams • “Slingbox” functionality – variable resolution & bandwidth VC-1 / H.264 • Transcode/sling content from PC (or PC-connected peripheral) • Webcam videoconferencing • Accelerated HD-DVD / Blu-Ray burning Cablecard/DVB-CI socket (optional) Aspex Q-based Encoder/ Transcoder Video RAM 32Mx16 DDR2-667 PCI Express x1 Serial Boot / ID Flash ATSC/Cable/Sat in Tuner / Demod Transport Stream PCIe slot (desktop) or ExpressCard slot (laptop) HDMI Component in Video ADC Digital Y Cr Cb PSU & Power sequencer Stereo audio in I2S Audio ADC

  13. USB / Wireless TV capture PCI 32/33 802.11n WiFi USB chipset (Wireless Option) • Standalone USB Dongle or Wireless Media Ingest engine • USB 2.0 interface configurable as host or device • H.264 SD or HD encode from component or HDMI inputs • Any resolution & bitrate from 1..20 Mbps, Baseline (Quicktime) or Main / High Profile • Transcode from off-air MPEG-2 HD to H.264 (HD or SD) • Free-to-air or using Cablecard/DVB-CI Conditional Access smartcard • Can transcode multiple SD streams • “Slingbox” functionality – variable resolution & bandwidth VC-1 / H.264 Cablecard/DVB-CI socket (optional) Aspex Q-based Encoder/ Transcoder Video RAM 32Mx16 DDR2-667 USB 2.0 OTG (Host or Device) Serial Flash (Program) ATSC/Cable/Sat in Tuner / Demod Transport Stream PC USB port (Wired Option) HDMI Component in Video ADC Digital Y Cr Cb PSU & Power sequencer Stereo audio in I2S Audio ADC

  14. Webcam / Videoconferencing app • Digital Y Cr Cb (or RGB) input from image sensor • 8/10/16/20 bit input, up to 165 MHz pixel clock • H.264 (Quicktime) or VC-1 (Windows Media) encoding at up to 1080i60 • Other video formats (Flash, MJPEG, MPEG-4) could be added as software upgrades • USB Video Class support • Bulk or Isochronous • Stream-based (MPEG-2 TS) • Frame-based (MJPEG etc) Aspex Q-based Encoder/ Transcoder Video RAM 32Mx16 DDR2-667 CMOS or CCD Camera Module USB 2.0 OTG (Host or Device) Digital Y Cr Cb Serial Flash (Program) PC USB port (Wired Option) Microphone PSU & Power sequencer I2S Audio ADC

  15. Aspex Compression Engine Elementary Stream Uncompressed Video System Bus Aspex Compression Engine • Software programmable architecture • Exploits Aspex’s expertise in multi-standard video encoding • Based on 8th generation Aspex ASProCore • Supports concurrent multiple steams and standards • Configurable for any price or quality point • Optimized for low system power

  16. Processing Units Ctrl unit Control Unit: VLIW program controller and scalar processor, e.g. DSP, ARM. MB PU Macro Block PU: SIMD parallel co-processor for data processing. Designed to minimise power and memory bandwidth.Performs all macro block processing including motion search. SAD Accel (Optional) Sum of Absolute Difference Accelerator: Hardware accelerator with flexible fully programmable search strategy. EC Accel (Optional) Entropy Coding Accelerator: Hardware accelerator. Supports multiple standards including CABAC, CAVLC, etc.

  17. Scalable to meet any price / performance point System Control CPU (ARM, MIPS, DSP, etc) Scalable number of instances for multi-stream support Aspex Compression Engine Control Unit AMBA AHB Interface SIMD Instruction bus Scalable number of SIMD Macroblock PUs (Decides performance) SAD Accelerator SAD Accelerator Entropy Coding Accelerator Macroblock ProcessingUnit Macroblock Processing Unit Macroblock Processing Unit Macroblock Processing Unit Scalable number of SAD Motion Estimation accelerators (Decides Quality) DMA DMA DMA DMA Arbiter Scalable amount of on-chip memory (Performance & Power) On-chip video memory Scalable amount of off-chip memory (Quality & Power) Off-chip video memory

  18. Software Development • Software tools • Comprehensive suite of GNU based cross development tools • Compiler, assembler, linker, loader, libraries • Supported under Linux and Windows • Derived from previous ASProCore programming tools and libraries • Proven on seven ASProCore versions over 10 years • Programming • Majority of customers • Use the Aspex encoder libraries and program in C/C++ via the library API • Some customers wishing to differentiate themselves • Directly programming the PUs in an extended version of C/C++ • New statement to declare data parallel variables and perform data parallel operations • Programming model • Conventional SISD processor with co-processors • Simple to understand, program and debug • All control on the SISD processor

More Related