170 likes | 271 Views
Market-proven since 1996. Technology focus on Multimedia Applications and services. Alex Shtein. Topics for this presentation. Indentify the main multi-media applications in the fixed-line and mobile telecom market
E N D
Market-provensince 1996 Technology focus onMultimedia Applications and services Alex Shtein Surf Proprietary Information
Topics for this presentation • Indentify the main multi-media applications in the fixed-line and mobile telecom market • Provide a description of the main media-processing related challenges for each of the above applications Surf Proprietary Information Surf Proprietary Information 2
Target Markets & applications Target markets and applications are divided into 4 Segments: Segment 1: Telecom multi-media applications and services in IMS/NGN Segment 2: IMS/NGN infrastructure Segment 3: Enterprise Telephony Segment 4: Over-the-top (OTT) rich content adaptation and streaming Surf Proprietary Information Surf Proprietary Information 3
Segment 1: Telecom Multi-media applications There are 4 main applications in the telecom space All 4 are relevant for fixed and mobile telephony Interactive voice and video response (IVVR), implementing: Mobile banking, Video dating, Adult entertainment, etc. Wide band telephony Video/voice conferencing bridge Video mail/messaging Surf Proprietary Information Surf Proprietary Information 4
Mobile banking • video dating • Video search • Mobile TV • Video blog SurfExpress PCI/e Prompts in various formats Play prompt information 3G-324M or RTP Server Storage Receive DTMF IVVR Main challenges • Various video content in different formats: requires transcoding • from any to any codec • Support for H.263, MPEG4 • H.264 is becoming dominant • Handle resolutions of up to VGA/D1 in the input (720*576) • Video quality, interoperability and robustness • Need to be able to optimize video quality especially at low bitrates • Support for in-band I-frame requests (relevant RFC’s) • Interoperability with hundreds of mobile and fixed phones • Low latency from key stroke till change of appearance on the phone • Running 3G-324M layer and transcoding layer on the same sub-system • Fast switching of video contents without waiting for I-frames • Support fixed IP and mobile 3G-324M on the same platform • In ATCA, need to support iTDM for TDM transfer • Support for advanced video features: • Scrolling text, multiple overlays at multiple languages • Logos, bitmaps, lines insertions with transparency (Alpha blending) • 3G-324M over an IP transport for easy interface with IP based MSC • Using transparent RTP • Using 3GPP IUuP/Nb-UP Surf Proprietary Information
RTP/AAC RTP/G711.1 IP phone IP WB-AMR (G.722.2) • Conference bridge • Announcement server • Transcoder Wideband Telephony Main challenges • High density transcoding for wideband codecs • For example, AAC-LC needs 10 time more resources then G.729 • Wideband codec support • G.722.2 (WB-AMR), AAC-LC • G.711.1 will become important • Wideband conferencing: optimize voice quality • Voice mixer needs to handle wideband inputs at various sampling ratesy • Interoperability and interworking between wideband devices and narrow band devices Surf Proprietary Information
Video Phone (Soft phone) H.264/CIF MPEG4/D1 IP SurfExpress PCI/e Video Phone (LCD, TV) H.264/VGA 3G-324M/MPEG4/QCIF Video Phone (Desktop phone) Video Conferencing Main challenges • Bridge between various types of endpoints (soft clients, desktop, Mobile phones, MS Messenger, Skype..) with diverse codecs and resolutions • Resolutions from SQCIF to VGA • Resizing from any device to any device • Support various transport layers (RTP, 3G-324M) • 3G phones and fixed (RTP) connected to the same bridge • Split screens, multiple layouts from the same conference • Different participants will view different layouts in same conference • Layouts change based on dominant speaker change • Rich layout support: • Backgrounds and foregrounds • Drawing lines • Text overlays for participant identification • Large amount of participants per conference • Need to decode dozens of video sources distributed conference Surf Proprietary Information
SurfExpress PCI/e Storage Server 3G-324M/H.263 QCIF Play message in a different format IP Leave message RTP/H.263/CIF RTP/H.264/VGA Video Phone (Soft Client) Fixed Video Phone Video Mail Main challenges • Record in one format, play in another format (transcoding) • Resolution adjustment, transport adjustment (3G-324MRTP) • Generate I-frames so that recorded message starts with an I-frame • Diverse resolutions and codecs (from VGA/D1 to QCIF phones) high quality rescaling • Audio-video synchronization Surf Proprietary Information
Segment 2: IMS/NGN infrastructure There are 3 main IMS/NGN components that are involving multi-media processing Media gateway (MGW) 3G to IP video gateway Voice gateway Session Boarder Controller (SBC) Media server – Media resource function (MRF/MRFP) Surf Proprietary Information Surf Proprietary Information 9
RTP/SIP PSTN Media Gateway SIP IP phone IP/NGN SurfRider/AMC RTP/SIP 3G-324m/H.263 H.264 SIP Video phone IMS Infrastructure: Media Gateway Main challenges • Field hardened: • With top class echo canceller, T.38, interoperable • Voice quality at harsh network conditions • High density • Need iTDM for ATCA, uTCA • Low power and low footpring per port • Rich codec support • Fixed and mobile codecs • Narrowband and wideband codecs • Simultaneous voice and video support • Voice: TDMRTP • Video: 3G-324MRTP Surf Proprietary Information
SIP IP phone G.729/SRTP IPv6 G.711/RTP IPv4 SBC IP Operator A IP Operator B SurfRider/AMC IMS Infrastructure: SBC Main challenges • Packet to packet architecture (not the TDMIP based architecture of legacy telephony boards) • Voice/video transcoding • Codec A codec B • RTP framesize A framesize B • IPv4 IPv6 • Wideband codec narrowband codec • High density: • Number of concurrent sessions • Number of new calls per second (CPS) • Security: • SRTP/AES • Use the same box for other IMS infrastructure (MRF, MGW) Surf Proprietary Information
Storage Servers RTP/G.729 Prompts in G.711 (example) IP phone RTP/G.729 IP/NGN SurfExpress PCI/e DTMF AnnouncementServer IP phone IMS Infrastructure: MRF/MRFP Main challenges • High density and bottleneck-free architecture (move away from the TDM based architecture of legacy boards) • High call-per-second (CPS) score. At least 100 per board for a 10 second call duration. • Multiple services including voice/video, streaming, conferencing • Support for distributed conferencing – at least 1000 voice participants on the same bridge Surf Proprietary Information
Segment 3: Enterprise telephony Next generation IP-PBX First generation PBX supported PSTN Second generation PBX integrated an external VoIP gateway to the PBX Third generation PBX was an integration of the VoIP and PSTN in one box (IP-PBX) Forth generation PBX is an integration of all multi-media services into the IP-PBX, including Video IVVR Video conferencing Video mail Surf Proprietary Information Surf Proprietary Information 13
Surf DSP chip IP Phone PSTN Phone Modem IP PSTN PBX • VoIP GW • Conference bridge • Fax server • Modem backup connection • Codec transcoder Fax Printer Multi-Media IP-PBX Main challenges • Low cost per port / high functionality • Integration of VoIP services: • VoIP gateway, • Fax server, Internet aware fax • Conferencing bridge, • Analog modem backup connection, • Voice mail • Integration of Multi-media services: • Video mail • Video conferencing bridge • Video IVR (IVVR) Surf Proprietary Information
Segment 4: Over The Top (OTT) rich content adaptation and streaming Focused around rich content (video) IP streaming to mobile phones and PCs connected to mobile internet Various applications, including: LiveTV to mobile Mobile Video on demand (VoD) Streaming of web content to the mobile (web-to-mobile) Streaming of web content to mobile internet (web-to-web) Video Advertisements injection Surf Proprietary Information Surf Proprietary Information 15
HTTP Ad Server SurfExpress PCI/e RTP Live feed RTP/UDP/IP(unicast) flv StreamingServer Web RTCP 3GPP Storage Servers Mobile TV & Other Streaming Video Services Main challenges • Optimize Video quality, and quality of experience (QoE): • Video streaming with on-the-fly bitrate adaptation adapt to each device’s variable network connection quality • Transcoding/repurposing content from web to mobile: • Flash(FLV), H.264 & older codecs (VP6, Sorenson) • RTSP streaming and progressing download • Enable service personalization: • Advertisement injection • Logo, scrolling text, transparency (Alpha blending) • Support high resolutions in the Input • For example YouTube stores content at high quality (VGA, D1) • Support high resolutions in the Output • Relevant when streaming to laptops connected to mobile Internet. • Requires support for resolutions up to VGA in the output • Cable to mobile: • Support for Mpeg2 Transport stream (MP2TS) • Support for AAC codec Surf Proprietary Information
Thank You Surf Proprietary Information