270 likes | 382 Views
Creating Resource-Efficient V2oIP Applications for Low-MHz Mobile Processors. Fred Wydler VP VoIP Products SPIRIT DSP. About SPIRIT. Acknowledged Communications Expert. 10 years in global embedded voice software business
E N D
Creating Resource-Efficient V2oIP Applications for Low-MHz Mobile Processors Fred Wydler VP VoIP Products SPIRIT DSP
About SPIRIT Acknowledged Communications Expert • 10 years in global embedded voice software business • 200+ first-class customers, including largest OEMs and software vendors • 140 people, 70 engineers, 15 PhDs • 100+millionsembedded (HW) voicechannelspowered • Multiple international “Product of the year” awards: Selected SPIRIT Customers: …and 200+ more
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
Mobile VoIP: Start of a New Era WiFi phones Game Consoles Mobile phones VoIP Set-top boxes Wireless residential gateways Portable players
Demands of Today and Tomorrow Requirements grow higher and deeper Basic layer – traditional requirements
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
Each Service over Each Access Network IMS idea goes to the real life fast
VoIP Evolution Are you 100% sure of your Voice Engine supplier?
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
voice, audio, video Video Means See not Guess • Video performance in terms of resource limitations of mobileplatforms • Regular RISC processor inside offers up to 15fps on a PDA display • Adding HW accelerator significantly improves frame rate • Video packet loss - Video PLC • Packets’ delivery conditions do not allow smooth playback • Automatic adaptation to the channel bandwidth (ARS) • Intelligent CPU load control/playback rate control • Audio/Video synchronization
Hardware Accelerators Welcome Integrating hardware accelerators into a complete solution • Standard integration (OpenMAX™) • Custom integration Already deployed by:
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
Quality as Competitive Advantage Customer satisfaction is the goal • Mobile VoIP is a commodity (lots of providers offer VoIP services) • Zero switching costs while changing VoIP provider (caused by poor user experience: voice breaks, delays, echo) • To tie up the customer VoIP providers need to pursue voice quality vs. 3.9MOS 4.32MOS Voice quality delivered by TeamSpirit® for VoIP calls over WiFi Average real conversation voice quality delivered by typical VoIP service providers nowadays
Wideband Voice Engine Customer’s demand – wideband communication • Wideband AEC • Wideband speech codec • Wideband adapted algorithms
Agenda • VoIP on mobile: new rules of the game • To be IMS ready is the goal • Video communication – must-have functionality • Mobile VoIP. Quality wins. Wideband coming • Where the troubles come from
Where the Troubles Come From • Network challenges • Voice processing challenges • Device challenges • Integration challenges
Why Engine, not Codec? Network challenges • Smooth operation in IP networks originally not suited to real-time voice transmission • Network jitter elimination • Packet loss concealment (standard speech codecs) • Delay reduction • Packets re-ordering • Robustness to WiFi-specific network impairments • Applying new WiFi standard revisions • Advanced algorithms handling packet bulk scenario
Seamless Network Access Network challenges • Handover • Apply VoIP to different access networks (WiFi, 3G) • Network evolution to the all-IP network and mobility • Service provider has to be involved • Active and automatic handover • WiFi roaming
PSTN Experience to Achieve with VoIP Voice processing challenges • Quality issues • Voice packet loss robustness • Efficient echo cancellation • Round-trip delay minimization • Clock drift adaptation • Regular telephony services • Call mute • Call hold/resume • N-way conferencing • Call transfer • Advanced telephony services • 4x dialing • Voice mail • Caller ID
Mobile Form Factor to Survivewith Device challenges • Hardware acoustic differences • Earpiece mode support • Microphone and speaker AGC • Filtering • Intelligent non-linear processing • Battery life • Minimal MHz requirements • The least number of threads in a system and the lowest memory footprint • Effective usage of DTXmode to minimize Tx and Rx power consumption for the WiFi interface • Highly-optimized speech and video codecs • Careful optimization to specific processor architecture
VoIP Encapsulation Integration challenges • VoIP is a commodity – not everyone is an expert in VoIP • Integration is the key • Minimum number of threads • CPU load control • Time for debugging • Cross-platform code (ARM9/9E/11, TI DaVinci, TI C64x, Renesas, XScale, TI OMAP) • Support for Windows/Linux OS families • HW accelerators support • High-level API – application enabler required • Signalling (H.324M, H.323, SIP, Skype, XMPP, any proprietary protocol) • IMS application compliance
Integration is the Key What’s wrong with components? • Single components work good, but the complete solution does not • Single componentsare optimized, but the complete solution is not • Integration is difficult to manage vs.
Real Life Requirements Beyond standard specifications • Interoperability with IMS infrastructure vendors • Firewall overcoming • Testing with major operators in USA, Asia, Europe
Thank you! Voice and Video Enable your Application! Request TeamSpirit® Mobile evaluation SDK with free SIP Voice&Video phone application in it running on starting from200MHz WinMobile devices www.SpiritDSP.com request@spiritdsp.com