280 likes | 437 Views
Supporting Multimedia in Mobile Handsets. Dror Gill, Founder and CEO Gamdala Ltd. – Mobile | Media | Knowledge dror@gamdala.com. Outline. Mobile Multimedia Market Overview Multimedia Handset Architecture Mobile Multimedia Chips and Software Standards for Mobile Multimedia Q&A.
E N D
Supporting Multimedia in Mobile Handsets Dror Gill, Founder and CEO Gamdala Ltd. – Mobile | Media | Knowledge dror@gamdala.com
Outline • Mobile Multimedia Market Overview • Multimedia Handset Architecture • Mobile Multimedia Chips and Software • Standards for Mobile Multimedia • Q&A
Scope of Mobile Multimedia Screen Savers Pictures Ring Tones Instant Messaging Animation Icons Audio Browsing Voice Java Games Video MMS
Scope of This Presentation Audio Video
Mobile Multimedia Applications • Download & Play • Streaming • Recording • Messaging • Telephony
Mobile Multimedia Market Status • Korea: • 1xRTT: Video download since 2001 • 1xEV-DO: Video streaming, recording and messaging since 2002 • Japan: • PDC/PHS/1xRTT: Picture messaging evolved into short video clip messaging in 2002 • W-CDMA: Video telephony and streaming since 2001 • 1.3 megapixel cameras and video recording to memory cards since 2003 • Europe: • GPRS: Initial video download and messaging services on Smart Phones (Nokia 7650/3650, SE P800) since 2002 • W-CDMA: Video streaming and telephony from 2003
2G Voice-Only Handset GUI & Applications RTOS Baseband Chip
2.5G Video Feature Phone Video Applications GUI & Applications RTOS RTOS Video Co-Processor Baseband Chip
2.5G/3G Smart PhoneTwo Chip Architecture GUI & Applications User OS RTOS Application Processor Baseband Chip
Multimedia Handset Architecture Audio I/O CMOS Sensor Keypad SIM Card LCD Screen Baseband Processor Multimedia Processor RF Analog BB Media Storage Data Memory Program Memory BT USB BT IR
2.5G/3G Smart PhoneSingle Chip Architecture GUI & Applications User OS RTOS Baseband/Application Processor Application Processor Core Baseband Core
Multimedia Application Processors • 2.5G Baseband/Application Processors • TI OMAP 710/730 • Intel Xscale PXA800F • Motorola i.250 (BB only) • Qualcomm MSM 6xxx • 3G Application Processors • TI OMAP 1510/1610 • Intel Xscale PXA25x/26x • Motorola DragonBall MX1 (part of i.300 chipset)
More Multimedia Application Processors • ST Nomadik • Philips Nexperia • Hitachi SH-Mobile • Emblaze Semiconductor ER4521/25 • AlphaMosaic VC01 • Atsana Semiconductor J2210 • NeoMagic MiMagic 6
Mobile Application Platforms • SymbianOS • Nokia Series 60 • UIQ (Ericsson, Motorola) • Microsoft Windows CE • Microsoft SmartPhone (Windows Mobile) • Java • Proprietary
Mobile Application Platforms - Multimedia Support • SymbianOS 7.0s • Multimedia Framework • Nokia Series 60 • RealOne Player • MMS Client • Microsoft SmartPhone • Windows Media Player • Java • JSR 135 (based on Java Media Framework) • Qualcomm Internet LaunchPad • QTV MPEG-4 Player, MP3 Player
Multimedia Software Vendors • Proprietary • Microsoft • Nancy • Thin • OplayO • HelloJava • Standard (MPEG-4) • PacketVideo • Philips MP4Net • Hantro • Emblaze • Sasken • Real • Apple
Why are Standards Needed? • Enable interoperability between devices from different vendors • Enable content to be authored once, in a single format and distributed through various wireless systems • Enable development of innovative applications and services based on standard, fully-defined systems
Don’t We Have Enough Standards? • A single standard that defines an end-to-end system of multimedia delivery over wireless channels is required • ISO/MPEG defines compression, scene description, control APIs but not transport • IETF defines transport only • ITU defines multimedia communication only • W3Cdefines standards for web content • 3GPP defines standards for GSM systems only
Components of an End-to-End Framework • Codecs • Audio, Video, Image, Text, ... • Transport protocols • Capability Exchange • Session Initiation, Media Description • Media Control • File Format
MPEG-4 H.263 AMR AAC MP4 GIF JPEG XHTML SMIL RTP/RTCP RTSP/ SDP HTTP UDP TCP TCP/IP GPRS/EDGE/W-CDMA 3GPP Packet-Switched Streaming Framework (TS 26.234)
3GPP Circuit-Switched Video Telephony Framework (3G-324M) MPEG-4 H.263 AMR G.723.1 H.263+ H.261 H.245 User Data H.223 Circuit-Switched UMTS
The MPEG-4 Standard • MPEG-4 Visual • Natural Video • Simple Profile • Simple Scaleable Profile • Core Profile • Main Profile • ... • Synthetic Video • Face Animation • Body Animation • 2D/3D Mesh • Sprites • MPEG-4 Audio • Natural Audio • AAC • TwinVQ • CELP • HVXC • HILN • Synthetic Audio • Text To Speech • General MIDI • Synthesis • MPEG-4 Systems • MP4 File Format • BIFS • Sync Layer • FlexMux • DMIF • MPEG-J • IPMP • OCI