ICEBERG: An Architecture for Multimodal, Multimedia Communications Randy H. Katz UC Berkeley

1. Bridge to the Future ICEBERG: An Architecture for Multimodal, Multimedia CommunicationsRandy H. KatzUC Berkeley S. S. 7 ETH Zurich November 1999 http://iceberg.cs.berkeley.edu Cellular “Core” Network

2. Outline • Motivation • It’s all about Services • The ICEBERG Project • Summary and Conclusions

3. Outline • Motivation • It’s all about Services • The ICEBERG Project • Summary and Conclusions

4. Mobile Telephone & Internet Users Millions Mobile Telephone Users Internet Users Year Source: Ericsson Radio Systems, Inc.

5. Data Dominates United States Network Traffic Growth (gigabits, bn) Source: Nortel in The Economist, 13 Mar 99

6. Local Switch Local Switch Interexchange Network (IXC) PSTN Voice Traffic Connection-Oriented Local Switch IWF + Router Local Switch IWF + Router Local Exch Net (LEC) Local Exch Net (LEC) Local Exch Local Exch Data Traffic Packet-Oriented IP-Based WAN Access Network Access Network Local Gateway Local Gateway Core Network Core Network BecomesData-Oriented

7. Core Network BecomesData-Oriented • Appl-specific routing overlays, e.g., info dissemination • Routing infrastructure with DiffServ support • Service-level agreements spanning multiple ISPs • Services running on servers in the infrastructure VoIP Gateway VoIP Gateway Packet-Oriented IP-Based WAN Router Router Access Network Access Network Core Network

8. PDA PCS Qualcomm PDQ Phone Smart Appliances/Thin Clients

9. Top Gun MediaBoard • Participates as a reliable multicast client via proxy in wireline network • Top Gun Wingman • “Thin” presentation layer in PDA with full rendering engine in wireline proxy

10. Critical Trends • Multimedia / Voice over IP networks • Lower cost, more flexible packet-switching core network • Simultaneous support for delay sensitive and delay insensitive flows via differentiated services • Intelligence shifts to the network edges • Third-party functionality downloaded into Information Appliances like PalmPilots • Programmable intelligence inside the network • Proxy servers intermixed with switching infrastructure • Mobile/extensible code, e.g., JAVA: “write once, run anywhere” • Rapid new service development • Speech-based services

11. Outline • Motivation • It’s all about Services • The ICEBERG Project • Summary and Conclusions

12. The Future: Internet-basedOpen Services Architecture “Today, the telecommunications sector is beginning to reshape itself, from a vertically to a horizontally structured industry. … [I]t used to be that new capabilities were driven primarily by the carriers. Now, they are beginning to be driven by the users. … There’s a universe of people out there who have a much better idea than we do of what key applications are, so why not give those folks the opportunity to realize them. … The smarts have to be buried in the ‘middleware’ of the network, but that is going to change as more-capable user equipment is distributed throughout the network. When it does, the economics of this industry may also change.” George Heilmeier, Chairman Emeritus, Bellcore

13. Universal In-box Transparent Information Access Speech-to-Text Speech-to-Voice Attached-Email Call-to-Pager/Email Notification Email-to-Speech All compositions of the above! Policy-based Location-based Activity-based

14. A/V Devices Path ICSI Speech Recognizer Text to Command Room Entity Audio Text Cmd Microphone Cell phone Response to Client Composable Services • E.g., voice control of A/V devices in a “Smart Room” • Multistage processing transformation • Strongly typed connectors • Service discovery service • Automated path generation

15. Outline • Motivation • It’s all about Services • The ICEBERG Project • Summary and Conclusions

16. ICEBERG: Internet-based core for CEllular networks BEyond the thiRd Generation • Motivation: • People use a multitude of communication devices and networks: • Cell phones, PSTN, VoIP, E-mail, V-mail, fax, etc. • 3G cellular: UMTS/IMT2000 • Wireless LANs: Bluetooth / HomeRF • Home Access Networks: DSL / Cable modem • Access to real-time services embedded in diverse networks • Model: Person-to-Person and Person-to-Service communication across diverse access networks • Not device to device! • Service handoff across devices and access networks • Potentially Any Network Service (PANS) • Different coverage, bandwidth, latency, and cost characteristics

17. ICEBERG Goals • Demonstrate ease of new service deployment • Packet voice for computer-telephony integration • Speech- and location-enabled applications • Complete interoperation of speech, text, fax/image across the PDAs, pads, pagers, phones (4 P’s) • Mobility and generalized routing redirection • Demonstrate new service architecture supporting innovative applications • Personal Information Management • Universal In-box: e-mail, news, fax, voice mail • Notification redirection: e.g., e-mail, pager • Home networking and control of “smart” spaces, sensor/actuator integration • Build on experience with A/V equipped rooms in Soda Hall

18. SimMillennium Network Infrastructure Experimental Testbed IBM WorkPad Velo Nino MC-16 Motorola Pagewriter 2000 CF788 Pager WLAN / Bluetooth 306 Soda 405 Soda H.323 GW 326 Soda “Colab” GSM BTS TCI @Home Millennium Cluster Smart Spaces Personal Information Management Millennium Cluster

19. Bases (1M’s) • scalable, highly available • persistent state (safe) • databases, agents • “home” base per user • service programmingenvironment Wide-Area Path • Active Proxies (100M’s) • not packet routers, may beactive networking nodes • bootstrap thin devices into infrastructure • soft-state and well-connected • Units (1B’s) • sensors / actuators • PDAs / smartphones / PCs • heterogeneous • Minimal functionality: “Smart Clients” Jini devices NINJA Distributed Computing Platform

20. ICEBERG Feature Set • Potentially Any Network Services (PANS) • Any service can from any network by any device; network/device independence in system design • Personal Mobility • Person as communication endpoint with single identity • Service Mobility • Retain services across networks • Easy Service Creation and Customization • Allow callee control & filtering • Scalability, Availability, Fault Tolerance • Security, Authentication, Privacy

21. ICEBERG Architectural Elements • ICEBERG Access Point (IAP) • Encapsulates network specific gateway (control and data) • ICEBERG Point of Presence (iPOP) • Performs detailed signaling • Call Agent: per communication device per call party • Call Agent Dispatcher: deploy call agent • Name Mapping Service • Mapping between iUID (Iceberg Unique ID) and service end point • Preference Registry • Contains user profile: service subscription, configuration, customization • Personal Activity Tracker (PAT) • Tracks dynamic information about user of interest • Automatic Path Creation Service • Creates datapath among participants’ communications devices

22. Transducer Agent IAP IAP IAP IAP IAP Redirection Agent Transformation and Redirection Pager IP Core GW Cellular Network WLAN GW GW H.323 GW PSTN

23. IAP IAP iPOP iPOP IAP IAP iPOP iPOP IAP IAP Naming Server Preference Registry Personal Activity Tracker APC Server More Detailed View GSM PSTN WaveLAN Pager Iceberg Network Cal GSM PSTN Stanford

24. iPOP administration domains Multicast tunnels More Detailed View GSM PSTN IAP IAP iPOP iPOP WaveLAN IAP Pager IAP iPOP iPOP IAP IAP GSM PSTN

25. ICEBERG Signaling System • Signaling System • Distributed system w/agents communicating via signaling protocol for call setup, routing, & control • ICEBERG Basic Call Service • Communication of two or more call participants using any number of communication devices via any kind of media • If call participant uses more than one devices, must be used synchronously • Essential Approach • Loosely coupled, soft state-based signaling protocol w/group communication • Call Session: a collection of call agents that communicate with each other

26. iPOP iPOP Call Agent Dispatcher Call Agent Dispatcher 4 2 3 5 8 9 1 Call Agent Call Agent 7 3 IAP IAP 10 12 11 iPOP Call Agent Dispatcher 6 13 16 Call Agent 15 14 IAP Signaling: Call Session Establishment Bob Alice Carol Name Mapping Service Preference Registry

27. Call Control and Call States • Control • For established call session, alter/propagate call states. Modify datapath correspondingly • States • Call party identities, in-use devices in use & their call status, datapath information on active data streams • Challenge • Reliable propagation of call state changes to call agents, given highly dynamic call session environment • ICEBERG Approach • Light Weight Sessions • IAP: network specific gateways maintain hard state • IAPs and iPOPs exchange heartbeats; loss triggers recovery

28. Announce Announce Data Path Table Listen Listen Add or remove path Create/tear down data path Create/tear down data path Call Agent Light-Weight Call Session Call Session Call Agent Call Agent Call State Table Auto Path Creation

29. New ICEBERG Capabilty: Service Handoff • Service handoff occurs when users switch communication devices in midst of call session • Enables service mobility • Service handoff is: • Generalized call transfer • Special case of conference call • User uses one device to invite another device • Then hangs up the first device

30. handoff from cell phone to VAT Cell phone turned off announce announce Listen Listen Start new IAP announce Listen Service Handoff Scenario:Cell Phone to Laptop Caller IAP Callee IAP Multicast Session Caller IAP2

31. handoff from cell phone to VAT Cell phone turned off announce Listen Start new IAP announce Listen Service Handoff Scenario Caller IAP Callee IAP Multicast Session Caller IAP2 • Simple reliability scheme • IAP fault tolerant • Simultaneous service handoff • Multiparty calls trivial • Security through encryption

32. Office Phone Cell Phone E-mail access via phone Home Phone E-Mail Important e-mail headers Pager Voice Mail New ICEBERG Capabilty: Policy-Based Redirection Friends & family calls Calls during business hours Calls in the evening Anonymous Calls

33. Policy-Based Redirection IF (9AM < hour < 5 PM) THEN Preferred-End-Point = Office-Phone IF (5 PM < hour < 11 PM) THEN Preferred-End-Point = Home-Phone IF (11 PM < hour < 9 AM) THEN Preferred-End-Point = Voice-Mail Personal Activity Tracker Other Personal State Callee location Callee state Preference Registry Callee’s Preferred End Point Per Call State e.g., Caller ID Time of Day Caller End Point Type User Preference Profiles

34. Preference User Interface

35. Outline • Motivation • It’s all about Services • The ICEBERG Project • Summary and Conclusions

36. Implementation Status • Much of architecture initially implemented • IAPs: GSM, PSTN (H.323), WaveLAN; Service handoff • iPOPs in Berkeley CS LAN: local area components for name service, pref resolution, activity tracking • Areas under development: • Wide-area APC for service composition and instantiation • Graphical capture/playback of user preference specs • Billing architecture • New services to test the architecture: • Call completion on busy subscriber • Ninja jukebox to audio information appliance • Evaluation • Critical metric is scalability, resistance to failure • Soft-state vs. hard-state performance tradeoffs

37. Connectors Data Plane Operators APC Paths IAP PRLS PAT Pref Reg ActiveProxies Name Svc Bases Control Plane Ninja Execution Environment Units Summary

38. Conclusions • Emerging Network-centric Distributed Architecture spanning processing and access • Open, composable services architecture--the wide-area “operating system” of the 21st Century • Beyond the desktop PC: information appliances supported by infrastructure services--multicast real-time media plus proxies for any-to-any format translation and delivery to diverse devices • Common network core: optimized for data, based on IP, enabling packetized voice, supporting user, terminal, and service mobility