1 / 22

Towards Sustained Scalability of Communication Networks

Towards Sustained Scalability of Communication Networks. Mike P. Wittie mwittie@cs.ucsb.edu. Changing Traffic Patterns. High bandwidth cost of inter-user traffic. High delay of local communications. Diverse Traffic Requirements. Inter-user communications. Real-time traffic.

moses-carter
Download Presentation

Towards Sustained Scalability of Communication Networks

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Towards Sustained Scalability of Communication Networks Mike P. Wittie mwittie@cs.ucsb.edu

  2. Changing Traffic Patterns High bandwidth cost of inter-user traffic High delay of local communications

  3. Diverse Traffic Requirements Inter-user communications Real-time traffic Autonomous device traffic

  4. Challenges to Sustained Net. Scalability • Are existing network architectures well-suited to meet evolving traffic requirements? • Throwing capacity at the problem is not cost efficient or effective • Cannot reduce end-to-end delay • Existing capacity not used effectively ?

  5. Dissertation Research Overview • Network engineering process • Clean slate ideas • Dirty slate solutions Network Measurement MIST [Broadnets ’07] AirLab [CCR ’11] ParaNets [HotMobile ‘07] Topology Design Cloud Routing [Comcom ‘09] SISR [SECON ’09] Distr. OSNs [CoNEXT ‘10] Resource Allocation AggrBP [in preparation]

  6. Online Social Networks (OSNs) • OSNs are fun, socially significant, and here to stay • OSN traffic is the next evolution in Internet usage • How is OSN traffic different? • Can we deliver OSN traffic more effectively? Mike P. Wittie, VeljkoPejovic, Lara Deek, Kevin C. Almeroth, Ben Y. Zhao "Exploiting Locality of Interest in Online Social Networks," in ACM CoNEXT, 2010.

  7. Project Overview • Infrastructure discovery • DNS redirection • Interaction analysis • Crawls of public profiles • Protocol discovery • Packet traces • Path measurement • PlanetLab + ping High latency and loss paths U.S.-centralized infrastructure Local communication patterns Inefficient routing High network costs Unresponsive service

  8. Facebook’s Infrastructure

  9. Social Graph and Interactions Users and Social Links • Locality of interest: • Percentage of user communications within a region • Web crawls of public user profiles • Social graph • Interaction history • Local-to-Local • Remote-to-Local • Local-to-Remote Remote Local

  10. Locality of Interest: Posts Local to Remote Local to Local Remote to Local Many posts between local users

  11. Delivery Ratio of Wall Posts Local to Remote Local to Local Remote to Local Needlessly routed through the U.S.

  12. Internet Path Measurement • High latency and loss but separable by a regional proxy Facebook Facebook Regional Server Akamai Akamai User User

  13. Discussion Challenges Solutions Locality of interest allows OSN state partitioning:REGIONAL OSN CACHES Split the high latency and loss path segments:REGIONAL TCP PROXIES • Infrastructure centralization results in inefficient routes • Many round trips and poor paths inflate request delay

  14. Current Facebook Architecture With TCP Proxies Post Post 3. Static content 3. Static content 1. New content 1. New content 1, 2, 3 2. Display markup 2. Display markup Facebook Regional Server Facebook Akamai Akamai User User

  15. Current Facebook Architecture With Regional Caches Poll Poll 3. Static content 3. Static content 1. Any new content? 1. Any new content? 1, 2, 3 2. Concatenated display markup 2. Concatenated display markup Facebook Facebook Regional Server Akamai Akamai User User

  16. Simulating Facebook Traffic Inputs Simulation Core Metrics Interaction History Transaction Delay Transaction Traces Network Load Social Graph Cache Usage Path Measurement

  17. Delay of Post Transactions TCP proxies significantlyreduce transaction delay

  18. Network Load Regional caches significantlyreduce load on Internet paths

  19. Discussion • Lack of sophisticated topology design has significant impact on Facebook performance: • Inefficient centralized processing of regional communications • Unresponsive service due to high latency and loss on Internet paths and many round trips • Regional TCP proxies and caches can improve OSN responsiveness • Distributed infrastructure is a more effective scaling strategy • Infrastructure design that can conform to communication patterns • Multi-cloud service deployments and optimization

  20. Summary and Conclusions • Sustained network scalability challenged by changing traffic patterns • More sophisticated network design and resource management methods can address fundamental limitations of existing deployments • Networks scalability an important problem: • Allow the Internet to continue to play important role in our lives • Support new types of applications • Maintain democratic access to digital communications • Clean slate ideas and dirty slate solutions for a new set of problems

  21. Vision for Future Work • Clean slate ideas and dirty slate solutions a fruitful and valid research approach • Networks scalability an important problem: • Allow the Internet to play important role in our lives • Support new types of applications • Maintain democratic access to digital communications • Apply my research philosophy to a new set of problems: • Large distributed applications in a diverse cloud services ecosystem • Autonomous device coordination and services

More Related