1 / 21

Wide-Area Route Control for Distributed Services

Vytautas Valancius, Nick Feamster, Akihiro Nakao, and Jennifer Rexford. Wide-Area Route Control for Distributed Services. Cloud Computing. Cloud computing is on the rise Provides computing resources and storage in cloud data centers Hosting on the steroids for Internet services.

sheryl
Download Presentation

Wide-Area Route Control for Distributed Services

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Vytautas Valancius, Nick Feamster, Akihiro Nakao, and Jennifer Rexford Wide-Area Route Control for Distributed Services

  2. Cloud Computing • Cloud computing is on the rise • Provides computing resources and storage in cloud data centers • Hosting on the steroids for Internet services

  3. Accessing Services in the Cloud • Hosted services have different requirements • Too slow for interactive service, or • Too costly for bulk transfer! ISP1 Cloud Data Center Internet Data Center Router ISP2 Routing updates Interactive Service Bulk transfer Packets

  4. Cloud Routing Today • Multiple upstream ISPs • Amazon EC2 has at least 58 routing peers in Virginia data center • Data center router picks one route to a destination for all hosted services • Packets from all hosted applications use the same path

  5. Route Control: “Cloudless” Solution • Obtain connectivity to upstream ISPs • Physical connectivity • Contracts and routing sessions • Obtain the Internet numbered resources from authorities • Expensive and time-consuming!

  6. Routing with Transit Portal (TP) Cloud Data Center Internet ISP1 Virtual Router A Transit Portal Virtual Router B Interactive Service ISP2 Full Internet route control to hosted cloud services! Routes Bulk transfer Packets 6

  7. Outline • Motivation and Overview • Connecting to the Transit Portal • Advanced Transit Portal Applications • Scaling the Transit Portal • Future Work & Summary

  8. Connecting to the TP • Separate Internet router for each service • Virtual or physical routers • Links between service router and TP • Each link emulates connection to upstream ISP • Routing sessions to upstream ISPs • TP exposes standard BGP route control interface

  9. Basic Internet Routing with TP • Cloud client with two upstream ISPs • ISP 1 is preferred • ISP 1 exhibits excessive jitter • Cloud client reroutes through ISP 2 ISP 2 ISP 1 Traffic Transit Portal BGP Sessions Virtual BGP Router Interactive Cloud Service

  10. Current TP Deployment • Server with custom routing software • 4GB RAM, 2x2.66GHz Xeon cores • Three active sites with upstream ISPs • Atlanta, Madison, and Princeton • A number of active experiments • BGP poisoning (University of Washington) • IP Anycast (Princeton University) • Advanced Networking class (Georgia Tech)

  11. TP Applications: Fast DNS • Internet services require fast name resolution • IP anycast for name resolution • DNS servers with the same IP address • IP address announced to ISPs in multiple locations • Internet routing converges to the closest server • Available only to large organizations

  12. TP Applications: Fast DNS • TP allows hosted applications use IP anycast Asia North America ISP1 ISP2 ISP3 ISP4 Transit Portal Transit Portal Anycast Routes Name Service Name Service

  13. TP Applications: Service Migration • Internet services in geographically diverse data centers • Operators migrate Internet user’s connections • Two conventional methods: • DNS name re-mapping • Slow • Virtual machine migration with local re-routing • Requires globally routed network

  14. TP Applications: Service Migration Asia Internet North America ISP1 ISP2 ISP3 ISP4 Transit Portal Transit Portal Tunneled Sessions Active Game Service

  15. Scaling the Transit Portal • Scale to dozens of sessions to ISPs and hundreds of sessions to hosted services • At the same time: • Present each client with sessions that have an appearance of direct connectivity to an ISP • Prevented clients from abusing Internet routing protocols

  16. Conventional BGP Routing ISP2 ISP1 • Conventional BGP router: • Receives routing updates from peers • Propagates routing update about one path only • Selects one path to forward packets • Scalable but not transparent or flexible BGP Router Client BGP Router Client BGP Router Updates Packets

  17. Scaling BGP Memory Use ISP1 ISP2 • Store and propagate all BGP routes from ISPs • Separate routing tables • Reduce memory consumption • Single routing process - shared data structures • Reduce memory use from 90MB/ISP to 60MB/ISP Routing Process Routing Table 1 Routing Table 2 Virtual Router Virtual Router Bulk Transfer Interactive Service

  18. Scaling BGP CPU Use ISP1 ISP2 • Hundreds of routing sessions to clients • High CPU load • Schedule and send routing updates in bundles • Reduces CPU from 18% to 6% for 500 client sessions Routing Process Routing Table 1 Routing Table 2 Virtual Router Virtual Router Bulk Transfer Interactive Service

  19. Scaling Forwarding Memory for TP ISP1 ISP2 • Connecting clients • Tunneling and VLANs • Curbing memory usage • Separate virtual routing tables with default to upstream • 50MB/ISP -> ~0.1MB/ISP memory use in forwarding table Forwarding Table Forwarding Table 1 Forwardng Table 2 Virtual BGP Router Virtual BGP Router Bulk Transfer Interactive Service

  20. Future Work • Future work: • More deployment sites • Making TP accessible for network research test-beds (e.g., GENI, CoreLab) • Faster forwarding (NetFPGA, OpenFlow) • Lightweight interface to route control

  21. Conclusion • Limited routing control for hosted services • Transit Portal gives wide-area route control • Advanced applications with many TPs • Open source implementation • Scales to hundreds of client sessions • The deployment is real • Can be used today for research and education • More information http://valas.gtnoise.net/tp Questions?

More Related