1 / 29

Dynamic Topology Adaptation of Virtual Networks of Virtual Machines

Demonstrate feasibility & benefits of adaptation in virtual environments at VM & VNET level for BSP applications, studying effectiveness & challenges.

johnsonjames
Download Presentation

Dynamic Topology Adaptation of Virtual Networks of Virtual Machines

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Dynamic Topology Adaptation of Virtual Networks of Virtual Machines Ananth I. Sundararaj Ashish Gupta Peter A. Dinda Prescience Lab Department of Computer Science Northwestern University http://virtuoso.cs.northwestern.edu

  2. Summary • Dynamically adapt applications in virtual environments to available resources • Demonstrate the feasibility of adaptation at the level of collection of VMs connected by VNET • Show that its benefits can be significant for the case of BSP applications • Studying the extent of applications for which our approach is effective

  3. Outline • Virtual machine grid computing • Virtuoso system • Networking challenges in Virtuoso • Enter VNET • VNET, VTTIF Adaptive virtual network • Experiments • Current Status • Conclusions

  4. Virtual Machine Grid Computing Deliver arbitrary amounts of computational power to perform distributed and parallel computations Aim 1 Traditional Paradigm New Paradigm 2 5 Grid Computing using virtual machines Resource multiplexing using OS level mechanism Grid Computing 4 3a 3b 6a Problem1: 6b Virtual Machines What are they? Complexity from resource user’s perspective Solution Problem2: How to leverage them? Complexity from resource owner’s perspective

  5. Virtual Machines Virtual machine monitors (VMMs) • Raw machine is the abstraction • VM represented by a single • image • VMware GSX Server

  6. The Simplified Virtuoso Model Virtual networking ties the machine back to user’s home network User’s LAN Specific hardware and performance VM Basic software installation available Orders a raw machine Virtuoso continuously monitors and adapts User

  7. User’s View in Virtuoso Model User’s LAN VM User

  8. Outline • Virtual machine grid computing • Virtuoso system • Networking challenges in Virtuoso • Enter VNET • VNET, VTTIF Adaptive virtual network • Experiments • Current Status • Conclusions

  9. Why VNET? A Scenario Foreign hostile LAN User’s friendly LAN IP network User has just bought Virtual Machine

  10. Why VNET? A Scenario VM traffic going out on foreign LAN Foreign hostile LAN X User’s friendly LAN IP network Virtual Machine Host • A machine is suddenly plugged into a foreign network. What happens? • Does it get an IP address? • Is it a routeable address? • Does firewall let its traffic • through? To any port? Proxy VNET: A bridge with long wires

  11. VNET startup topology Foreign LAN 1 TCP Connections User’s LAN VM 1 Host 1 + VNET IP network Proxy+ VNET Foreign LAN 2 Host 3 + VNET VM 2 VM 4 Host 4 + VNET Host 2 + VNET VM 3 Foreign LAN 3 Foreign LAN 4

  12. A VNET Link VM “eth0” Ethernet Packet Captured by Interface in Promiscuous mode First link Second link (to proxy) “Host Only” Network VM “eth0” ethy ethz vmnet0 vmnet0 IP Network VNET VNET Ethernet Packet Tunneled over TCP/SSL Connection Host Host Ethernet Packet is Matched against the Forwarding Table on that VNET Ethernet Packet is Matched against the Forwarding Table on that VNET Local traffic matrix inferred by VTTIF Periodically sent to the VNET on the Proxy

  13. VTTIF • Topology inference and traffic characterization for applications • Ethernet-level traffic monitoring • VNET daemons collectively aggregate a global traffic matrix for all VMs • Application topology is recovered using normalization and pruning algorithms

  14. VTTIF Operation Synced Parallel Traffic Monitoring Traffic Filtering and Matrix Generation Matrix Analysis and Topology Characterization

  15. Dynamic Topology Inference VNET Daemons VNET Daemons 1. Fast updates Smoothed Traffic Matrix 2. Low Pass Filter Aggregation 3. Threshold change detection Topology change output

  16. Reaction time of VTTIF

  17. Outline • Virtual machine grid computing • Virtuoso system • Networking challenges in Virtuoso • Enter VNET • VNET, VTTIF Adaptive virtual network • Experiments • Current Status • Conclusions

  18. Adaptation Adapt to available resources Virtuoso presents tremendous opportunities and challenges Challenges Network and host monitoring Adequacy of available mechanisms Monitor application Infer goals of application Challenges interrelated To determine subset of applications for which such adaptation succeeds We demonstrate that the subset is not empty

  19. Experiments • Focus on a specific instance • Application : Patterns, a synthetic benchmark • Monitoring : Application topology inferred by VTTIF • Aim : Minimize running time of patterns • Mechanism : Add links and corresponding forwarding rules to VNET topology Performance of BSP applications significantly enhanced by adapting VNET topology, guided by topology inferred by VTTIF

  20. Illustration of dynamic adaptation in Virtuoso Fast-path links amongst the VNETs hosting VMs Resilient Star Backbone User’s LAN Foreign host LAN 1 VM 1 Host 1 + VNET IP network Proxy+ VNET Merged matrix as inferred by VTTIF Foreign host LAN 2 VM 2 VM 4 VM 3 Host 3 + VNET Host 4 + VNET Host 2 + VNET Foreign host LAN 4 Foreign host LAN 3

  21. Evaluation • Reaction time of VNET • Benefits of adaptation (performance speedup) • Eight VMs on a single cluster, all-all topology • Eight VMs spread over two clusters over MAN, bus topology • Eight VMs spread over WAN, all-all topology

  22. Reaction Time

  23. Benefits of Adaptation Benefits accrued as a function of the number of fast-path links added • Patterns has an all-all topology • Eight VMs are used • All VMs are hosted on the same cluster

  24. Benefits of Adaptation Benefits accrued as a function of the number of fast-path links added • Patterns has a bus topology • Eight VMs are used • VMs spread over two clusters over a MAN

  25. Benefits of Adaptation Benefits accrued as a function of the number of fast-path links added • Patterns has an all-all topology • Eight VMs are used • VMs are spread over WAN

  26. Outline • Virtual machine grid computing • Virtuoso system • Networking challenges in Virtuoso • Enter VNET • VNET, VTTIF Adaptive virtual network • Experiments • Current Status • Conclusions

  27. Current Status • Applications: Transactional web ecommerce application • Mechanisms: VM migration

  28. Conclusions • Demonstrated the feasibility of adaptation at the level of collection of VMs connected by VNET • Showed that its benefits can be significant for the case of BSP applications • Studying the extent of applications for which our approach is effective • Moving ahead to use other adaptation mechanisms

  29. For More Information • Prescience Lab(Northwestern University) • http://plab.cs.northwestern.edu • Virtuoso: Resource Management and Prediction for Distributed Computing using Virtual Machines • http://virtuoso.cs.northwestern.edu • VNET is publicly available from • http://virtuoso.cs.northwestern.edu

More Related