1 / 27

A Communication Relay Mechanism toward Construction of Virtual Cluster on Orverlay Network

A Communication Relay Mechanism toward Construction of Virtual Cluster on Orverlay Network. PRAGMA14 Working Group 11-12 March 2008 Yasuyuki Kusumoto Osaka University, Cyber media Center. Motivation of this study.

beulah
Download Presentation

A Communication Relay Mechanism toward Construction of Virtual Cluster on Orverlay Network

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Communication Relay Mechanismtoward Construction of Virtual Cluster on Orverlay Network PRAGMA14 Working Group 11-12 March 2008 Yasuyuki Kusumoto Osaka University, Cyber media Center

  2. Motivation of this study • It is difficult to unify resources on Grid and provide a single optimum computational system with a user • Heterogeneous computational environment • Disability on network connectivity, such as NAT, FW • Requirement for virtual cluster • Homogeneous computational machines ⇒virtualization technology (Xen) • End to end communication among nodes of virtual clusters ⇒orverlay network(P2P framework: PIAX) Firewall siteA NAT os:solaris library:2.0.1 Disconnectivity ・・・ siteB siteC Grid resources ・・・ ・・・ Heterogeneous os:redhat library:1.0.0 os:debian library:1.1.2

  3. Virtual cluster on overlay network(P2P) • Our approach for virtual cluster • Gathering computational machines on overlay network • Deployment of virtual machines on gathered machines • Providing a private network among virtual machines • goal • providing a customizable computational environment with a user virtual cluster virtual cluster Virtual network Virtual network virtualization virtualization Overlay network ・・・ ・・・ Grid resources ・・・

  4. A communication relay mechanism • Private network communication among virtual machines • End-to-end communication with IP regardless ofNAT,FW ⇒Virtual private network over a P2P environment • Relaying VPN communication on orverlay network • This mechanism: • delivers VPN packets on overlay network regardless of NAT, FW • allows virtual machines to communicate with IP each other Overlay network Communication relay mechanism relay relay relay relay relay Virtual machine A Virtual machine B Virtual machine C Virtual machine D Virtual machine E

  5. OrverlayNetwork The communication relay mechanism architecture VPN forward vpn packets by using logical ID communication ID communication Tunnel Agent Tunnel Agent PIAX PIAX End-to-end communication with IP IP communication VirtualNIC IP:10.8.0.a VirtualNIC IP:10.8.0.b vpnclient vpnserver workerApp masterApp hostA(worker) hostB(master)

  6. Performance evaluation of the proposed mechanism • Communication throughput • master-worker communication (bandwidth:100Mbps) • Execution of distributed computation applications • Dock cpu utilization: bignetwork utilization: small • Himeno Benchmark cpu utilization: bignetwork utilization: big

  7. Summary • The proposed mechanism • provides virtualprivate network across multiple organizations • realizes a virtual cluster on a P2P environment • Future works • Improvementof communication throughput • VPN hole-punching on overlay network • On-demand construction of virtual clusters • Automatic deployment of virtual machines by utilizing data transfer functions of P2P • Collecting resources broadly by using the resource powerful searching ability of PIAX

  8. fin

  9. Summary • The proposed mechanism • provides virtualprivate network across multiple organizations • realizes a virtual cluster on a P2P environment • Future works • Improvementof communication throughput • On-demand construction of virtual clusters • Automatic deployment of virtual machines by utilizing data transfer functions of P2P

  10. Virtual cluster

  11. Virtual cluster on overlay network(P2P) • Advantages of P2P • Scalability of computational resources • Resource Discovery • Network connectivity(solves problem of NAT, Firewall) • Goal • To provide a customizable computational environment (virtual cluster) with a user virtual cluster virtual cluster virtualization virtualization Overlay network ・・・ ・・・ Resources of grid ・・・

  12. Requirements for communication among virtual cluster nodes • Private network communication among virtual machines • End-to-end communication with IP regardless ofNAT,FW ⇒Virtual private network over a P2P environment Virtual Cluster VirtualPrivate Network virtualization virtualization Overlay network virtualization

  13. A communication relay mechanism • relays VPN communication on orverlay network • This mechanism: • delivers VPN packets on overlay network regardless of NAT, FW • allows virtual machines to communicate with IP each other Overlay network Communication relay mechanism relay relay relay relay relay Virtual machine A Virtual machine B Virtual machine C Virtual machine D Virtual machine E

  14. Motivation for study • Virtual cluster on orverlay network(P2P) • Scalability of computational resources • Discovery for resources • Virtual machine (Xen)

  15. Virtual cluster on overlay network virtual cluster virtual cluster Virtualization ・・・ Virtualization siteB Virtualization ・・・ ・・・ siteA siteC

  16. User’s job Necessity for new communication mechanism Virtual Cluster VirtualPrivate Network

  17. Performance of proposed system • Communication throughput • Execution of application • Dock :CPU-intensive application()

  18. User’s job Virtual Cluster overlay network PIAX VirtualPrivate Network virtual machine Xen Virtualization Virtualization Virtualization ・・・ ・・・ ・・・ siteA siteB siteC

  19. Summary and Future work • Summary • Proposed system enable computers on orverlay network to communicate using IP address • Realization for Construction of virtual cluster utilizing our proposed communication system • Future work • Improvementof communication throughput • On-demand construction of virtual cluster

  20. User’s job n overlay network1/2 Virtual Cluster overlay network PIAX VirtualPrivate Network virtual machine Xen Virtualization Virtualization Virtualization ・・・ ・・・ ・・・ siteA siteB siteC

  21. Virtual cluster on overlay network virtual cluster overlay network PIAX Virtualization virtual machine Xen ・・・ Virtualization siteB Virtualization ・・・ ・・・ siteA siteC

  22. User’s job Necessity for new communication mechanism Virtual Cluster VirtualPrivate Network

  23. User’s job Necessity for new communication mechanism Virtual Cluster VirtualPrivate Network virtualization virtualization Overlay network virtualization

  24. User’s job Necessity for new communication mechanism Virtual Cluster VirtualPrivate Network virtualization virtualization virtualization Overlay network

  25. Virtual cluster on overlay network(P2P) • Integration of virtual machines on wide area distributed environment(P2P) • Scalability of computational resources • Discovery for resources • Goal virtual cluster virtual cluster virtualization virtualization Overlay network ・・・ Resources of grid ・・・ ・・・

  26. virtualization Virtual network Virtual network virtual cluster virtual cluster virtual resource overlay network virtual resource ・・・ ・・・ Grid resources ・・・

More Related