Eucalyptus: A Middleware for the NEP

1. Eucalyptus: A Middleware for the NEP Bruce Spencer, Sandy Liu, Yong Liang National Research Council June 26, 2007

2. The community I am talking to • Scientists (natural, technical, social) who see an opportunity to accelerate their research by reaching out to a larger community • Researchers with similar interests, problems, approaches • To reach their subjects, data sources • Sharing their computing environment and resources • Multiplatform, multisite, access reusable components • Synchronous and Asynchronous • Access to people and resources for participatory sessions • Access to computing and storage devices

3. CyberInfrastructure • While hardware performance has been growing exponentially – with gate density doubling every 18 months, storage capacity every 12 months, and network capability every 9 months – it has become clear that increasingly capable hardware is not the only requirement for computation-enabled [scientific] discovery. • Cyberinfrastructure Vision for 21st Century Discovery • Networks of resources • High performance computers, communication systems • Data sources • Data collection methods, sensor networks • Data analysis methods • Data mining • Service-based computing • Stateless/stateful, standards • Virtual organizations • Having impact on society • Social networking

4. More from Cyberinfrastructure Vision for 21st Century Discovery In facilitating the creation and support of effective virtual organizations, NSF will focus on three essential elements: • the creation of a common technological framework that promotes seamless, secure integration across a wide range of shared, geographically-distributed resources; • the establishment of an operational framework built on productive and accountable partnerships developed among system architects, developers, providers, operators, and • end users who span multiple communities;…

5. More of NSF’s vision Together, Web Services and service-oriented architectures are emerging as a standard framework for interoperability among various software applications on different platforms. They provide important characteristics such as standardized and well-defined interfaces and protocols, ease of development, and reuse of services and components, making them potential central facets of the cyberinfrastructure software ecosystem.

6. Broker 2:Search 3:Bind 1:Publish Provider Client 4:Invoke 5:Respond Service Oriented Architectures • Model of distributed, shared computing • Evolution: Objects/Messages, Client/Server • Simplified model: Stateless services that complete some function • Platform and language independent, sharable components • XML Standards • WSDL: Description, SOAP: Packaging • WS Triangle • Development environments: Eclipse WSToolKit • Repositories XMethods • Workflows • BPEL: Ties services together • Relevant for business models • Semantics of Services • OWL-S, WSMO: descriptions in logic of purpose and interface

7. Eucalyptus in action

8. Eucalyptus Layers Eucalyptus Website WS (Tomcat) Resource JNLPApplication Client WS (Tomcat) Resource SessionManager Resource Manager User Manager JNLPApplication WS (Tomcat) Resource Client WS (Tomcat) Resource JNLPApplication Client ClientPDSC ManagementServices Framework PDSF

9. User Mgmt Web Service Resource Mgmt Web Service Session Management Web Service Management Web Services

11. Eucalyptus Client • A Java Desktop Application • Integrated Web Services Clients • A dashboard that controls and configures sessions • Implemented as a floating dock • Use Java Web Start to simplify deployment and maintenance

12. Management Web Services Manages the resources and users Users interact with the system by engaging in sessions Selecting people s/he wants to interact with and the resource that supports the interaction (e.g. High-Def VideoConference) Status of sessions, resources, and users can be acquired through these management services

13. Resource Hosts • Web Services platform (HTTP + Servlet Container + SOAP engine) installed • All Resources (e.g. videoconference) are wrapped as Web Services • Hides configuration complexity for each resource

14. APN - Articulated Private Network This Web Service allows a Eucalyptus admin user to configure an APN using UCLPv2. Eucalyptus users can then use this configured APN as a resource for connectivity.

15. Eucalyptus Resources used by Architect / Industrial Design Community: CIMS • Pleora videoconferencing • Pleora’s devices for converting digital media signal into IP • Standard Definition: 270 Mbps uncompressed • Signal can be easily accommodated by 1Gbps CANET4 • Ultragrid HD Videoconference • A Sweet Spot: $8K and a lightpath gives you point to point HD • Isabel multi-site videoconferencing • Autodesk Maya • Qube: rendering from Maya • OpenSceneGraph for visualization • DCV: graphics acceleration from IBM • RVN for two-way graphics application sharing • SVN for display over multiple monitors • UCLPv2 Lightpath configuration • CD++ Simulation system • Jabber Chat

16. How might you use Eucalyptus? • Set up a session with a number of people accessing a number of resources for a certain period of time • Schedule a session with colleagues every Monday morning at 9:00 using Maya and lightpaths for an hour • Files • File transfer over lightpaths (can be tricky) • Desktop applications (standalone) • Use tool to share desktop with colleagues: VNC • Both can move mouse, keyboard, etc. • E.g Suppose an application licence costs $100,000 per desktop, you can share it across your network, saving you cost of more licences • Networked applications (that already run in multiple locations) • Set up lightpath between locations • Bring them into the session

17. Adding your own resource • You have a custom application • allows you to visualize a virtual phenomenon (weather maps in real time, connected to many observation points) • You want to incorporate it to Eucalyptus to show your colleague • You build a hosted Web Service that invokes your application • You provide the WSDL URL • our software builds the stubs in Java • compiles them and deploys to our management service. • We generate a generic client interface • Similar to xMethods • Probably want to customize for end-user client • Now any Eucalyptus user can use your resource

18. Eucalyptus Workflow

19. Workflow for High Definition Tool

20. 2-step Conference First step Two sub groups Second step One big group If a resources is not available (fault) We invoke backup

21. Working with the NRC team • We are looking for NEP partners • Want to incorporate Eucalyptus • Interested in doing own development, customization with our support • We provide software for basic management services • We plan to licence the software as OpenSource across the set of our NEP partners • No sublicencing • After the technology is more mature, and then will open source in the usual sense with sublicences, modifibility. • By then there will be a healthy Eucalyptus community

22. Eucalyptus Facts • Eucalyptus provisions resources to users in sessions • Client code is in Java, delivered by Java WebStart • Resources deployed, configured through Web Services • Sessions can be scheduled • To start immediately • to start/stop at specific times • New resources are easy to add • New resource deployed by a Web Service easily integrated • Services can be hosted on any platform • Two sets of clients • End-user for start/stop resources • Admin user for configure resources • Eucalyptus is simple, lightweight, adaptable

27. Layer 1/2 and Layer3 • Lightpaths require a computer with access to layer 1 • Direct connections through optical switches • Access to Web Services usually requires access to layer 3 • Routed network, the usual internet • We have one computer that can access two networks

29. Driver for User Controlled Networks • More and more organizations are acquiring their own fiber networks • Acquiring fiber in the long haul is very expensive to light and obtain • Alternative is to use “dim fiber” – point to point wavelengths • But want flexibility to do configuration and change management as with dark fiber • e-Science needs dedicated networks for specific applications and disciplines for high data volume grids • Want to be able to manipulate the network in the same way they can manipulate the application • SOA and networks • Can provide the same user control over networks as with applications

30. What is UCLP? • Stands for User-Controlled Lightpath Provisioning • A configuration and provisioning tool: http://www.uclp.ca/ • Treats network resources as software objects • Uses Service Oriented Architecture (SOA) and so network can be integrated with other Web Service applications • Extends the network into the application • Creates discipline or application-specific IP network • Supports for high-end e-science and grid applications

31. What is an APN – VPN enabled by UCLP • Articulated Private Network is the Next generation VPN • normal VPNs but able to have any topology • Network operators can make part of their resources available to end users • The end users can then assemble these various Web Services into multiple network virtualizations, i.e. APNs, running their own protocols and services. • Extending the Application into the Network: • users can make use of the network resources whenever they are required, effectively bringing the network into the application itself. • Not only can the end users control and manage their own private high speed networks, but so can their sensors, instruments and applications.

32. CANARIE provides APN to NRC Edmonton Saskatoon Vancouver Winnipeg Ottawa Montreal Regina Toronto Calgary Fredericton Seattle Chicago New York Halifax CA*net 4 router 2G Lightpath WS GbE interface WS Source: Bill St Arnaud

33. NRC partitions APN Edmonton Saskatoon Winnipeg Ottawa Montreal Regina Toronto Calgary Fredericton Seattle Chicago New York Halifax Source: Bill St Arnaud

34. NRC logical view of APN Edmonton Saskatoon Vancouver Winnipeg Ottawa Regina Montreal Victoria Toronto Fredericton Seattle Chicago New York Source: Bill St Arnaud Halifax

35. Regional Tomorrow’s peer to peer IP network World World National DWDM Network World Child Lightpaths NREN B NREN A NREN C NREN D Child Lightpaths University Server Source: Bill St Arnaud