StratusLab: Enhancing Grid Infrastructures with Virtualization and Cloud Technologies

1. StratusLab: Enhancing Grid Infrastructures with Virtualization and Cloud Technologies • C. Loomis (CNRS/LAL, SixSq Sàrl) • Canada-EU Future Internet Workshop (Waterloo, Canada) • 23-24 March 2011

2. Contents • Biography • StratusLab Project • Goals • Targeted users • Current status • Interactions with Other DCI Projects • EDGI, EGI, EGI-InSPIRE, EMI, IGE, VENUS-C • Conclusions

3. Biography • High-Energy Physicist (<2001) • E735 (Duke), FermilabTevatron • CDF (Rutgers), FermilabTevatron • ALEPH (CERN), CERN LEP • ATLAS (UCSC), CERN LHC • Grid & Cloud Computing (2001—) • European DataGrid: Integration and deployment • EGEE, EGEE-II, EGEE-III: Coordinator for user-facing activities • Quattor: Principal developer for pan language compiler • StratusLab: Project Coordinator • SixSq Sàrl (2007—) • Founded in 2007 by 3 partners, based in Geneva • Provides consulting and tools for automated systems testing

4. StratusLab Project • Goal • Createcomprehensive, open-source,IaaS cloud distribution • Focus on supporting grid services • Information • 1 June 2010—31 May 2012 (2 years) • 6 partners from 5 countries • Budget : 3.3 M€ (2.3 M€ EC) • Contacts • Site web: http://stratuslab.eu/ • Twitter: @StratusLab • Support: support@stratuslab.eu CNRS (FR) UCM (ES) GRNET (GR) SIXSQ (CH) TID (ES) TCD (IE)

5. Project Principles • Grid and cloud technologies are complementary • Uniform security model (grid) • Sharing of resources, algorithms, and expertise (grid) • Dynamic allocation of resources (cloud) • Customized environments (cloud) • Only develop new software when necessary • Integrate existing solutions if possible • Practical development real needs of users • Maintain production quality with rapid evolution • Use agile and scrum methodologies • Iterative integration: always maintain working distribution • Public releases approximately every 6 weeks

6. Public, Preview Releases • Releases: • v0.1 (9 Nov. 2010) • v0.2 (17 Dec. 2010) • v0.3 (11 Mar. 2011) • v0.4 (~mid-Apr., +storage) • v1.0 (~end-May) • Goals • Provide complete, open-source cloud distribution • Generate feedback from users and administrators • Warning: • The APIs, commands, etc. can (and will) change! Documentation • User tutorial (web et video) • Reference deployment description • Installation guides Services • Appliance repository • Marketplace (v0.3) • Cloud infrastructure (GRNET) • User and administrator support (support@stratuslab.eu) Software • OpenNebula (2.0 in v0.1-2, 2.2 in v0.3) • Command line utilities (user and administrator) • Utilities for signing and validating image metadata (v0.2) • Site policy engine for specified images (v0.3) • IP Addresses: public, local, and private (v0.2) • Standard machine images (ttylinux, Ubuntu, CentOS) • Bioinformatics and grid services images (v0.3) • Web monitor • Manual and Quattor-based installation Security • Integration with grid certificates (v0.2) • Integration with VOMS proxies (v0.3) • Enhancing logging (v0.3) • Quarantine for forensic analysis (v0.3)

7. Grid and Cloud Integrations users Grid Resource Center Grid Services Cloud API and Service Manager API StratusLab Distribution Private/PublicCloud PublicClouds

8. Architecture ofStratusLab v1.0 users Appliance Management HTTP(S) REST Interface StratusLab Marketplace IaaS Cloud Appliance Storage (Web, Grid, Cloud) TCloud Service Manager (Claudia) XML-RPC OCCI CDMI Virtual Machine Manager (OpenNebula) Storage Manager KVM Xen VMware … iSCSI (?) … Physical Computing Resources Physical Storage Resources

9. EGI is Center of DCI Ecosystem European GridInfrastructure

10. Other DCI Projects provides software for scientific PaaS; resources to support real applications running on cloud IaaS cloud distribution running grid services; collaboration on policies and operations European DesktopGrid Initiative supplies desktop grid infrastructures and bridges to EGI European GridInfrastructure gLite, ARC, and UNICORE grid services; support for supplied services support for Globus software and services on EGI and in Europe

11. View From StratusLab cooperation on grid service operation in cloud, security policies, integration with accounting, monitoring, … IaaS services on which to test VENUS-C PaaS; interactions on higher-level services for users European DesktopGrid Initiative European GridInfrastructure use of standard grid authn/authz, collaboration on grid service images support for images with desktop grid software; ref. infrastructure for tests support for Globus service images; reference infrastructure for tests

12. Conclusions • StratusLab • Small project (3 M€, 20 people)  integration of existing services • StratusLab v0.3 available, v0.4 in mid-April • Reference infrastructure available (and open to public) • Support: support@stratuslab.eu • Looking for collaboration with resource providers and end-users • Distributed Computing Infrastructure Projects • Diverse set of 6 complementary projects • Cooperation between projects to maximize impact • Focus on putting results into production on/with EGI

13. EU Project Links • EDGI: http://edgi-project.eu/ • EGI, EGI-InSPIRE: http://egi.eu/ • EMI: http://eu-emi.eu/ • IGE:http://www.ige-project.eu/ • StratusLab: http://stratuslab.eu/ • VENUS-C: http://www.venus-c.eu/