European Grid Initiative

1. European Grid Initiative Per Öster Director Application Services, CSC – IT Center for Science Ltd, Finland EGI Council Chair Chair EGI.eu Executive Board Per.Oster@csc.fi

2. Why Still Grids?

3. Productive Use Testbeds Utility Evolution of European Grid National/Regional European e-Infrastructure EU Projects

4. Grids and key Europeane-Infrastructure • European Data Grid (EDG) • Explore concepts in a testbed • Enabling Grid for E-sciencE (EGEE) • Moving from prototype to production • European Grid Infrastructure (EGI) • Routine usage of a sustainable e-infrastructure

5. EGI – European Grid Initiative • Overall governing body: • EGICouncil • NGIs + other associated partners (e.g. EIRO members) • Legal entity, 8 Feb 2010: • EGI.eu • Coordinating organization -“glue” betweendifferent distributed computing infrastructures in Europe and beyond

6. EGI Council 24 Member Countries1 June 2010Committed to the EGI objectives and yearly fee

7. EGI ObjectivesEGI.eu Statutes Article 3.1 • “The objective of the foundation is to create and maintain a pan-European grid infrastructure in collaboration with NGIs in order to guarantee its long-term availability for performing research and innovation activities.”

8. EGI European Grid Initiative EGI Council: The overall governingbody EGI.eu: The legal Entity

9. EGI Interaction

10. EGI.eu Organization in Amsterdam • Director • Steven Newhouse • Chief Administrative Officer • Catherine Gater • Chief Community Officer • Steven Brewer • Chief Operations Officer • Tiziana Ferrari • Chief Technology Officer • Vacant(www.egi.eu/about/jobs) • User Community Support Team • Policy Development Team • Dissemination Team • Financial Officer http://www.egi.eu/about/staff/

11. EGI Infrastructure International Research Collaboration Services EGI.eu European-level Grid Services gLite UNICORE ARC Middleware A Middleware B Middleware B Middleware X NationalGridInitiative 1 NationalGridInitiative 2 NationalGridInitiative N …

12. The EGI-InSPIRE Project Integrated Sustainable Pan-European Infrastructure for Researchers in Europe • A 4 year project with €25M EC contribution • Project cost €69M • Total Effort ~€330M • Staff ~ 170FTE • Start 1 May 2010 Funded Un-Funded Project Partners (48) EGI.eu, 37 NGIs, 2 EIROs, 8 AP

13. EGI-InSPIRE Objectives • Support Grids of high-performance and high-throughput computing resources • Integrate existing and new Distributed Computing Infrastructures (DCIs) • Be a coordinating hub for European DCIs • Support interoperation of individual national grid infrastructures • Collect requirements and provide user-support for the current and new (e.g. ESFRI) users • Support new European and other international research collaborations

14. EGI-InSPIRE Objectives • Support current heavy users (e.g. WLCG) • In move their critical services and tools from a central support model to ones driven by their own individual communities • Define, verify and integrate within the Unified Middleware Distribution • middleware from external providers needed to access the e-Infrastructure (European Middleware Initiative with ARC, gLite, and UNICORE, ….) • Extend operational tools to support a national operational deployment model • Include new DCI technologies in the production infrastructure • New Grid techs, Virtualization, Clouds,…

15. Scalable Community Interactions USERS EGI.eu EGI Helpdesk NGI VOs User Community Board Virtual Research Community USERS Training Events VOs Trainers VOs Virtual Research Commmuity Apps. DB USERS VOs VRC Helpdesk ESFRI Project Other Helpdesk Virtual Research Community VOs NGI Helpdesk

16. VRC Characteristics • International Existence & Governance • A research community that spans borders • Ability for groups to join and leave • e.g. ESFRI, EIROForum, Collaboration, etc. • Sustainable beyond just a funded project • Engagement with EGI • Resources, Policies, Planning, ... • May provide community specific support • Dissemination, Training, Application Porting, ...

17. European Strategy Forum on Research Infrastructures • Roadmap updated in 2008 • Preparatory phase funding for most projects • Big push in FP8 (2013 and beyond)? • 44 projects covering: • Social Sciences and Humanities • Environmental Sciences • Energy • Biological and Medical Sciences • Materials and Analytical Facilities • Physical Sciences and Engineering • e-Infrastructures Data Intensive Science National commitments in European context Global collaboration and shared access Long lifetime (10-20+ years)

18. Road to Success yes/no? • A few things to have in mind…

19. Be a Neutral Infrastructure • Consider IP network providers • Open to any traffic from many different communities • Restrictions to protect other users • Customised solutions within a generic framework • Light paths on demand • Standards drive integrated deployment • Hardware and fibre from many different providers • And for sustainable E-Infrastructures? • Any application domain or middleware technology • A platform for domain specific innovation and use • Integration of any compliant compatible resources

20. Can we learn from others? • Grids have benefited from commoditisation • Hardware: HTC & HPC affordable to all • Networking: >GBscan be moved over WAN • Software: Open source software comes of age • How will commodity virtualisation impact us? • For transactional models  • Cloud Computing: A model based on compute not data • For large distributed data-oriented models  • The emergence of true ‘function shipping’?

21. Evolving Service Delivery Models • Move towards an interoperable cloud infrastructure • Federated pan-European infrastructure • Use standards and the established AAAA mechanisms • Provide a Data-Oriented Infrastructure as a Service • Use existing high performance data storage & transfers • Empower VRCs/VOs to source and run their own services • Bring new research innovations into production • Federated cloud environments (i.e. VMs @ each site) • Experimenting with virtualised worker nodes in EGEE: • e.g. INFN, BiG Grid, CERN, NGS, Dgrid, ...

22. What does this evolution mean? • EGI coordinates the core infrastructure • Assessing & certifying technology for deployment • Ensure integration of the core services in Europe • Operate & manage domain specific environments • If required by that domain! • VOs now manage their own infrastructure • Decide what services are deployed where • Flexibility (& responsibility) to meet their own needs Deregulate and open up the infrastructure (Where it makes sense to do so!)

23. A long-term need for Standards • Data Layer • Secure reliable data movement • Standardised access to data resources • Virtualisation Layer • VMM across trust domains within agreed policies • Monitoring as important as lifecycle control • Service Layer • The services that go into the virtual machine • Avoid domain specific silos & promote reuse Openness Consensus Balance Transparency

24. Sustainability ‘Europe as a hub for sustainable e-science and continuous service innovation’ • Reduce barriers for collaborative data intensive science • Integration with GEANT provides unique offering • Support to ESFRI projects and new communities • Flexibility to run the services and software they need • Open global collaboration of e-infrastructures providers • Domain driven collaboration with other infrastructures • Open standardised interfaces to avoid vendor lock in • Add value where we can and outsource where we can’t

25. Summary • EGI: • Provide a sustainable production e-infrastructure • EGI.eu is now a legal entity based in Amsterdam • Supported transition for 4 years through EGI-InSPIRE • Contact: director@egi.eucouncil@egi.eu EGI Technical Forum 14-17th September 2010 in Amsterdamwith NRENS and Grids Workshop 15th Septwww.terena.org/nrens-n-grids

26. Acknowledgment • EGI.eu • Steven Newhouse, EGI.eu Director