European Grid Initiative - Towards a Sustainable Grid Infrastructure

1. European Grid Initiative -Towards a Sustainable Grid Infrastructure Dieter Kranzlmüller(GUP, Joh. Kepler University Linz) contact@eu-egi.org

2. European Commission Stakeholders in Europe onGrids International Scientific and Research Collaboration NationalFunding Agency 1 NationalFunding Agency 2 NationalFunding Agency n … www.eu-egi.eu

3. Stakeholders in Europe International Scientific and Research Collaboration European Grid Projects NationalGridProject Regional GridInstitution LocalGridCommunity … European Commission NationalFunding Agency 1 NationalFunding Agency 2 NationalFunding Agency n … www.eu-egi.eu

4. Stakeholders in Europe International Scientific and Research Collaboration European Grid Projects NationalGridProject Regional GridInstitution LocalGridCommunity … European Commission NationalFunding Agency 1 NationalFunding Agency 2 NationalFunding Agency n … www.eu-egi.eu

5. 250 Sites 48 Countries 50,000 CPUs 13 PBytes >5000 Users >200 VOs >140,000 Jobs/Day • Archeology • Astronomy • Astrophysics • Civil Protection • Comp. Chemistry • Earth Sciences • Finance • Fusion • Geophysics • High Energy Physics • Life Sciences • Multimedia • Material Sciences • … 32% www.eu-egi.eu Univ. Linz - March 2008 5

6. The Need for a Permanent, Common Grid Infrastructure Production Grids are reality today, but … • Dependency: Some application domains depend on grids already today by using them for production runs • Protection of Investment:Investment in grids, both from funding organizations and from users, need to be protected • Perspective: Today’s grid users are grid enthusiasts, tomorrows grid users ask for a longer term perspective www.eu-egi.eu

7. Stakeholders in Europe International Scientific and Research Collaboration European Grid Projects NationalGridProject Regional GridInstitution LocalGridCommunity … e-Infrastructure Reflection Group (e-IRG) European Commission NationalFunding Agency 1 NationalFunding Agency 2 NationalFunding Agency n … www.eu-egi.eu

8. e-IRG Delegates Meeting, London, 12/2005 Recommendation: “The e-IRG recognises that the current project-based financing model of grids (e.g., EGEE, DEISA) presents continuity and interoperability problems, and that new financing and governance models need to be explored – taking into account the role of national grid initiatives as recommended in the Luxembourg e-IRG meeting.” www.eu-egi.eu

9. Grids in Europe www.eu-egi.eu www.eu-egi.eu

10. Characteristics of NGIs Each NGI • … should be a recognized national body with a single point-of-contact • … should mobilize national funding and resources • … should ensure the operation of a national e-Infrastructure • … should support user communities (application independent, and open to new user communities and resource providers) • … should contribute and adhere to international standards and policies Available soon: Guidelines for NGIs – Prepared by EGI_DS www.eu-egi.eu

11. e-IRG Recommendaitons on Sustainable e-Infrastructures http://www.e-irg.org/publ/2006-Report_e-IRG_TF-SEI.pdf e-IRG Delegates Meeting, London, 12/2005 Recommendation: “The e-IRG recognises that the current project-based financing model of grids (e.g., EGEE, DEISA) presents continuity and interoperability problems, and that new financing and governance models need to be explored – taking into account the role of national grid initiatives as recommended in the Luxembourg e-IRG meeting.” www.eu-egi.eu

12. European Commission “…for Grids we would like to see the move towards long-term sustainable initiativesless dependent upon EU-funded project cycles” Viviane Reding, Commissioner, European Commission, at the EGEE’06 Conference, September 25, 2006 www.eu-egi.eu

13. Publication: early 2007 Closure: spring 2007 • Support conceptual design studies for new RI (or major upgrades of existing ones) of clear European dimension and interest; such studies will help to assess technical and financial feasibility of proposed new RI • Action should also foster emergence of new organisational models to consolidate a sustainable approach to e-Infrastructures, in particular in the domain of grids and data repositories • New service provisioning schemes to be more neutral and open to all user communities and resource providers • e-Science Grid Infrastructures • Scientific Digital Repositories • Deployment of e-Infrastructures for new • Scientific Communities • New Research Infrastructures – Design studies • New Research Infrastructures – Preparatory phase • Support measures (studies, policy initiatives, • international co-operation,…) The first e-Infrastructure Call in FP7 Year 2007 Year 2008 Year 2009 www.eu-egi.eu Slide courtesy of Kyriakos Baxevanidis, EC

14. Routine Usage Testbeds Utility Service Evolution National European e-Infrastructure Global www.eu-egi.eu

15. European Grid Initiative Goal: • Ensure the long-term sustainability of grid infrastructures in Europe by establishing a new federated model bringing together NGIs to build the EGI Organization Objectives: • Ensure the long-term sustainability of the European e-infrastructure • Coordinate the integration and interaction between National Grid Infrastructures • Operate the European level of the production Grid infrastructure for a wide range of scientific disciplines to link National Grid Infrastructures www.eu-egi.eu

16. Stakeholders in Europe International Scientific and Research Collaboration European Grid Projects NationalGridInitiative 1 NationalGridProject NationalGridInitiative 2 Regional GridInstitution LocalGridCommunity NationalGridInitiative n … … e-Infrastructure Reflection Group (e-IRG) European Commission NationalFunding Agency 1 NationalFunding Agency 2 NationalFunding Agency n … www.eu-egi.eu

17. Ensure the long-term sustainability of the European e-infrastructure • Coordinate the integration and interaction between National Grid Infrastructures • Operate the European level of the production Grid infrastructure for a wide range of scientific disciplines to link National Grid Infrastructures • Provide global services and support that complement and/or coordinate national services (Authentication, VO-support, security, etc); • Coordinate middleware development and standardization to enhance the infrastructure by soliciting targeted developments from leading EU and National Grid middleware development projects; • Advise National and European Funding Agencies in establishing their programmes for future software developments based on agreed user needs and development standards; • Integrate, test, validate and package software from leading Grid middleware development projects and make it widely available; • Provide documentation and training material for the middleware and operations. (NGIs may wish to make the material available in turn in their local language); • Take into account developments made by national e-science projects which were aimed at supporting diverse communities. • Link the European infrastructure with similar infrastructures elsewhere; • Promote Grid interface standards based on practical experience gained from Grid operations and middleware integration activities, in consultation with relevant standards organizations; • Collaborate closely with industry as technology and service providers, as well as Grid users, to promote the rapid and successful uptake of Grid technology by European industry. EGI Vision Paper http://www.eu-egi.eu/vision.pdf www.eu-egi.eu

18. 38 European NGIs + Asia, US, Latin America + OGF-Europe + PRACE + … www.eu-egi.eu

19. www.eu-egi.eu Goal of EGI Design Study: Conceptual setup and operation of a new organizational model of a sustainable pan-European grid infrastructure www.eu-egi.eu

20. EGI Policy Board www.eu-egi.eu

21. EGI Knowledge Base - Main NGI Representatives to provide their input and update their local information http://knowledge.eu-egi.eu www.eu-egi.eu

22. EGI Functionality Overview • Management, Outreach & Dissemination, Representation of European Grid Efforts, Industry take-up • Operations & Resource Provisioning & Security • Middleware Coordination: Build & Test, Component Selection & Validation & Deployment, Standardization & Policies • Application Support, User Support & Training www.eu-egi.eu

23. Standardization BodiesOpen Grid Forum Stakeholders in Europe International Scientific and Research Collaboration European Grid Projects NationalGridInitiative 1 NationalGridProject NationalGridInitiative 2 Regional GridInstitution NationalGridInitiative n … … European Commission NationalFunding Agency 1 NationalFunding Agency 2 NationalFunding Agency n … www.eu-egi.eu

24. EGI & Standardization • EGI interacts with NGIs, who are running different middleware stacks Interoperability is a basic requirement for intl. grid collaboration • EGI requires convergence of middleware stacks towards full interoperability (through general standards interfaces) • Distinction between core and high-level functions • EGI coordinates core services (selection, deployment) on European level • EGI provides standards-compliance test specification for core middleware services • EGI requires a common build&test system www.eu-egi.eu

25. EGI Functionality Overview • Management, Outreach & Dissemination, Representation of European Grid Efforts, Industry take-up • Operations & Resource Provisioning & Security • Middleware Coordination: Build & Test, Component Selection & Validation & Deployment, Standardization & Policies • Application Support, User Support & Training www.eu-egi.eu

26. Industrial Involvement • Roles in EGI: • Customer using the EGI Grid for daily work • Provider offering services on the EGI Grid • Actions for Industry: • Define requirements for industry to use EGI • Evaluate and support the definition of the EGI functionality • Collaborate on the development of business models for Grids • Develop future services to be provided on EGI, e.g. in the domain of security www.eu-egi.eu

27. EGI – European Grid Initiative • EGI Grid Infrastructure should • be a large-scale, production Grid infrastructure • built on national grids that interoperate seamlessly at many levels, • offering reliable and predictable services to a wide range of applications • The Future EGI Organization represents the “Glue” between various grid communities in Europe and beyond • EGI_DS defines required mechanisms and functionalities of the EGI Organization • EGI needs to collaborate with OGF on middleware standardization and convergence www.eu-egi.eu

28. http://www.eu-egi.org contact@eu-egi.org www.eu-egi.eu