1 / 46

EELA (2004-2009) Achievements and Impact Towards a Latin American Grid Initiative (LGI)

EELA (2004-2009) Achievements and Impact Towards a Latin American Grid Initiative (LGI). Bernard M. Marechal (Project Coordinator) Roberto Barbera (Technical Coordinator) Philippe Gavillet (Deputy Project Coordinator) Francisco Brasileiro (JRA1 Activity Manager)

zinna
Download Presentation

EELA (2004-2009) Achievements and Impact Towards a Latin American Grid Initiative (LGI)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EELA (2004-2009)Achievements and ImpactTowards a Latin American Grid Initiative (LGI) Bernard M. Marechal (Project Coordinator) Roberto Barbera (Technical Coordinator) Philippe Gavillet (Deputy Project Coordinator) Francisco Brasileiro (JRA1 Activity Manager) CLARA Board of Directors Meeting San José (Costa Rica), 12.08.2009

  2. Outline EELA and EELA-2 EELA impact in Latin America The EELA-2 model for long-term sustainability Proposal for future activities San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  3. EELA in numbers EELA (SSA under EU FP6) EELA-2 (CP-CSA under EU FP7) • E-infrastructure shared between Europe and Latin America • EC support: 1.7 M€ • CIEMAT extra support: 0.4 M€ • 10 Countries (3 in Europe) • 2 International Organisations • 20 Members (7 in Europe) • E-sciencegrid facility forEurope andLatinAmerica • EC support: 2.1 M€ • CETA-CIEMAT extra funds: 0.3 M€ • Currently 16 Countries (11 in LA) • 2 new countries (Panama & Uruguay) • 1 International Organisation (CLARA) • Currently 78 Members (62 in LA) • 32 Institutions joining (31 in LA) • Currently 13 JRUs (9 in LA) • 4 new JRUs (3 in LA) At the final review EELA was awarded the highest EC rank: “Good to excellent project” San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  4. France Ireland Italy Portugal Spain • New • Panama • Uruguay Argentina Brazil (RNP) Chile (REUNA) ColombiaCLARA (International) Cuba Ecuador Mexico Peru Venezuela • EELA-2 today • 16 Countries • 18 Partners (13 JRUs) • 78 Member Institutions Countries and Resource Centres San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  5. Joint Research Units in EELA-2 • A Joint Research Unit (JRU) is a partnership with no legal status as such, formed between entities of the same nationality and meeting the following conditions: • scientific and economic unity (internal MoU in place); • lasting a certain length of time (not linked to a particular project); • recognised by a public authority (minister, secretary of state, etc.). • EELA-2 JRUs (no JRUs were established in LA during EELA): • Reference documents: • http://documents.eu-eela.eu/collection/JRUs%20-%20NGIs One of the major successes of EELA-2 San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  6. EELA & EELA-2 objectives • EELA-2 • Provide an empowered Grid Facility with versatile services fulfilling application requirements • Ensure production quality services • Ensure the long term sustainability of the e-Infrastructure beyond the term of the project • Expand the current EELA e-Infrastructure • Look for new communities outside academia (Industry and Business) EELA • Build a bridge between consolidated e-Infrastructure initiatives in Europe and emerging ones in Latin American • Create a collaboration network to deploy a large portfolio of scientific applications on a well supported Pilot Test-bed • Care in parallel of the training in grid technologies and of the knowledge dissemination and outreach San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  7. More Numbers EELA EELA-2 • At the end of the project • # Sites: 19 (13 in Production) • # Cores: 2700 • Storage: 100 TB • # Jobs: 430,000 • Scientific domains: 4 • # Applications: 18 • 12 in production • 6 gridified • Conferences: 3 • Workshops: 8 • Tutorials: 18 • Trained people: 733 • Grid Schools: 2 • After 1 year • # Sites: 22 • # Cores:  3000 • Storage:  1000 TB • # Jobs :  1,000,000 • Scientific domains: 9 • # Applications: 55 • 12 in production • 15 gridified • Conferences: 1 • Workshops: 4 • Tutorials: 8 • Trained people: 158 • Grid Schools: 1 San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  8. 810 participant · day (as of end on April 2009) Project goals DoW  600 by year 2  300 by year 1 Participant · day EELA-2 achievementsTraining Much more training effort delivered than pledged San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  9. EELA-2 achievementsApplication identification and support The EELA-2 “gridification universe” GILDA training-infrastructure Grid Schools Tutorials Support system Wiki pages / EOC website Gridification team Gridification Weeks San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  10. Applications distribution per country/continent and scientific domain(Y1) EELA-2 achievementsApplication identification and support 2 San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 10

  11. EELA-2 achievements Infrastructure Every EELA-2 country has access to the LA PKI Certification Authority Registration Authority CA Applicant Catch All Certification Authority San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  12. EELA-2 achievements Network provision San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 Legacy from EELA 1st Phase • Initial model of incident control system EELA-2 Results • Specification of the EELA-2 Network Support Centre (ENSC) • Set of the ENSC procedures defined [DSA2.3] • Support Protocols agreed with SA1 • ENSC integrated as a support unit inside the Trouble Ticket System implemented by SA1 • Milestone MSA2.2 reached 15

  13. EELA-2 achievements Infrastructure • Multi-domain monitoring • Overlay network monitoring • RedCLARA • LA-NRENB • EELA-2MP B • LA-NREN A • EELA-2 Measurement Points (MPs) • EELA-2MP A • RedCLARA MPs • LA-NREN A - MPs • Visualizationtool • LA-NREN B - MPs San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 • Deployment of a sustainableperfSONAR-based multi-domain network monitoring service • 3 measurement points on EELA-2 RCs (Overlay network monitoring) already installed • Integration with available monitoring services in the domains (LA and EU-NRENs, RedCLARA, GÉANT2, EGEE-III, etc.)

  14. Results – Monitoring Delay on Overlay Network Actual Screen Snapshots San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 17

  15. Collaboration Outcomes San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 • All LA‑NREN representatives agreed to support the ENSC in order to solve network incidents involving EELA-2 community. • European network support • Provided by committed cooperation between EGEE-III ENOC and EELA-2 ENSC • MoU between EELA-2 and EGEE-III being finalized • SA2 member has leading role on CLARA Measurements Working Group • Key to multi-domain monitoring dissemination • RedCLARA and LA-NRENs infrastructure and services upgraded • SA2 has represented EELA-2 demands and requirements • Participating in the service and infrastructure upgrade decisions of the Latin American academic networks • CLARA Management Meeting, from June 23rd to 27th, 2008 • SA2 participated on the redesign of RedCLARA, with expanded links to Peru, Colombia, Ecuador 18

  16. Final Considerations San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 • Network Service Support related to a broad set of players • Research and Education Networks • Continental backbones – GEANT, CLARA • Local campus networks • EELA-2 locations • SA1 • NA3 • EGEE-III • Technology developers and providers • Approach is strongly based upon • Coordination • Adaptation • Integration • Dissemination • Which are key factorsin the long term sustainabilityof the multi-domain network services 19

  17. EELA impact in Latin America Just a few examples… San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  18. Colombian professionals trained in Grid technology Decision to create the Certification Authority Centre for e-Science in Colombia First RC certified in an international infrastructure It will evolve as a Tier-3 for UNIANDES scientists in CMS Installation of a second RC in progress High visibility of Colombian institutions and research groups within the grid community Increase of awareness of grid technology and its possibilities within Colombian institutions EELA-2 impact in Colombia (1/2) (H. Castro – EELA-2 First Review) Brussels, First Project Review, 28.04.2009 San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 21

  19. Strengthening og the Colombian JRU Goverment awareness New Call for Proposals: more inclusive New institutions want to join (now with a better understanding) JRU with 9 universities estalished 5 in EELA-2 Universidad de los Andes (Coordinator) Universidad Industrial de Santander Pontificia Universidad Javeriana Universidad Católica de Colombia Universidad Autónoma de Bucaramanga RENATA (Colombian NREN) supports the long-term sustainability EELA-2 model and already proposes e-Science services EELA-2 impact in Colombia (2/2) (H. Castro – EELA-2 First Review) Brussels, First Project Review, 28.04.2009 San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 22

  20. Ecuadorian professionals trained in Grid technology thanks to Tutorials, Grid schools, Workshops and Conferences Ecuador is creating its own RA for the LA “catch-all” CA JRU created with support from the National Secretary of Science and Technology (SENACYT) – Coordinated by CEDIA (Ecuadorian NREN) SENACYT LoS: “Referring to the motion D.E.C. 09-19 dated February 19, 2009, in which seeking the endorsement of SENACYT to establish working group ECUADOR-GRID, the Secretary with the authority it deserves, and considering that research in this area encouraged the GRID development of science and technology, supported the request of the Executive Director of CEDIA”. EELA-2 impact in Ecuador (S. Arias – EELA-2 First Review) Brussels, First Project Review, 28.04.2009 San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 23

  21. EELA-2 impact in Peru (R. M. San Martin – EELA-2 All Members Meeting) San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 Peru GRID (www.perugrid.org) has started the process of obtaining official recognition as a National Grid Initiative (NGI). We are working together with CONCYTEC in Peru to achieve this goal. We need to demonstrate sustainability and to have a group active and coherent of institutions, and demonstrate compliance with the main goals of our group. 24

  22. EELA impact in CLARA(M. Stanton – EELA Final Review) • EELA has been very successful in disseminating knowledge and encouraging interest in grid computing in CLARA countries, including some outside of EELA • EELA has demonstrated and justified the need for higher bandwidth connections to and within RedCLARA to support grid activities • EELA has provided important support in defending continued EU involvement in future LA networking activities San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  23. Grid Related Activities in CLARA before EELA • Hosted first pre-EELA demo at RedCLARA launch at EU-LAC Summit in November 2004 in Brazil • RedCLARA support provided for Brazilian HEPGrid participation in demos at Supercomputing conferences (SC04 and SC05) San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  24. CLARA members of EELA and their roles in the project • RNP (Brazil) • Exercised responsibility delegated by CLARA for Task 2.4 (Network support) • Support for certification activities (hosting of 1st TAGPMA face-to-face meeting, creation of general academic PKI in Brazil) (Task 2.2) • Articulation of Brazilian NGI/JRU initiatives • REUNA (Chile) • Exercised responsibility delegated by CLARA for Task 4.1 (Dissemination) • Certification activities (Task 2.2) • Articulation of Chilean NGI/JRU initiatives • CUDI/UNAM (México) • UNAM operates CUDI and RedCLARA NOCs and also Mexican grid CA (Tasks 2.4 and 2.2) San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  25. Grid initiatives carried on in CLARA thanks to EELA (1/2) • Creation of IGTF-accredited Grid CAs in Brazil, Chile, Mexico (and now Argentina, Venezuela and Peru) • Conferences: • LAGrid07 (together with CCGrid07) in Rio de Janeiro, May 2007 • e-Science sessions at RNP Workshop, SBPC (Brazilian Society for Advancement of Science) Annual meeting and SBBD (Brazilian Symposium on Data Bases) in 2007 • EELA project progress presented and discussed at CLARA technical meetings (twice-yearly) San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  26. Grid initiatives carried on in CLARA thanks to EELA (2/2) • Network support activities • RNP is a leading member of the perfSONAR consortium (together with Dante, Internet2 and ESNET) • CLARA and RNP are deploying perfSONAR tools in parts of the EELA overlay network • Tuning of transport protocols for high-bandwidth high-latency applications, such as intercontinental file transfers • Improved network error-handling support for end-users of networking services San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  27. The “global” Grid coverage How to take care of the future of e-infrastructures and make them dependable ? San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  28. National Ref.: D. Kranzlmüller presemtation at EGEE’08 Global Routine Usage Testbeds Utility Service Grid “Ecosystem” evolution in Europe San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  29. ? EELA-2 4/2010 → EELA 4/2008-3/2010 1/2006-12/2007 …and in Latin America ? San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  30. Some considerations… San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 • After March 2010 EELA-2 will be over • Will 6-year of successful efforts to: • Set up a production quality Latin American e-Infrastructure at the level of existing European Grids; • Acquire the various Grid technology skills to autonomously support the Latin American e-Infrastructure on the long term (~1000 LA people trained and 10’s of local tutor formed); • Allow LA scientific communities to: • Strengthen their active participation in EU – LA collaborations by satisfying the required contributions to computing resources • Enter new international collaborations to take part in new research field or attract new partners in their own field of research • Altogether “contribute to amplify the relevance of e-Infrastructures, blazing the trail towards Latin American e-Science Initiatives via National Grid Initiatives (NGIs) created in cooperation with existing NRENs and RedCLARA” (EELA-2 proposal). just be waisted ??? 33

  31. The EELA-2 proposal San José (Costa Rica) - CLARA Board Meeting - 12.08.2009 • A 3-level organisation is proposed: • Local (RCs ↔ LAN/MAN) • National (NGIs ↔ NRENs) • Continental (LGI ↔ CLARA) • Multi-middleware (gLite, OurGrid, OSG, …) capable: NGIs and LGI must not be middleware dependent !!!! • Close synergy with EGI (that will support 3 middlewares: ARC, gLite and UNICORE in the framework of UMD)) • Important role of both the LA NRENs and CLARA: fully justified by their participation in EELA and EELA-2 • Even more: e-Infrastructures (Grid) should be partof the NRENs and CLARA structure (cost effective, technically correct, politically easier) Detailed proposal will be shown in the next slides by Roberto… 34

  32. The Latin American Grid Initiative (LGI)(http://documents.eu-eela.org/record/1119/files/) (RC: Resource Centre, NGI: National Grid Initiative, GOC: Grid Operation Centre, NREN: National Research & Education Network, NOC: Network Operation Centre, LGI: Latin American Grid Initiative, CLARA: Cooperación Latino Americana de Redes Avanzadas, GSC: Grid Support Centre, NSC: Network Support Centre) San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  33. The Latin American Grid Infrastructure - GridLGI • GridLGI is composed, from bottom to top of three layers, each of them including Grid and Network components: • At the lower Institute level: • The Resource Centre (RC) is the actual site of the Grid computing resources; • The backbone LAN or MAN network connects the Computing and Storage Elements (CE & SE) at the RC site; • At the intermediate national level: • The National Grid Initiative (NGI) integrates all Grid Institutions in the country and federates under its Grid Operation Centre (GOC) all their RCs in a National Grid (GridNGI); • The underlying National Research & Education Network (NREN) links country-wide the Research and Education Institutes and optimizes / monitors their network activity via its associated Network Operation Centre (NOC); • The upper international layer is made of two entities at the same level: • The Latin American Grid Initiative (LGI) which brings together all NGIs and supervises the various GridNGIs operation from its Grid Support Centre (GSC); • CLARA: it is the WAN network which integrates the Latin American NRENs and supervises the overall RedCLARA network activity by means of its Network Support Centre (NSC). San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  34. Reg. Auth. Monitoring 1st Level User Supp. RC Accounting Storage Element(s) Security inc. resp. Computing Element(s) RC tasks San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  35. WMS Monitoring L&B Cert. Auth. 2nd Level user supp. GOC M/W Repos. Info. Syst. Accounting VOMS Data Catalogs GOC tasks San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  36. High level Grid services Monitoring Catch-all CA 3rd Level user supp. GSC Gen. Info. System Accounting Global VOMS Knowledge repo. M/W releases GSC tasks San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  37. Single point of access Network NSC Team Operations Training and Dissemination NSC OperatedbyNOC ofCampus Network OperatedbyDANTE OperatedbyNOC of NREN A OperatedbyCLARA OperatedbyNOC of NREN B OperatedbyNOC ofCampus Network Ticket Processing GSC TicketSystem User ticket Grid Site Deployment Middleware E2E services ... Network quality indicators NSC NSC tasks RedCLARA GÉANT2 LA-NREN A EU-NREN B RC 2 RC 1 Grid Site 1 Grid Site 2 San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  38. Training events Conferences T&D Consultancy Event calendar Dissemination Material Training & dissemination tasks San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  39. Local/remote support Guidelines Tech. requirements gathering User Supp. Apps. Registry New communities User support tasks San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  40. LGI Management/Governance San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  41. Possible structure of a Latin American NGI A strong liaison with the NREN is strongly suggested/recommended. Local conditions permitting, the NGI should be incorporated into the NREN. San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  42. Long-term sustainability status (1/2) • Long-term sustainability of e-Infrastructures world wide is key for a continued support of scientific communities; • EELA-2 is definitely contributing to the establishment of JRUs and NGIs in Latin America, in close synergy with NRENs and CLARA, also in countries not initially involved in the project; • EELA-2 has defined a detailed model and architecture of the Latin American Grid Initiative; • Contacts with CLARA have formally been established and a Joint Committee has been formed at the Bogotá Conference (with Spanish participation) to analyse, agree on, and start implementing the proposed model. San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  43. Long-term sustainability status (2/2) • CLARA Management has been officially approached and it supports the EELA-2 model (see below the letter signed by Carlos Casasus): San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  44. Then… What’s round the corner ? CHAIN (?) • No EELA-3 foreseen (at first sight), then … • Co-ordination and Harmonisation of Advanced e-INfrastructures • Objective • Design study of the collaboration scheme between EGI and non-European Grid infrastructures • Time scale • Transition period to EGI start early 2010 (also end of several Grid-related projects) to typically 2011 • Vision / Facts(from the common “Input to EC programme”) • "It is clear from the current projects that one cannot revert to a European-only model since many of the user communities currently supported are already of a global dimension" • "Ongoing efforts of inter-projects coordination and collaboration are converging and deemed to be supported” • "There is an enormous variation in the level of maturity and organisational models of the regional Grid which want to contribute to EGI" CHAIN is however only a small proposal with a limited budget to be submitted in a highly competitive call. It can not be the only solution for the future of e-Infrastructure in Latin America. San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  45. Proposal to be discussed today • We (CLARA, EELA-2, the NRENs, and the JRUs) prepare and agree on a Memorandum of Understanding containing: • The number of FTEs each NREN can second to CLARA to manage LGI and the central GOC; • The number of “managed” (with local manpower) CPU cores and TeraBytes of storage each country can commit to LGI for the period 4/2010-3/2012 (2 years); • The MoU is signed at the EELA-2 Conference in November by all the NRENs willing to participate from “Day 1” (the others can of course join later) and enters into force on the 1st of April 2010; • Between December 2009 and March 2010 the profiles for the people to be hired are defined and the positions are open; • CLARA appoints immediately an “ad interim” LGI Director till 3/2012 to oversee the transition from EELA-2 to LGI and the start-up of the Infrastructure; • Bonus: if CHAIN will be approved, the LGI “kernel” constituted above will be the strong unfunded contribution of Latin America to the project. San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

  46. Useful references • Project website: • www.eu-eela.eu • Final review of EELA: • http://indico.eu-eela.eu/conferenceOtherViews.py?view=standard&confId=113 • First review of EELA-2: • http://indico.eu-eela.eu/conferenceOtherViews.py?view=standard&confId=193 • LGI model: • http://documents.eu-eela.org/record/1119/files San José (Costa Rica) - CLARA Board Meeting - 12.08.2009

More Related