150 likes | 224 Views
Creating and operating a Grid infrastructure: a use case from Europe & Latin America. Bernard M. Marechal EELA-2 Project Coordinator CETA-CIEMAT (Madrid - Spain) & UFRJ (Rio de Janeiro - Brazil) Philippe Gavillet EELA-2 Deputy Project Coordinator
E N D
Creating and operating a Grid infrastructure: a use case from Europe & Latin America Bernard M. Marechal EELA-2 Project Coordinator CETA-CIEMAT (Madrid - Spain) & UFRJ (Rio de Janeiro - Brazil) Philippe Gavillet EELA-2 Deputy Project Coordinator CETA-CIEMAT (Madrid - Spain) & CERN WSIS’08 - ICT / e-Science 21.05.2008 (3rd Facilitation Meeting on Action Line C7 e-Science)
KEY WORDS • Grid: Multi-CPU Computing model that provides the ability to perform higher throughput computing with large storage capabilities • e-Infrastructure: Distributed Grid infrastructure • e-Science: Global collaborative scientific research, usually based on an e-Infrastructure • JRU: Joint Research Unit • NGI: National Grid Initiative UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
MOTIVATIONS, PROBLEM AREA • EELA (E-infrastructure shared between Europe and Latin America) under FP6 www.eu-eela.org • Bridge consolidated e-Infrastructures in Europe and emerging ones in Latin America • Create and operate a transcontinental Grid infrastructure • Address cost-effectively regional problems • Enhance Research in developing counties • EELA-2 (E-science grid facility for Europe and Latin America) under FP7 www.eu-eela.eu • Set up a high capacity, production quality, scalable Grid Facility • Ensure round-the-clock, worldwide access to distributed computing and storage resources • Support a wide spectrum of applications for both European and Latin American scientific communities UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
RESEARCH OBJECTIVES • EELA • Aim at building a Latin American e-Infrastructure at the level of European standard • Focus on e-Science-related applications, profiting from a stable, performant networking infrastructure (RedCLARA & GÉANT) • Disseminate the Grid culture (Decision makers) and train local communities of all kinds (Users, System Administrators) • EELA-2 • Provide empowered Grid facility with versatile services fulfilling all application requirements • Ensure long-term sustainability of the e-Infrastructure beyond the term of the project (from 2010 onward) UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
RESEARCH APPROACH • EELA • Establish scientific network • Enlarge and train (hands-on workshops) communities • Establish a pilot Grid supporting proof-of-concept applications • Close collaboration with other EC funded projects • Grid Cluster deployment, definition and enforcement of operational schemes and policies • EELA-2 • Expand the current EELA infrastructure • Provide the full set of Grid Services needed by all types of applications • Collaborate with NRENs and create Regional Operation Centres • Support actively the creation of National Grid Initiatives (NGI) UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
MAJOR OUTCOMES / RESULTS • EELA • Provide European researchers early access to a new, well-supported e-Infrastructure and enable them to speed up the processing of scientific data • Strengthen scientific communities in Europe and Latin America • Successful building of a reliable and almost “production quality” e-Infrastructure in Latin America • Grid technology skills acquired to autonomously support the Latin American Grid on the long term • Entrance and consolidation of Latin American communities in worldwide collaborations • Amplification of the e-Infrastructures relevance, blazing the trail towards Latin American e-Science initiatives and/or NGIs UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
EELA-2 COUNTRIES / RESOURCES France Ireland Italy Portugal Spain 14 Countries 16 Partners (9 JRUs) 53 Members Argentina Brazil Chile Colombia CLARA (International) Cuba Ecuador Mexico Peru Venezuela UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
EELA in numbers • 21 partners from 10 countries (7 in Latin America and 3 in Europe), including 2 international organisations (CERN and CLARA) • EC support: 1.7 MEuro for 2 years • Additional CIEMAT funds (400 KEuro) for Latin America • 4 Work Packages (Management; Pilot Test-bed operation and support; Support of applications; Dissemination activities) • 1700 CPUs; 500,000 jobs successfully executed, i.e. 500 CPUs.year delivered to EELA users • 15 applications deployed on the EELA infrastructure • 18 tutorials (about 700 participants enrolled, i.e. 2000 participants.day) • 2 EELA Grid schools (Concept of Stand-alone Grid; 30 students deployed 12 applications in 2 X 10 days) UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
EELA-2 in numbers • 16JRU-type partners (6 from Europe, 9 from LA and 1 International Institution CLARA) in 14 countries (5 from Europe, 9 from Latin America) • 53 institutions, most of them clustered in 9 Joint Research Units (JRU) • EC support of about 2.1 MEuro (+ 300 KEuro from CIEMAT) • 6 Activities (Management, Dissemination and training; Application support; Infrastructures services; Network resource provision; Development of services for applications and infrastructure) • 30Resource Centres; 3000 computing nodes; 700 TB of storag • Foreseen growth over the project duration: 20 % in computing and 15% in storage • About 50 applications selected (Biomedical, High Energy Physics, Earth Sciences, Climate, e-Learning, e-Government, e-Industry) UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
SURVEY: APPLICATION DOMAINS Biomedicine: 45% HEP: 14% Earth Sciences: 14% UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
SURVEY: APPLICATIONS PER COUNTRY BR: 29% ES: 27% CL: 8% AR=FR=MX=PT: 6% UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
SURVEY: POTENTIAL IMPACTS (1) • Scientific: <98%> • Consensus that the Grid model is (will be) useful and should open new perspectives for Applications. • Social: <55%> • Half of Applications will have positive outcomes socially • Biomedicine: <82%> • HEP: It induces social benefits, but delayed beyond the project time scale (e.g. Hadron therapy) • Earth Sciences: <70%> • Comment: Running Biomedicine & Earth sciences Applications on EELA-2 will substantially contribute to enhance their socially useful results (higher accuracy of predictions, diagnosis, rates) UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
SURVEY: POTENTIAL IMPACTS (2) • Industry: <80%> • A rather large fraction of Applications is claimed to induce Industry spin- offs. Arguments are: • Biomedicine<91%> • Induce better medical methods for observation, diagnosis, therapy / new tools • General feeling: By nature results should interest industry, but no clear link yet • HEP: <71%> • Grid boosts simulation studies, leading to more efficient detector R&D in collaboration with Industry. • Earth Sciences: <57%> • Enhance forecasts (seismic, weather,..) for agriculture, industry activities • Comments: In fact, basicallyNO industry sector concerned by EELA-2 Applications is currently using a Grid model. • Studies are outsourced to University teams (through University-Industry contract) which use a Grid for higher efficiency (faster, more accurate results) • Challenge is to get Industry (especially SMEs) to use the EELA Grid. UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
CONCLUSIONS AND OUTLOOK • EELA was a success, recognized by the highest EC ranking • EELA drastically changed the perspectives about e-Science in Latin America • The mature grid empowered EELA Test-bed improved scientific collaborations between European and Latin American scientists • EELA-2 was recently presented at IST-Africa’08 (7-9 May 2008) with interesting exchanges: • EELA know-how could perfectly be “exported” through its powerful, comprehensive Training program (e.g. Grid Schools) • EELA-2 is willing to share resources and knowledge with other institutions from other countries • New collaboration is usually established via MoU UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008
Thank you for your attention Marechal@if.ufrj.br Philippe.Gavillet@cern.ch UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008