150 likes | 251 Views
Introduction to EGEE-II. Antonio Fuentes Antonio.fuentes@rediris.es Tutorial Grid Sevilla, September 2007 RedIRIS/Red.es (Slices of Bob Jone, Director of EGEE-II Project ). The project. EGEE 1 April 2004 – 31 March 2006 71 partners in 27 countries, federated in regional Grids EGEE-II
E N D
Introduction to EGEE-II Antonio Fuentes Antonio.fuentes@rediris.es Tutorial Grid Sevilla, September 2007 RedIRIS/Red.es (Slices of Bob Jone, Director of EGEE-II Project )
The project • EGEE • 1 April 2004 – 31 March 2006 • 71 partners in 27 countries, federated in regional Grids • EGEE-II • 1 April 2006 – 31 March 2008 • 91 partners in 32 countries • Objectives • Large-scale, production-quality grid infrastructure for e-Science • Attracting new resources and users from industry as well asscience • Maintain and further improve“gLite” Grid middleware
Applications on EGEE • Applications from many scientific domains • Archaeology • Astrophysics • Computational Chemistry • Digital libraries • Earth Sciences • Financial Simulation • Fusion • Geophysics • High Energy Physics • Life Sciences • Multimedia • Material Sciences • ….. Book of abstracts:http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-005.pdf
KNOWLEDGE . INFRASTRUCTURE GRID . INFRASTRUCTURE GÉANT . INFRASTRUCTURE Support for digital repositories • 3 layered model to support access to heterogeneousinformation and connect resources throughcommon shared services • Grids can offer: • Sharing of resources • Secure Access Control • Data management • Execution of computationally demanding applications (e.g. multi-media content)
EGEE Operations Structure • Operations Coord. Centre (OCC) • Regional Operations Centres (ROC) • Front-line support for user and operations issues • Provide local knowledge and adaptations • One in each region – many distributed • Manage daily grid operations – oversight, troubleshooting • “Operator on Duty” • Run infrastructure services ROCs serving
GIN EGEE Related Infrastructures
Grid Interoperability • We currently see different flavors of Grids deployed worldwide • Because of application needs, legacy constraints, funding, etc. • Diversity is positive! – Competition to find the best solutions • Many applications need to operate on more than one Grid infrastructure • Pragmatic approach to interoperability is key • Applications need interoperable Grid infrastructures now • A production infrastructure cannot be an early adopter of quickly changing standards • Interoperability and standardization pursued at multiple levels • Bilateral efforts (e.g. EGEE and EUChinaGrid, OSG and TeraGrid, EGEE and Naregi) • Resulted in the “Grid Interoperability Now (GIN)” effort combining major worldwide and regional Grid efforts at GGF • Grid standardization and best practices at the Global Grid Forum • Now merging with comparable industry efforts – Open Grid Forum • Standardization of basic infrastructure like web services (OASIS)
Grid Middleware Applications • Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware • Higher-Level Grid Services are supposed to help the users building their computing infrastructure but should not be mandatory • Foundation Grid Middleware will be deployed on the EGEE infrastructure • Must be complete and robust • Should allow interoperation with other major grid infrastructures • Should not assume the use of Higher-Level Grid Services Higher-Level Grid Services Workload Management Replica Management Visualization Workflow Grid Economies ... Foundation Grid Middleware Security model and infrastructure Computing (CE) and Storage Elements (SE) Accounting Information and Monitoring
EGEE Middleware Distribution • gLite • Exploit experience and existing components from VDT (Condor, Globus), EDG/LCG, and others • Develop a lightweight stack of generic middleware useful to EGEE applications (HEP and Biomedics are pilot applications). • Pluggable components – cater for different implementations • Follow SOA approach, WS-I compliant where possible • Focus is on re-engineering and hardening • Business friendly open source license • Plan to switch to Apache-2
gLite Grid Middleware Services Access CLI API Security Information & Monitoring Authorization Auditing Information &Monitoring Application Monitoring Authentication Data Management Workload Management MetadataCatalog File & ReplicaCatalog Accounting JobProvenance PackageManager Site Proxy StorageElement DataMovement ComputingElement WorkloadManagement
gLite Grid Middleware Services Overview paper http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-001.pdf
EGEE and Sustainability BUT … • How does EGEE compare to other computing infrastructures? • Number of infrastructure users? • Number of application domains? • Number of computing nodes? • Number of years in service? • What would happen, if EGEE is turned off? • What happens after April 2008 (End of EGEE-II)?
Sustainability: Beyond EGEE-II • Need to prepare for permanent Grid infrastructure • Maintain Europe’s leading position in global science Grids • Ensure a reliable and adaptive support for all sciences • Independent of short project cycles • Modelled on success of GÉANT • Infrastructure managed in collaboration with national grid initiatives
Structure • Federated model bringing together National Grid Initiatives (NGIs) to build a European organisation (EGI) • EGEE-II federations wouldevolve into NGIs • Each NGI is a national body • Recognised at the national level • Mobilises national funding and resources • Contributes and adheres to international standards and policies • Operates the national e-Infrastructure • Is application independent, open to new user communities and resource providers
Summary • Grids are all about sharing – they are an excellent means of working with groups around the world • EGEE operates the world’s largest multi-disciplinary grid infrastructure for scientific research • In constant and significant production use • EELA & EUMedGrid & EUChinaGrid as part of this production infrastructure • We have gained significant experience in what it takes to deploy, operate and manage a large distributed infrastructure • Next steps: Service Availability Monitoring, Service Level Agreements • This work has shown the importance of interoperability/interoperations with related projects • Need to prepare the long-term • EGEE, related EU projects, national grid initiatives and user communities are working to define a model for a sustainable grid infrastructure