510 likes | 644 Views
Presentation of the main current EU projects on GRID. Thierry PRIOL INRIA Thierry.Priol@inria.fr. Outline of the Presentation. From FP5 to FP6 Unit F2 - Grid Technologies Unit F3 - Research Infrastructure Conclusion. Grid projects funded by the EU. Former FP5 IST Grid Projects (58 M €).
E N D
Presentation of the main current EU projects on GRID Thierry PRIOL INRIA Thierry.Priol@inria.fr
Outline of the Presentation • From FP5 to FP6 • Unit F2 - Grid Technologies • Unit F3 - Research Infrastructure • Conclusion Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Grid projects funded by the EU Former FP5 IST Grid Projects (58 M€) • Infrastructure • DataTag • Computing • EuroGrid, DataGrid, Damien • Tools and Middleware • GridLab, GRIP • Applications • EGSO, CrossGrid, BioGrid, FlowGrid, Moses, COG, GEMSS, Grace, Mammogrid, OpenMolGrid, Selene, • P2P / ASP / Webservices • P2People, ASP-BP,GRIA, MMAPS, GRASP, GRIP, WEBSI • Clustering • GridStart Applications Middleware Infrastructure Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
First actions launched in IST-FP5 Grid research is a key strategic objective From FP5 to FP6 Grid research funding more than doubles IST-FP6 commitment to Grid research 325M€ FP6 58M€ FP5 2000-2002 2002-2006 Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
FP6 and its new instruments • Instrumental for creation of a European Research Area (ERA) • Towards a European research policy • Community funding to help aggregate RTD effort (EU, Member states & private) • Open coordination at all level (EU, National, Regional) • Basic principles • Focus on integration, fewer priorities, critical mass, improve impact • Lasting, structuring impact (to avoid “end of project”…) • Several instruments (IP, NoE, STREP, SSA, CA) Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Integrated Project (IP) - objectives • Designed to support research that is … • objective and result driven • Clearly defined objectives and results • Each IP should • Integrate the types of activities needed to obtain the goals • Basic research, development, take-up, trials, best-practice • Integrate the critical mass of resources needed to obtain the goals • Integrate all elements of technology / value chain to attain high-impact goals • Support industry (large & SME) collaboration with academia • Several implementations • Monolithic, incremental participation, incremental funding Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Network of Excellence (NoE) - objectives • To reinforce or strengthen scientific and technological excellence on a given research topic • By integrating the critical mass of expertise needed to provide European leadership and be a world force • Around a Joint Programme of Activity (JPA) • Structuring European research by integrating research capacities across Europe • Strong and durable integration • To progress knowledge on a particular theme • Overcome the fragmentation of European research • To act as a “Virtual Centre of Excellence” • To spread excellence beyond the partners Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Grids for Complex Problem Solving Architecture, design and development of the next generation Grid Enabling application technologies DG IST - F2 Research Infrastructure Deployment of specifichigh performance Grids Deployment of high-capacityand high-speed communi-cations network - GEANTDG IST - F3 Grid Research and Deployment in FP6 Application-orientedStrategic Objectives e.g. eBusiness, eGov, eWork, eHealth, risks management,environment, transport R&D Research & Development Deployment 125 M€ (IST) 200 M€ RI Technology-orientedstrategic objectives, e.g. semantic web, embedded systems software and services R&D Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Grid Research Projects funded by F2 EU Funding:52 MILLION Start: SUMMER 2004 GRIDCOORDBuilding the ERA in Grid research GRID@ASIA Collaboration with China/South-Korea K-WF GridKnowledge basedworkflow & collaboration inteliGRIDSemantic Grid based virtual organisations Grid-based generic enabling application technologies to facilitate solution of industrial problemsSIMDAT OntoGridKnowledge Services for the semantic Grid UniGridSExtended OGSAImplementation based on UNICORE EU-driven Grid services architecture for businesS and industry NextGRID Mobile Grid architecture and services for dynamic virtual organisations Akogrimo DataminingGridDataminingtools & services HPC4UFault tolerance,dependabilityfor Grid European-wide virtual laboratory for longer term Grid research-creating the foundation for next generation Grids CoreGRID ProvenanceTrust and provenance for Grids Specific support action Integrated project Network of excellence Specific targeted research project Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Project timeframe AKOGRIMO 36 months IPs NEXTGRID 36 months SIMDAT 48 months NoE CoreGRID 48 months DataMiningGrid 36 months HPC4U 36 months InteliGrid 30 months STREP K-WF Grid 30 months OntoGrid 36 months Provenance 24 months UniGriS 24 months GridCoord 24 months SSA Grid@Asia 18 months June 2004 June 2005 June 2006 June 2007 June 2008 Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
EU Funding to Grid projects Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
AkogrimoMobile Grid architecture and services for dynamic virtual organisations
Domain specificservices layer Generic ApplicationSupport Layer Grid infrastructure Network Middleware Mobile Internet (MIPv6) Project Objectives • Realize a layered Next Generation Grid middleware • architecture and • reference implementation • enabling cross-layer co-operation from network through Grid up to the application layer • for a large number of nomadic and mobile users • Demonstrate the capabilities with challenging applications and real users • Develop Elaborated Business Models for this new platform • Provide Supporting Tools for developers Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Akogrimo partners • Network operators: Telefonica (lead), Telenor, IT-Aveiro • Software industry: ATOS, Datamat • Tool Provider: BOC • Grid Infrastructure providers: • University of Stuttgart, CCLRC • R&D: Universities of Hohenheim, • Zurich and Madrid; • research institutes: CRMPA and ICCS/NTUA Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
eHealth Locate patient, collect and interpret patient data, dinamically change workflows to treat patient according to live data, historical data and simulations Logistics Multimodal combined planning between different transport companies Disaster Handling and Crisis Management eLearning Personalised, collaborative and interactive virtual experimentson the move Tele Working Corporate Mobile Grid (expert in the field with backend groups and services Forecast application Traffic, Weather, Sea, … Scenarios Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
NextGRIDEU-driven Grid services architecture for businesS and industry Vision: An architecture for Next Generation Grids which will enable its widespread use by research, industry and the ordinary citizen thus creating a dynamic market place for new services and products.
NextGRID Goals • Develop architectural components that will lead to the emergence of the Next Generation Grid. • Prepare the way for the broader use of Grid technologies and their widespread adoption by organisations and individuals from the business and public domains. • Improve the technology in key areas such as security, development of applications, interoperability, quality of service and robustness. • Contribute to the standards which are essential if Next Generation Grids are to succeed. Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
NextGRID Partners Academic partners Commercial partners Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
The NextGRID Process • Applicationneeds • Existing BusinessModels • Existing standards • Expertise • Experience withGrid in production Conceptualisation Analysis Design • Architecture • Grid Business Models • Reference Implementations • Applications • Standards Feedback for next iteration Implementation Evaluation Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
SIMDATGrid-based generic enabling application technologies to facilitate solution of industrial problems
SIMDAT Objectives • Develop federated versions of problem solving environments • Support of distributed product and process development • Test and enhance grid technology for access to distributed data bases • Tools for semantic transformation between these data bases • Grid support for knowledge discovery • Promote defacto standards • Raise awareness in important industrial sectors Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
End Users Capability Providers Grid Technologists SIMDAT partners Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
SIMDAT - Overview Seven Grid-technology development areas: Grid infrastructure Distributed Data Access VO Administration Workflows Ontologies Analysis Services Knowledge Services Four sectors of international economic importance: Automotive Pharmaceutical Aerospace Meteorology The solution of industrially relevant complex problems using data-centric Grid technology. Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
SIMDAT Project Results • Federated versions of existing commercial Problem Solving Environments • (for example MSC.SímManager, ESI Composer, ESI SDM, LMS Tec.Manager, LION SRS) • Grid enabled versions of (commercial) analysis services • (for example ESI PAM-CRASH, MSC.Nastran) • Grid technology services • Commercial products for Grid support of Workflow, Ontologies • Grid enabled version of the WEKA data mining tool • Commercial product for Grid enabled model development (LMS.OPTIMUS) • Contributions to standardisation activities • Industrial showcases solving complex problems • Demonstration of the industrial relavance of the project results • (for example: Distributed knowledge discovery for the NVH behaviour of multiple cars based on the same platform) Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
CoreGRID European Research Network on Foundations, Software Infrastructures and Applications for Large Scale Distributed, Grid and Peer-to-Peer Technologies • Objectives • Build S&T excellency on Grid - EU-wide virtual laboratory • Achieve sustainable restructuring and integration • Disseminate EU research on Grid • Set-up a think-tank to create spin-off projects • Create the European “Grid Lighthouse” • Research Focus • Knowledge and data management • Programming models • System architecture • Grid Information and Monitoring Services • Resource Management & Scheduling • Problem solving environments, tools & Grid Systems VTT IC RAL-CCLRC U. Belfast U. Cambridge U. Cardiff U. Manchester U. Newcastle U. Wesminster 6 EU Virtual Institutes KTH SICS FhG FZ-Julich HLRS U. Munster U. Dortmund U. Passau ZIB Delft U. Vrije U. PSC CYFRONET CETIC UCL Masaryk U. INRIA CNRSERCIM EPFL UASF SZTAKI U. Coimbra CLPP-BAS UPC CNR-ISTI INFN U. Calabria U. Lecce U. Pisa ICS-FORTH U. Chile U. Cyprus 42 Partners Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Network priorities • Excellence • CoreGRID brings together a European critical mass of well-known experts in GRID and P2P research allowing to compete with research and development in US and Japan • An ambitious joint program of activities to deal with well identified challenges • Long-term integration & structuring • Set-up a sustainable European research laboratory with an associated management • With several Institutes • With research groups assigned to Institutes Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
A set of well identified research challenges • Knowledge & Data Management • Handling information/data that are required/produced by a wide range of diverse processing power • Programming Model • Making the programming of Grid infrastructures as simple and transparent as possible • System Architecture • Designing the next generation Grid middleware • Grid Information and Monitoring Services • Scalable information service to implement a service view of the Grid • Resource Management & Scheduling • Scheduling jobs/applications/tasks/computation within a Grid environment • Problem Solving Environments, tools and GRID systems • Integrating various middleware, tools and applications for problem solving Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Spreading Excellence Book Technical Reports http://www.coregrid.net Internal and External Communication June 14, 2005: 148,000 Visitors Brochure Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Spreading Excellence • Grid Users Community • Electronic mailing list, Scientific – Industry - Public • Newsletter • Quarterly • Nr. 1: February 2005 • Nr. 2: May 2005 • next issue: September 2005 • Editorial board • Sent to the GUC • European Grid Conference • EGC’2006 in June 6-7, 2006 • 4 days program • Grid project Launch event (IST Call 5) • Conference (2 days) • Grid concertation meeting (1 day) Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Durable mobility of researchers • Internal mobility is essential for integration • Ensure stronger co-operation among partners, promote career development and mobility • 2 activities : • Fellowship Programme - Young researchers hosted by two institutes for two distinct periods ~ 600 k€ • Research Exchange Programme - Researcher or student from 1 member to another, two weeks to six months~ 480 k€ • Search for external sources of funding is also needed, e.g. the Marie-Curie-Programme • Mobility web portal available at the CoreGRID web site Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Application Pull Grid-enabled Applications & Services for business and society Research, development, validation and take-up of generic environments and tools TechnologyPush Work Programme 2005-2006Advanced Grid Technologies, Systems and Services IST Call 5Open May 2005Close Sept 2005Budget: ~70M€ e-bus, e-health, e-goy, e-learning Environment, … Application Sector 1 Application Application Sector 3 Application Sector 2 Sector n Advanced Grid Technologies, Systems and Services Grid Foundations Architecture, design and development of technologies and systems for building the invisible Grid Network-centric Grid Operating Systems Potential new fabric layer for future distributed systems and services Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Degree Nessi-Grid Grid@Asia Challengers GridCoord SIMDAT industrial simulations BeinGrid business experiments BREIN agents & semantics NextGRID service architecture Akogrimo mobile services XtreemOS Linux based Grid operating system GridEcon InteliGrid OntoGrid GridComp GridTrust CoreGRID six virtual laboratories Gredia A-Ware HPC4U g-Eclipse UniGrids Grid4all ArguGrid Sorma KnowArc Datamining Grid Edutain@ Grid Chemomen tum Provenance K-WF Grid AssessGrid QosCosGrid Call 5 start: Summer 2006 FP6 Grid Technologies Projects Calls 2, 3, 5 EU Funding: 124 M€ supporting the NESSI ETP & Grid community Grid services, business models trust, security platforms, user environments data, knowledge, semantics, mining Specific support action Integrated project Network of excellence Specific targeted research project Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
User involvement… Real time Grid for remote control of instruments Optical solutions for Grid infrastruct. …technology validation New user communities using Grids – Digital Libraries Flexible Quality of Service Assurance GRIDCC MUPPET DILIGENT EUQoS EGEE DEISA SEE-GRID eInfrastructure IPv6TF SC EUROLABS IPv6 Task Force support Experimental testbeds LOBSTER Specific Support Actions Traffic monitoring Grid Deployment and Testbeds - Overview Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
The EGEE project – Building a Global Production Grid http://www.eu-egee.org
Computing intensive science • Science is becoming increasingly digital and needs to • deal with increasing amounts of data • Simulations get ever more detailed • Nanotechnology –design of new materials from the molecular scale • Modeling and predicting complex systems (weather forecasting, river floods, earthquake) • Decoding the human genome • Experimental Science uses ever moresophisticated sensors to make precisemeasurements • Need high statistics • Huge amounts of data • Serves user communities around the world Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
EGEE • Objectives • consistent, robust and secure service grid infrastructure • improving and maintaining the middleware • attracting new resources and users from industry as well as science • Structure • 70 leading institutions in 27 countries, federated in regional Grids • leveraging national and regional grid activities worldwide • funded by the EU with ~32 M Euros for first 2 years starting 1st April 2004 Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Country providing resources • Country anticipating joining EGEE/LCG • In EGEE-0: • >140 sites • >14 000 CPUs • >5 PB storage EGEE Infrastructure It is already exceeding original project plans Already outdated ! Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
LCG-1 LCG-2 gLite-1 gLite-2 Globus 2 based Web services based EGEE Middleware - gLite • Intended to replace present middleware with production quality services • Developed from existing components • Aims to address present shortcomings and advanced needs from applications • Prototyping short development cycles for fast user feedback • Initial web-services based prototypes being tested Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Pilot applications • High-Energy Physics (HEP) • Provides computing infrastructure (LCG) • Challenging: • thousands of processors world-wide • generating terabytes of data • ‘chaotic’ use of grid with individual user analysis (thousands of users interactively operating within experiment VOs) • Biomedical Applications • Similar computing and data storage requirements • Major challenge: security Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Generic Applications • EGEE Generic Applications Advisory Panel (EGAAP) • UNIQUE entry point for “external” applications • Reviews proposals and make recommendations to EGEE management • Deals with “scientific” aspects, not with technical details • Generic Applications group in charge of introducing selected applications to the EGEE infrastructure • 6 applications selected so far: • Earth sciences (I and II) • MAGIC (Astronomy) • Computational Chemistry • PLANCK (Astronomy) • Drug Discovery • GRACE (end Feb 2005) Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
The DEISA consortium New members in 2005: BSC, Barcelona Supercomputing Centre, Spain HLRS, Stuttgart, Germany LRZ, Munich, Germany Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Requirements and strategies • Fast deployment of a persistent, production quality, grid empowered supercomputing infrastructure with continental scope. • European supercomputing service built on top of existing national services (reliability, non disruptive behavior) • Top-bottom approach: technology choices follow from the business and operational models of virtual organizations. DEISA technology choices are fully open. • Two level operation: • Deep integration and highly coupled operationof homogeneous platforms: promoting cluster software to super-cluster middleware • Looser federation of heterogeneous platforms: heterogeneous grid of supercomputers and super-clusters. Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
AIX distributed super-cluster Vector systems GEANT Linux systems Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
The AIX DEISA super-cluster (phase 1) Global, high performance, Distributed file system with continental scope (GPFS). Dynamic pool of resources. VPN connecting computing platforms on NRENs – GEANT infrastructures. 4000 processors, 24 Teraflops of integrated computing power Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Heterogeneous Supercomputing Grid • Workflow management: UNICORE plus further extensions and services coming from DEISA’s JRA7 and UniGrids. • Global data management: a detailed architecture is being defined, based partly on extended global file systems on heterogeneous systems, partly on more general OGSA based services. • Scheduling: some reliable and stable implementation of advanced reservation and co-scheduling is needed for Grid aplications running on the heterogeneous environment. • Science gateways and portals: specific Internet interfaces to hide complex supercomputing environments from end users, and facilitate the access of new, non traditional, scientific communities. Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005
Conclusion • A huge funding effort from the European Union in Grid research and infrastructure • Gather a critical mass of skills & competences from research to engineering • The EU is at the leading edge of Grid computing for both e-science, e-engineering and e-business applications Presentation of the main current EU projects on GRID - T. Priol CoreGRID Summer School 05-09/09/2005