1 / 25

DEISA Towards a European HPC Infrastructure (deisa.eu)

DEISA Towards a European HPC Infrastructure (www.deisa.eu). Topics Vision The DEISA/eDEISA Infrastructure The DEISA2, the European HPC infrastructure. Status of the European HPC Infrastructure. Vision of the European DEISA/eDEISA projects in FP6

tamika
Download Presentation

DEISA Towards a European HPC Infrastructure (deisa.eu)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. DEISA Towards a European HPC Infrastructure(www.deisa.eu) Topics Vision The DEISA/eDEISA Infrastructure The DEISA2, the European HPC infrastructure

  2. Status of the European HPC Infrastructure • Vision of the European DEISA/eDEISA projects in FP6 • To enhance Europe’s capability computing and science by the integration of Europe’s most powerful supercomputing systems Tier-1 in a European HPC e-infrastructure • DEISA built a European Supercomputing Service on top of existing national services. This service is based on the deployment and operation of a persistent, production quality, distributed supercomputing environment with continental scope • Vision of the European Strategy Forum on Research Infrastructures (ESFRI) • Delivering a turnkey operational solution for a future persistent European HPC ecosystem integrating national Tier-1 centres and the new European Tier-0 centres

  3. DEISA2 - The Infrastructure for the European HPC Ecosystem Deep operational and technological integration of European HPC (T-0 and T-1) centres and systems providing efficient seamless access to shared HPC resources and large data repositories designing and approving an operational model for a large European Virtual HPC Centre. Providing scientists access to a large distributed HPC environment via integrated services. DEISA is paving the way to the efficient operation of the T-0 and T-1 ecosystem T-1 T-1 T-1 T-1 T-0 T-1 T-0 T-0 Enhancing the performance PRACE Building a world-class pan-European High Performance HPC Ecosystemwhich is operated under the umbrella of an European Legal Entityadopting operational and technological concepts and servicesdesigned and approved by DEISA2. Vision of a European HPC Ecosystem in FP7 T-0: future shared European PetaFLOP systems T-1: leading national supercomputing systems …

  4. Weather forecast Communities National HPC Center (T1) USA TeraGrid,DoE National HPC Center (T1) Japan NAREGI National HPC Center (T1) Material Sciences Community Fusion Community DEISA2 European Petascale Center (T0) European Petascale Center (T0) European Petascale Center (T0) National Data Center (T1) National Data Center Russian Academy Chinese Academy Industry Communities National HPC Center (T1) Climate Community National HPC Center (T1) Cosmology Community Towards a European HPC Infrastructure – DEISA2 DEISA2 – The Virtual European HPC Center Operation - Technology - Application Objectives Enhancing the existing distributed European HPC environment (DEISA) to a turnkey operational infrastructure • Advancing the computational sciences in Europe by supporting user communities and extreme computing projects • Enhancing the service provision by offering a complete variety of options of interaction with computational resources • Integration of T1 and T0 centres • The Petascale Systems need a transparent access from and into the national data repositories Bridging worldwide HPC projects

  5. DEISA: May 1st, 2004 – April 30th, 2008 Three new partners joined June 2005 (eDEISA) DEISA2: May 1st, 2008 – April 30th, 2011 DEISA Partners

  6. Partners/ Associate Partners • BSCBarcelona Supercomputing CentreSpain • CINECA Consortio Interuniversitario per il Calcolo AutomaticoItaly • CSCFinnish Information Technology Centre for ScienceFinland • EPCCUniversity of Edinburgh and CCLRCUK • ECMWFEuropean Centre for Medium-Range Weather ForecastUK (int) • FZJ Research Centre JuelichGermany • HLRS High Performance Computing Centre StuttgartGermany • IDRIS Institut du Développement et des RessourcesFrance • en Informatique Scientifique- CNRS • LRZ Leibniz Rechenzentrum MunichGermany • RZG Rechenzentrum Garching of the Max Planck SocietyGermany • SARADutch National High Performance ComputingNetherlands • KTH Kungliga Tekniska Högskolan Sweden • CSCSSwiss National Supercomputing Centre Switzerland • JSCCJoint Supercomputer Center of the Russian Russia • Academy of Sciences

  7. The basic DEISA infrastructures and services • Dedicated high speed network infrastructure • Common AAA infrastructure • Global data managementinfrastructure • Integrating distributed data with distributed computing platforms, including hierarchical storage management and databases. Major highlights are: • High performace remote I/O and data sharing with global file systems, using full network bandwidth • High performance transfers of large data sets, using full network bandwidth • DCPE (Distributed Common Production Environment) • The job management service • The science gateways (portals) to supercomputing resources • Common Operational Environment • Common monitoring and Information systems • Common system operation • Common help desk • Global Application Support

  8. DEISA network infrastructure FUNET DFN SURFnet UKERNA GÉANT GARR RENATER 1 Gb/s GRE tunnel 10 Gb/s wavelength 10 Gb/s routed 10 Gb/s switched RedIris

  9. GARR CINECA-Net: 130.186.27.0/24 DEISA 1GE site ECMWF via GEANT2 GRE tunnel ECMWF-Net: 136.156.48.0/24

  10. DEISA Data Services - Global File System (based on IBM’s GPFS) AIX IBM domain Linux SGI SARA (NL) IDRIS (FR) ECMWF (UK) RZG (DE) High Peformance Common Global File System various architectures / operating systems High bandwidth (up to10 Gbit/s) HPC Common Global File System similar architectures / operation systems High bandwidth (10 Gbit/s) LRZ (DE) LRZ (DE) CSC (FI) BSC (ES) LINUX Power-PC CINECA (IT) FZJ (DE)

  11. Workflow simulations using UNICORE UNICORE supports complex simulations that are pipelined over several heterogeneous platforms (workflows). UNICORE handles workflows as a unique job and transparently moves the output – input data along the pipeline. UNICORE clients that monitor the application can run in laptops. UNICORE has a user friendly graphical interface. DEISA has developed a command line interface for UNICORE.

  12. Operational Model

  13. Enabling Science • The basic service providing model for scientific users is the Extreme Computing Initiative (see www.deisa.org) • Identification, deployment and operation of a number of « flagship » applications requiring the infrastructure services, in selected areas of science and technology. • European Call for proposals in May-June every year. Applications are selected on the basis of scientific excellence, innovation potential and relevance criteria, with the collaboration of the HPC national evaluation committees. • Supported by the Applications Task Force (ATASKF) • Hyperscaling of huge parallel applications, data oriented applications • Workflows and coupled applications • Production of an European Benchmark Suite for HPC systems

  14. DEISA Extreme Computing Initiative DECI call 2005 51 proposals, 12 European countries involved 30 mio cpu-h requested 29 proposals accepted, 12 mio cpu-h (standardized of P4 Jülich) DECI call 2006 41 proposals, 12 European countries involved 28 mio cpu-h requested 23 proposals accepted, 12 mio cpu-h DECI call 2007 63 proposals, 14 European countries involved (US, Canada, Brazil, Israel) 30 mio cpu-h requested

  15. DEISA Extreme Computing Initiative 15 European countries so far involved in DECI: Austria Finland France Germany Greece Hungary Italy Netherlands Poland Portugal Russia Spain Sweden Switzerland UK

  16. DECI Projects – Publications Cover story of Nature May 24, 2007 DECI project POLYRES Benedict J. Reynwar, Gregoria Illya, Vagelis A. Harmandaris, Martin M. Müller, Kurt Kremer & Markus Deserno: Aggregation and vesiculation of membrane proteins by curvature mediated interactions, NATURE Vol 447|24 May 2007| doi:10.1038/nature05840 26 publications so far, among them NATURE, Phys Rev B, Phys Rev Lett, PNAS

  17. The purpose of the DEISA2 • Consolidation of the existing DEISA infrastructure • Guaranteeing the continuity of those activities and services that currently contribute to the effective support of world-leading computational science in Europe • DEISA2 providing a lean and reliable turnkey operational solution for a persistent European HPC ecosystem • Evolvement this European infrastructure towards a robust and persistent European HPC ecosystem • Enhancing the existing services, by deploying new services including • support for European Virtual Communities, and by cooperating and • collaborating with new European initiatives, especially PRACE that will enable shared European PetaFlop/s supercomputer systems • DEISA2 as the vector for the integration of Tier-0 and Tier-1 systems in Europe

  18. The purpose of DEISA2 • DEISA2 advancing computational sciences in Europe • DEISA2 will provide a consistent infrastructure for virtual organisations as the European Fusion Development Agreement (EFDA) supporting ITER, the Climate Modelling Community, the Cosmology Consortium VIRGO, Material Sciences projects/communities, Life Science projects/communities • DEISA2 as an extended partnership • DEISA2 targets the integration of further national Tier-1 partners • DEISA2 bridging worldwide HPC projects • Interoperation in a Grid context worldwide is seen as an important step for supporting international science communities which acquire computing time traversing existing political boundaries

  19. Integrated Tier-1 Systems

  20. Collaboration with other EU Projects, Institutions,…

  21. DEISA Towards a European HPC Infrastructure Topics Vision The DEISA/eDEISA Infrastructure The DEISA2, the European HPC infrastructure

  22. WP3 - Operations Request for new/upgraded services Answer Offer new service or upgrade existing ones WP4 - Technologies Answer Request for new/upgraded services Offer new service or upgrade existing ones WP6/WP6/WP7/WP9 – Applications and user support Relationship of the WPs in DEISA2 (except management, dissemination and one “real” JRA)

  23. Management Structure

  24. DEISA2 • WP1 Management • WP2 Dissemination, External Relations • WP3 Operations • WP4 Technologies • WP5 Applications enabling • WP6 Environment, User Related Application Services, and Training • WP7 DECI Computing Projects and Benchmark Suite • WP8 (JRA) Integrated DEISA Development Environment • WP9 (JRA) Enhancing Scalability

  25. DEISA2 should start 1st of May 2008 with 3 new Associate Partners for 3 years DEISA Partners DEISA Start on 1st of May 2004 Three new partners joined with eDEISA June 2005

More Related