1 / 26

Institute of Information and Communication Technologies – Bulgaria and IT

Explore the history, technology, and achievements of the Supercomputer System Avitohol at IICT-BAS, including specifications, software, and access information. Follow the journey of Bulgaria's leading partner in innovative HPC projects.

lcripps
Download Presentation

Institute of Information and Communication Technologies – Bulgaria and IT

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Institute of Information and Communication Technologies – Bulgaria and IT Assoc. Prof. EmanouilAtanassov Head of Grid Technologies and Applications Department Institute of Information and Communication Technologies – BAS Email: emanouil@parallel.bas.bg

  2. Historic perspective • IICT-BAS operated different types of clusters and supercomputers like the Origin 2000 • IICT-BAS coordinates the Bulgarian participation in the European Grid Initiative, first through the EGEE series of projects, then EGI-InSPIRE and EGI-Engage • IICT-BAS is one of the leading partners in a series of projects that spread the expertise of advanced countries in the region to the less developed countries • Innovative scientific applications are developed and run on the available HPC equipment at IICT-BAS by teams of scientists from institutes of the Bulgarian Academy of Sciences and leading universities in Bulgaria. • Clusters at IM-BAS, INRNE-BAS and Sofia Universtitywere added to the EGEE production infrastructure during EGEE and EGEE 2 projects.

  3. Regional Cooperation -History • PROJECTS

  4. Regional partnerships – from infrastructure to applications

  5. National Roadmap for Research Infrastructures

  6. HPC resources in Bulgaria

  7. HPC Center “Avitohol” at IICT Top500 List on 389 place (Nov 2015) http://www.top500.org/system/178609 • tt 10 Gbps Users workstations

  8. The Supercomputer System Avitohol at IICT-BAS • 8 water-cooled racks of type HP MCS 200, paired in couples. • Each pair provides power and cooling for up to 50 kW of equipment • About 90% of the computational power comes from the accelerators – one 7120P coprocessor achieves 1.25 TFlop/s in double precision. • Total energy use at maximum load ~ 250kW.

  9. The Supercomputer System Avitohol at IICT-BAS • RedHat Enterprise for HPC • Intel Cluster Studio (compilers, MPI,MKL) • Moab for resource management with web and command line interface • High-end database software - SAP HANA – in-memory database with advanced real-time analytics capabilities

  10. The Supercomputer System Avitohol at IICT-BAS • 150 dual-socket nodes HP SL250s Gen8 with 2 Intel Xeon E5-CPU E5-2650 v2 @ 2.60GHz and 2 Intel Xeon Phi 7120P coprocessors, 64 GB RAM • Interconnected with fully non-blocking FDR InfiniBand • Lustre parallel filesystem, 96 TB of disk storage

  11. The Supercomputer System Avitohol at IICT-BAS • Linpack tests: • 222.0 TFlop/s achieved in June, the system entered Top500 in 332nd place. • Further tuning of hardware and software produced the new result of 264 TFlop/s, maintaining presence in the November Top500 list. • For comparison the Blue Gene/P supercomputer achieved 23.9 TFlop/s and was last present in Top500 list in November 2009 in 379th place.

  12. National projects supported

  13. International projects supported

  14. Extension HPCG cluster at IICT-BAS – BG01-IPP • 36 blade servers HP BL 280c, deployed in 3HP Cluster Platform Express 7000 enclosures, each with 2 Xeon X5560 @ 2.80GHz, 24 GB RAM –576 cores total with more than 3 Tflops peak performance; 8 dual-socket HP DL 380 G6 with dual Intel X5560 @ 2.8 Ghz, 32 GB RAM. Non-blocking Infiniband interconnection @ 20 Gbps, 92% efficiency onLINPACK - 3 TFlops • Total disk storage more than 132 TB from three disk systems, interconnected with Fibre Channel. • 2 HP ProLiant SL390s G7 4U servers with 16 NVIDIA Tesla M2090 graphic cards (total 8192 GPU cores with 10.64 TFlops in double precision); HP SL270s Gen8 4U server with 8 Intel Xeon Phi 5110P Coprocessors (total 480 cores, 1920 threads, 8.088 TFlops of double-precision peak performance per server). • Total peak theoretical peak performance 22.93 TFlops

  15. Organization of access • Bulgarian scientists can obtain access to the HPC systems of IICT-BAS by filling request forms that are assessed on basis of scientific merit. • Remote access through ssh: • gw.avitohol.acad.bg • Batch system: torque/moab • Development tools: • Intel Parallel Studio XE 2016 • GNU Compiler Collection • MVAPICH 2.2 • Open MPI • Support helpdesk: avitohol-support@parallel.bas.bg • Access policies: • http://www.hpc.acad.bg/access-policies/ • More information at: • http://www.hpc.acad.bg/

  16. Organization of access • IICT-BAS maintains the BG.ACAD CA certification authority, which issues x509 certificates for use in Grids and PRACE. • BG.ACAD CA is member of EUGRID PMA organization, thus Bulgarian certificates are accepted in all European resources and the collaborating Asian-Pacific and American resources. • Avitohol is reachable through the PRACE internal network

  17. Software and tools • Libraries: • MKL • FFTW • PETSc • SLEPc • GSL • NetCDF … • Languages, tools: • R, Python, Java • cmake, gnuplot • Paraview • Scalasca • gdb, gprof …

  18. IICT-BAS is the Bulgarian representative in the European Grid Initiative - EGI Data Providers Technology Providers Service Providers All

  19. European Grid Initiative - EGI Innovating with RIs -The Distributed Competence Centre of EGI-Engage

  20. Regional HPC and distributed computing initiative – VI-SEEM • The project VI-SEEM aims to integrate all kinds of electronic infrastructure in the region – Grid, Cloud, HPC, BigData, in order to provide single point of access for scientists in the region of South Eastern Europe and the Mediterranean. • Bulgaria is the leader in the HPC area. • Provides user-friendly integrated e-Infrastructure platform for Scientific Communities in: • Climatology, • Life Sciences, • Cultural Heritage for the SEEM region by linking compute, data, and visualization resources, as well as services, software and tools. • Avitohol is the most powerful supercomputer in VI-SEEM

  21. VI-SEEM Geographical and historical context • VRE for regional Interdisciplinary communities in SEE and EM • Merging of SEE and EM regions • SEE: network SEEREN1-2, Grid SEE-GRID-1/2/SCI, HPC HP-SEE • EM: HPC LinkSCEEM1-2

  22. Regional HPC and BigData Resources • Main resource providers – Bulgaria, Greece, Serbia. • Heterogeneous computing resources – CPU-only, • GPGPU-enmabled, Xeon Phi, IBM Cell • Bulgaria is the leader in computing. • Need for larger and better storage facilities

  23. VI-SEEM technology context • Overall objective: Provide user-friendly integrated e-Infrastructure platform for Scientific Communities in Climatology, Life Sciences, and Digital Cultural Heritage for the SEEM region; by linking compute, data, and visualization resources, as well as services, software and tools. • Diverse computing technologies • Advent of big data • Service orientation

  24. EU Network of HPC Competency Centres working with SMEs – SESAME NET • 14 Partners , 13 Member States • ARCTUR, Slovenia (coordinator) • Bangor University, United Kingdom • Irish High End Computing, National University of Galway, Ireland • Fraunhofer Institute for Algorithms and Scientific Computing (SCAI), Germany • Poznan Supercomputing and Networking Center IBCH (Inst. of Bioorganic Chemistry) PAS, Poland • Greek Research and Technology Network S.A., Greece • Centro de Supercomputación de Galicia CESGA, Spain • IT4Innovations National Supercomputing Center, VŠB – Techn. University of Ostrava, Czech Republic • Yotta Advanced Computing d.o.o., Croatia • West University of Timisoara UVT, Romania • Inst. of Inform. and Comm. Technologies of BAS (IICT-BAS), Bulgaria • Ruder Bošković Institute, Croatia • Herculesstichting / Flemish Supercomputing Centre, Belgium • Vilnius University – Faculty of Mathematics and Informatics, Lithuania

  25. BG05-SUGRID perspectives • The BG05-SUGrid Grid site is currently the second Bulgarian production Grid Site. • Its current hardware is rather limited, however substantial upgrade is planned: • Computing - 72 servers with dual Intel L5640 (12 cores) - 864 total physical cores, with capability for hyperthreading • Storage - 15 servers with 24*2TB hdd each – 720 TB total

  26. Conclusions • The Avitohol supercomputer is the top HPC system in Bulgaria and ensures the needs of Bulgarian scientists in the near term. • It is used mostly for HPC tasks, but some distributed computing research is also performed on it. • Grid clusters like BG01-IPP and BG05-SUGRID support diverse virtual organizations, including those from CERN. • Advanced hardware sustains involvement in both infrastructure provision and development activities • The equipment and software is upgraded regularly, following the best practices in the IT • Ensuring governmental support for the upgrade and maintenance of the infrastructure is crucial for its capability to support advanced research

More Related