1 / 24

CENTRO DE SUPERCOMPUTACIÓN DE GALICIA

CENTRO DE SUPERCOMPUTACIÓN DE GALICIA. FORMIGA/G-FLUXO Adding Computer Labs to the Grid. J. López , D. Cordero, C. Fernández 2 , E. Gutierrez, J.I. López /CESGA R. Valín, A. Rodríguez, A. García, M. Aldegnde, N. Seoane, et al. /DEC. Ibergrid’09 - Valencia, Spain, 28/05/2009. OUTLINE.

lamya
Download Presentation

CENTRO DE SUPERCOMPUTACIÓN DE GALICIA

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CENTRO DE SUPERCOMPUTACIÓN DE GALICIA • FORMIGA/G-FLUXO • Adding Computer Labs to the Grid J. López, D. Cordero, C. Fernández2, E. Gutierrez, J.I. López /CESGA R. Valín, A. Rodríguez, A. García, M. Aldegnde, N. Seoane, et al. /DEC Ibergrid’09 - Valencia, Spain, 28/05/2009

  2. OUTLINE Introduction Platform Architecture Benchmarks User Interface Functionality Final remarks

  3. FORMIGA/GFLUXO: Adding Computer Labs to the Grid INTRODUCTION

  4. FORMIGA/G-FLUXO OBJECTIVES Integrate the available resources in the computer labs of Galician Universities Through the development of: A stable and secure infrastructure A common interface to access the resources that it is easy to use (G-FLUXO web portal)‏ SANTIAGO DE COMPOSTELA, SPAIN,

  5. COMPUTER LABS University of Santiago de Compostela (USC) alone has more than 90 computer labs with more than 1800 computers

  6. INTEROPERABILITY FORMIGA intrastructure is the first of its type that offers interoperability with EGEE, EELA, int.eu.grid and Spanish NGI.

  7. OPEN SOURCE All software and documentation generated in the projects are Open Source and distributed under the GPL license through mancomun.org.

  8. FORMIGA/GFLUXO: Adding Computer Labs to the Grid PLATFORM ARCHITECTURE

  9. PLATFORM ARCHITECTURE Each virtual machine uses a unique digital certificate to access the VPN

  10. FORMIGA/GFLUXO: Adding Computer Labs to the Grid BENCHMARKS

  11. BENCHMARKS An extensive set of benchmarks has been performed to see the performance lost incurred by using virtual machines. The tests included both synthetic and application benchmarks: iozone, linpack, iperf, GROMACS, etc. Intel(R) LINPACK data Number of tests : 3 Number of equations to solve (problem size) : 8000 6000 1000 Leading dimension of array : 8008 6008 1000 Number of trials to run : 2 3 4 Data alignment value (in Kbytes) : 4 4 4 Maximum memory requested that can be used = 512676256, at the size = 8000 ============= Timing linear equation system solver ================= Size LDA Align. Time(s) GFlops Residual Residual(norm)‏ 8000 8008 4 16.895 20.2113 7.066303e-11 3.887079e-02 8000 8008 4 16.493 20.7030 7.066303e-11 3.887079e-02 6000 6008 4 7.316 19.6923 3.668375e-11 3.557537e-02 6000 6008 4 7.277 19.7983 3.668375e-11 3.557537e-02 6000 6008 4 7.066 20.3905 3.668375e-11 3.557537e-02 1000 1000 4 0.040 16.6875 1.164207e-12 3.970245e-02 1000 1000 4 0.047 14.2007 1.164207e-12 3.970245e-02 1000 1000 4 0.046 14.4182 1.164207e-12 3.970245e-02 1000 1000 4 0.035 19.0441 1.164207e-12 3.970245e-02 Performance Summary (GFlops)‏ Size LDA Align. Average Maximal 8000 8008 4 20.4571 20.7030 6000 6008 4 19.9604 20.3905 1000 1000 4 16.0876 19.0441

  12. IOZONE 1/2 I/O performance was analysed using Iozone. The I/O performance is very similar between the Dom0 and the virtual machine: Virtual Machine Dom0 Write performance: very similar

  13. IOZONE 2/2 Comparison between a WMWare WN under Windows and a Xen WN under Linux: Linux (Xen)‏ Windows (VmWare)‏ Write performance. VMWare VM increases its performance when the file size increases.

  14. LINPACK No performance loss detected! MAQUINA VIRTUAL CPU frequency: 3.014 GHz Number of CPUs: 1 Number of threads: 1 Parameters are set to: Number of tests : 2 Number of equations to solve (problem size) : 6000 1000 Leading dimension of array : 6008 1000 Number of trials to run : 3 4 Data alignment value (in Kbytes) : 4 4 Maximum memory requested that can be used = 288508256, at the size = 6000 ============= Timing linear equation system solver ================= Size LDA Align. Time(s) GFlops Residual Residual(norm)‏ 6000 6008 4 30.726 4.6889 4.005251e-11 3.884235e-02 6000 6008 4 30.722 4.6896 4.005251e-11 3.884235e-02 6000 6008 4 30.717 4.6902 4.005251e-11 3.884235e-02 1000 1000 4 0.177 3.7694 1.452521e-12 4.953468e-02 1000 1000 4 0.178 3.7493 1.452521e-12 4.953468e-02 1000 1000 4 0.178 3.7638 1.452521e-12 4.953468e-02 1000 1000 4 0.178 3.7571 1.452521e-12 4.953468e-02 Performance Summary (GFlops) Size LDA Align. Average Maximal 6000 6008 4 4.6896 4.6902 1000 1000 4 3.7599 3.7694 DOM0 CPU frequency: 3.014 GHz Number of CPUs: 1 Number of threads: 1 Parameters are set to: Number of tests : 2 Number of equations to solve (problem size) : 6000 1000 Leading dimension of array : 6008 1000 Number of trials to run : 3 4 Data alignment value (in Kbytes) : 4 4 Maximum memory requested that can be used = 288508256, at the size = 6000 ============= Timing linear equation system solver ================= Size LDA Align. Time(s) GFlops Residual Residual(norm)‏ 6000 6008 4 30.760 4.6837 4.005251e-11 3.884235e-02 6000 6008 4 30.720 4.6898 4.005251e-11 3.884235e-02 6000 6008 4 30.723 4.6894 4.005251e-11 3.884235e-02 1000 1000 4 0.178 3.7489 1.452521e-12 4.953468e-02 1000 1000 4 0.178 3.7553 1.452521e-12 4.953468e-02 1000 1000 4 0.181 3.6944 1.452521e-12 4.953468e-02 1000 1000 4 0.178 3.7513 1.452521e-12 4.953468e-02 Performance Summary (GFlops) Size LDA Align. Average Maximal 6000 6008 4 4.6877 4.6898 1000 1000 4 3.7375 3.7553

  15. FORMIGA/GFLUXO: Adding Computer Labs to the Grid USER INTERFACE

  16. HOW TO USE FORMIGA

  17. GFLUXO WEB PORTAL

  18. FORMIGA/GFLUXO: Adding Computer Labs to the Grid FUNCTIONALITY

  19. FIRST PROTOTYPE FEATURES • Virtualization with Xen • Great flexibility • Virtual Private Network • Avoid network restrictions • General Monitoring Tools: • Ganglia, Nagios and SAM • Custom Monitoring Tools • Custom Web • Automatic Inventory • OCS/GLPI Inventory Portal

  20. FINAL PROTOTYPE FEATURES • Virtualization with VMWare • Personal UI VM • Job resubmission in case of node failure • Job migration • SGE sensor to check free disk space • Mapping of resources and OpenMP support • Email Notifications • Real time access to job output • Remote shutdown/startup using Wake-on-LAN • Power Saving Functionalities

  21. FORMIGA/GFLUXO: Adding Computer Labs to the Grid FINAL REMARKS

  22. Final remark: Bureaucracy

  23. LINKS • http://formiga.cesga.es • http://gfluxo.cesga.es • VO CESGA: http://www.cesga.es/vo.html • Mailing lists: • formiga@listas.cesga.es • g-fluxo@listas.cesga.es

  24. THANK YOU FOR YOUR ATTENTION

More Related