140 likes | 257 Views
Swiss-Tx. Swiss-Tx : A Commodity MPI computing solution. Ralf Gruber, EPFL-SIC/CAPA/Swiss-Tx, Lausanne. Mars 1999. Installation. #P. Peak. Memory. Disk. Operating. Date Place. Gflop/s. GBytes. GBytes. system. 12.97 EPFL. 8. Digital Unix. 1**. 2. 64. 8. 10.98 EPFL. 16. 16.
E N D
Swiss-Tx Swiss-Tx:A Commodity MPI computing solution Ralf Gruber, EPFL-SIC/CAPA/Swiss-Tx, Lausanne Mars 1999
Installation #P Peak Memory Disk Operating Date Place Gflop/s GBytes GBytes system 12.97 EPFL 8 Digital Unix 1** 2 64 8 10.98 EPFL 16 16 170 - Windows NT Digital Unix 8 8.99 EPFL 4.00 DGM 170 16 - 16 8 Tru64 Unix 1.00 EPFL Tru64 Unix 35 1** 70 950 70 Swiss-Tx The Swiss-Tx machines Machine Archive Connection TBytes system Swiss-T0 EasyNet bus FE bus Swiss-T0 * (Dual) EasyNet bus FE switch Baby T1* Crossbar 12x12 FE switch Swiss-T1 Crossbar 12x12 FE switch Swiss-T2 ? ? 504 1008 252 9000 - Not decided Crossbar 12x12 FE switch * Baby T1 is an upgrade of T0(Dual) ** Archive ported from T0 to T1 September 1998
Swiss-Tx Swiss-T1 March 2000
Swiss-Tx Swiss-T1 Architecture March 2000
Swiss-Tx Swiss-T1 Components 32 computational DS20E 2 frontend DS20E 1 development DS20E 300 GB Raid 600 GB distributed disks 1 TB DLT library Fast/Gigabit Ethernet Tru64/TruCluster Unix LSF, GRD/Codine Totalview, Paradyn MPICH, PVM T-Net network technology ( 8+1)12x12 crossbar 1.2 GB/s 32 bit PCI adapter 75 MB/s (64 bit PCI adapter 180 MB/s) Flexible, non-blocking Reliable Optimal routing FCI (one-sided) 5 ms MPI 18 ms Monitoring system Remote management Up to 3 Tflop/s (g < 100)
Swiss-Tx Baby T1 Architecture March 2000
Swiss-Tx Fat-tree/Crossbars 16x16 N=8, P=8, N*P=64 PUs, X=12, BBW=32, L=64 March 2000
Swiss-Tx Circulant graphs/Crossbars 12x12 K=2 (1/3) N=8, P=8, X=8 BBW=8, L=16 K=3 (1/3/5) N=11, P=6, X=11 BBW=18, L=33 K=4 (1/3/5/7) N=16, P=4, X=16 BBW=32, L=64 March 2000
Swiss-Tx Fat-tree/Circulant graphs March 2000
Swiss-Tx Swiss-T2 : K-Ring architecture March 2000
Swiss-Tx Swiss-T1 : Alternative network March 2000
Swiss-Tx Swiss-T1: Software in a Box *Digital Unix Compaq Operating system in each box *F77/F90 Compaq Fortran compilers *HPF Compaq High performance Fortran *C/C++ Compaq C and C++ compilers *DXML Compaq Digital math library in each box *Posix threads Compaq Threading in a box *OpenMP Compaq Multiprocessor usage in a box through directives *KAP-F KAI To parallelise a Fortran code in a multiprocessor box *KAP-C KAI To parallelise a C program in a multiprocessor box 15 juin 1998
Swiss-Tx Swiss-T1: Software between Boxes *LSF Platform Inc.Load Sharing Facility for resource management *Totalview Dolphin Parallel debugger *Paradyn Madison/CSCS Profiler to help parallelising programs *MPI-1/FCI SCS AG Message passing interface between boxes running over TNET *MPICH Argonne Message passing interface running over Fast Ethernet **PVM UTK Parallel virtual machine running over Fast Ethernet *BLACS UTK Basic linear algebra subroutines *ScaLAPACK UTK Linear algebra matrix solvers MPI I/O SCS/LSP Message passing interface for I/O MONITOR EPFL Monitoring of system parameters NAG NAG Math library package Ensight Ensight 4D visualisation MEMCOM SMR SA Data management system for distributed architectures 15 juin 1998
Swiss-Tx Create SwissTx Company Commercialise T-Net Commercialise machines for Compute Centres Commercialise dedicated machines Transfer knowhow in parallel application technology