140 likes | 346 Views
HIGH PERFORMANCE COMPUTING ENVIRONMENT. The High Performance Computing environment consists of high-end systems used for executing complex number crunching applications for research it has two such machines and they are, LIBRA (GPU) Cluster. VIRGO Super cluster. IBM's VIRGO SUPERCLUSTER.
E N D
HIGH PERFORMANCE COMPUTING ENVIRONMENT • The High Performance Computing environment consists of high-end systems used for executing complex number crunching applications for research it has two such machines and they are, • LIBRA (GPU) Cluster. • VIRGO Super cluster.
FDR 10 Infiniband Inter Processor Communication Network VIRGO 298 IBM System x iDataPlex dx360 M4 Servers SAN Switch - 1 SAN Switch - 2 1 Gbps Ethernet xCAT Management Network PFS - 1 PFS - 2 NFS
SystemConfiguration • 292 Compute Nodes • 2 Master Nodes • 4 Storage Nodes • Total Compute Power 97 TFlops • IBM System x iDataPlex dx360 M4 Highly Optimized Servers for HPC • Populated with 2 X Intel E5-2670 8 C 2.6 GHz Processor • A total of 64 GB RAM per node with 8 X 8 GB 1600 MHz DIMM connected in a fully balanced mode. • Low powered Mezzanine Adapter for FDR10 Infiniband based Inter processor communication
Storage Configuration • 2 Storage Subsystem for PFS and 1 Storage Subsystem for NAS. • Fine Tuned Redundant SAN Switch • IBM DS3500 Series of Storage System • Total PFS Capacity 160 TB • Total NAS Capacity 50 TB
Virgo Highlights • Ranked 4th in India • Ranked 224th in the world • Fastest in Indian Academic Institutions • 1st in India • 5th in the world • Rmax of 91.126 TF • Rpeak of 97.843 TF • Efficiency is 932 MFlop/Watt
Software Stack • Novell SuSE Enterprise Linux with SP2 • Extreme Cluster Administration Toolkit (xCAT) • IBM General Parallel File System • IBM Load Leveler • Intel Cluster Studio • IBM Tivoli Storage Manager • Vtunes and Intel Cluster Studio XE Commercial Software Namd 2.9 Gromacs 4.0.7,4.5.5 Ansys 11,12 Abaqus 6.10,.6.11 Fluent 6.3 OpenFoam 2.1.1 Comsol 4.3 Mathematica 8,9 Matlab 2012a,2012b Lammps (parallel) Gaussian 9 version A.02 Allinea
Parallel computing Frameworks Text File Editor • Gvim/VI editor • Emacs • Gedit • OpenMPI • MPIch • Intel-MPI Compilers Interpreters and Runtime Environments • Gnu compilers 4.3.4 • Intel Compilers 13.00 • Javac 1.7.0 • Python 2.7/2.7.3 • Cmake 2.8.10.1 • Perl 5.10.0 • Java 1.7.0 • Python 2.7/2.7.3 • Numpy 1.6.1 Open Source Software • Open foam • Scilab Scientific Libraries Visualization Software • FFTW 3.3.2 • HDF5 • MKL • GNU Scientific Library • BLAS • LAPACK • LAPACK ++ • Gnuplot 4.0 Debugger • Gnu gdb • Intel idb
Libra Cluster • 1 Head Node on HP Proliant DL380 G7 servers with Dual Processors, Six-Core Intel Xeon 5670 series processors with 24GB RAM and 146gb of SAS Hard disk. • 8 nodes based on HP Proliant SL390s server of Dual processor, Six-core, Intel Xeon X5675 Processors with 3 Telsa M2070 GPU card and 146gb of SAS Hard disk in each node.
GPU Hardware The GPU Cluster consist of One head node and 8 compute nodes and storage which achieves a performance of 6TFLOPS. Each node entails 3 Tesla GPU's, Intel Xeon with 12 CPU's and 10TB of shared storage.