1 / 42

C-DAC’s HPC Programme

C-DAC’s HPC Programme. Vinodh Kumar Markapuram Centre for Development of Advanced Computing Pune, India www.cdac.in. ATIP 1 st Workshop on HPC in India @ SC-09. Contents. About C-DAC HPC in C-DAC PARAM over the Years C-DAC’s HPC Programme Technology Development System Area Networks

benito
Download Presentation

C-DAC’s HPC Programme

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. C-DAC’s HPC Programme Vinodh Kumar Markapuram Centre for Development of Advanced ComputingPune, India www.cdac.in Workshop on HPC in India ATIP 1st Workshop on HPC in India @ SC-09

  2. Contents • About C-DAC • HPC in C-DAC • PARAM over the Years • C-DAC’s HPC Programme • Technology Development • System Area Networks • Reconfigurable Computing Technologies • System Software • Benchmarking and Testing • Applications and Solutions • HPC Applications • HPC Solutions & Services • Education & Training ATIP 1st Workshop on HPC in India @ SC-09

  3. About C-DAC • Established under MCIT, Government of India • ~ 20 years old • Government funded, but autonomous • 10 centers across India • C-DAC is in several areas in computing: • Language Technology & Applied AI • Training • e-Governance • Embedded Technologies, Power Electronics • HPC • ~ 1500 employees, ~ 150 in HPC & Grid Computing ATIP 1st Workshop on HPC in India @ SC-09

  4. HPC in C-DAC • Distributed activities across Pune and Bangalore centers • PARAM series of parallel supercomputers • PARAMnet • RCS • Applications Development Group involved in developing, porting apps to PARAM • Over 60 installations of PARAM in India and abroad ATIP 1st Workshop on HPC in India @ SC-09

  5. PARAM over the years Peak Perf. 50 TF PARAM Yuva(54 TF ClusterPARAMnet-3) 1 TF PARAM Padma(2 TF ClusterPARAMnet-II) 100 GF PARAM 10000(100 GF ClusterPARAMnet-I) 10 GF PARAM 9000 (2 GF MPP) 1 GF PARAM 8000 (100 MF MPP) 1991 1995 1998 2002 2008 ATIP 1st Workshop on HPC in India @ SC-09

  6. C-DAC’s HPC Programme • Technology Development • Applications and Solutions ATIP 1st Workshop on HPC in India @ SC-09

  7. Technology Development • System Area Network Technologies • Reconfigurable Computing Technologies • System Software • Benchmarking & Testing ATIP 1st Workshop on HPC in India @ SC-09

  8. SAN Technologies • Starting from PARAMNet-I (400 Mbps) to to PARAMNet-3 (10 Gbps) and beyond • Communication Co-processor (CCP) Generations • Offload host communication to intelligent hardware • Use Industry Standard Interfaces to allow for message passing (e.g. MPI) and Legacy (e.g. TCP/IP) support • Packet Switching Hardware • N-port switching hardware designs to augment CCP based NICs • Design of large crossbar hardware and packet routing engine • Communication software stack ATIP 1st Workshop on HPC in India @ SC-09

  9. Reconfigurable Computing • C-DAC has spearheaded RC in India • Accelerated Solutions for • Bioinformatics • Radio Astronomy • Fracture mechanics • Scientific & engineering routines • Crypto analysis And Many More… • Design & Development of • RC HW, HW Libraries (Avatars) • System Software & Drivers (Linux, Windows) 10X-200X … Acceleration Since 2000 ATIP 1st Workshop on HPC in India @ SC-09

  10. RC in PARAM-Yuva • Application: Smith-Waterman Sequence Search 49 hrs32.5 min 1 RC card comparable to 87 cores Time- 34 min 16 RC 16 Cores 16 Machines: HP DL580G5 Quad core Quad socket Xeon 2.93 GHz ATIP 1st Workshop on HPC in India @ SC-09

  11. RC Performance • RC for Accelerating Sequence search Bioinformatics Sequence search taking 528 days using pure software solution was completed in just 12 daysby C-DAC’s RC ! [what one of our customer has to say…] “C-DAC’s Reconfigurable Hardware Accelerator has helped us to achieve high scalability and reliability in our Microarray probe, Primer design business... Thanks C-DAC for being a great partner in our endeavour to become world number one in genomic outsourcing.” Anuradha Acharya CEO ATIP 1st Workshop on HPC in India @ SC-09

  12. C-DAC’s RC: Road Ahead • RC for Accelerating Multidisciplinary applications • Accelerated solutions for computationally challenging and emerging Applications through Industrial/research contacts and co-operations • Exploration of building RC, using hybrid components • Possible Areas of Collaboration • Hardware Library development • Algorithmic level • Application level • System software • Framework for Rapid development of RC enabled Applications (a user centric approach) ATIP 1st Workshop on HPC in India @ SC-09

  13. Important Publications • [1] Sajish C, Yogindra Abhyankar, Shailesh Ghotgalker and K. A. VenkateshFloating point Matrix multiplication on a Reconfigurable Computing System, Proceedings of the High Performance Computing and Application (HPCA 2004), August 2004, China. • [2] Yogindra Abhyankar, Sajish C, Shailesh Ghotgalker, Yogesh Agarwal and Pallavi KulkarniReconfigurable Computing System Initiatives at Centre for Development of Advanced Computing, Proceedings of the International conference on Reconfigurable Computing and FPGAs (Reconfig04), September 2004, Colima, Mexico. • [3] Yogesh Agarwal, Yogindra Abhyankar, Shailesh Ghotgalker, M.S. Shah, A.P. Kumbhar and B. DattaguruSolving Fracture Mechanics Problems Using Reconfigurable Computing, Proceedings of the International conference on Reconfigurable Computing and FPGAs (Reconfig04), September 2004, Colima, Mexico. • [4] Yogindra Abhyankar, Sajish C, Pallavi Kulkarni and C.R. SubrahmanyaDesign of a FPGA Based Data Acquisition System for Radio Astronomy Applications, Proceedings of the 16th IEEE International conference on Microelectronics (ICM 2004), December 2004, Tunis, Tunisia. • [5] A.P. Kumbhar, M.S. Shah,Yogindra Abhyankar, Sajish C, Vikas Bharadwaj, B. Yogesh Agarwal, Shailesh Ghotgalker DattaguruFracture Analysis Using Reconfigurable Computing, 8th Int. Conf. on High-Performance Computing in Asia-Pacific Region (HPC Asia 2005), Beijing, China. • [6] Yogindra Abhyankar, Sajish C, Yogesh Agarwal, C.R. Subrahmanya and Peeyush PrasadHigh Performance Power Spectrum Analysis Using a FPGA based Reconfigurable Computing Platform, Proceedings of the International conference on Reconfigurable Computing and FPGAs (ReConFig06), September 2006, San Luis Potosi, Mexico. ATIP 1st Workshop on HPC in India @ SC-09

  14. HPC System Software ATIP 1st Workshop on HPC in India @ SC-09

  15. HPC System Software • System software (device driver, kernel modules, specialized libraries, program development environments etc.) for HPC Interconnects and Reconfigurable Systems • Light weight protocols based on VIA/ uDAPL • Parallel File Systems • Grid File Systems for HPC applications • Performance engineering • System Software development on Linux, AIX, Windows and Solaris ATIP 1st Workshop on HPC in India @ SC-09

  16. HPC - Testing Methodologies, Benchmarks • Design Develop, Execute Test plan for large scale C-DAC HPC & Grid Computing Infrastructure” • Developed test suites can be downloaded from C-DAC web-site • Conduct technology training programme(s) on emerging areas of parallel processing technologies • Technology training programme(s) in the form of national level technology workshops can be downloaded from C-DAC web site ATIP 1st Workshop on HPC in India @ SC-09

  17. PARAM family of Scalable Hybrid Adaptive Clusters Client Client Client Client • Multi node Hybrid Adaptive Cluster • Efficient Mapping of Algorithms on suitable Architectures; Fast Access to large data sets • Economics – Easy Migration & Adoption LAN Mixed Hardware & Software GPU Accelerators SAN Fabric Multi Cores Intel /AMD FPGA Ex : HDF (Hierarchical Data Format) IBM Cell BroadBand Engine Storage HPC Tools and Programming Environments (NVIDIA CUDA, Intel TBB, FPGA, IBM CBE OpenCL, AMD-FireStream) In Memory DataBases (Ex. BerKeley DB)) Programming Environment - Compilers, Debugging, New Programming Paraidgms ATIP 1st Workshop on HPC in India @ SC-09

  18. GITeMS v1.0 Synthetic Test Suites and Secure Prog. Environment; Complete Application Based Test Suites or Data Intensive Benchmarks Level 5 Part-III Portal Features: Information Services; Job Management Features; Security Services Part-II Level 4 Part-I Level 3 Grid Probes; Grid Middleware Overhead Measurement Suites – Stability Aspects Part-I Enabling Applications for Grid Computing using Globus Toolkit Level 2 Level 1 Globus Services & Grid Integration on Prog. Env. Part-I Representation of test suites (Level, 1, Level 2,Level 3, Level 4, Level 5 ) ATIP 1st Workshop on HPC in India @ SC-09

  19. Test Suites & Open-source S/W • GITeMS v1.0: GARUDA Integrated Testing Methodology-Suites • SPAGMOS v1.0: Software on Probes for Assessment of Grid Middleware Overheads • INPEAG-v1.0: INtegrated Perl Script to Enable Applications for Grid computing with Globus) • GEAGUL-C v1.0: Grid Software-Enabling Applications for Grid Computing Using GLobus and C-Language • GOPAEAG-v1.0: Globus and Object Oriented Programming Approach to Enable Applications for Grid Computing. • JAGEAG-v1.0: JAva CoG Kit and Globus to Enable Applications for Grid Computing • PerlCEAG-v1.0: Perl CoG Kit to Enable Applications for Grid Computing • PyCEAG-v1.0: PythonCoG Kit to Enable Applications for Grid Computing ATIP 1st Workshop on HPC in India @ SC-09

  20. Scope for Collaborations • Hybrid Computing • Affordable – Multiple NIC Cards & Multiple GPU Cards Software • Mixed Programming - Local / Remote GPU/ FPGA/ Multi-core / Cell CBE • Storage HDF /Berkeley Data Bases/Virtualisation/Memory Allocators for large scale computations • Technology Workshops • C-DAC’s Technology Training & Workshops – GRIPSI-2007, ProMCore 2008, PEEP-2008, OPECG-2009 (Multi-Core Programming; GPU Computing; Hybrid Computing, Grid Computing) • Grid Computing Testing – Using Globus 4.X Technologies • Integration of C-DAC’s Grid Computing test Suites with Globus 4.X Technologies ATIP 1st Workshop on HPC in India @ SC-09

  21. Applications and Solutions • HPC Applications • HPC Solutions & Services • Education & Training ATIP 1st Workshop on HPC in India @ SC-09

  22. Applications at a Glance ATIP 1st Workshop on HPC in India @ SC-09

  23. Applications at a Glance ATIP 1st Workshop on HPC in India @ SC-09

  24. Computational Structural Mechanics • Core areas of Work • Earthquake Engineering • Composite Materials • Smart materials • Recent Projects • Optimization of Laminated Fiber Reinforced Composites (FEMCOMP) • Computer Aided Seismic Analysis & Design of Concrete Structures • Non-linear Earthquake Analysis of R/C Framed Buildings • Integrated Composites Structural Analysis (INTCOMP) ATIP 1st Workshop on HPC in India @ SC-09

  25. CSM Road Map • Smart Structures - Project with IIT-Guwahati • Optimum Design and Active Vibration Control of Smart FRP Structures on Parallel Platform , Sanctioned by DST. • Earthquake Engineering - Projects with SGSITS, Indore • Computer Aided Seismic Analysis And Design Of Concrete Structures: Integrating all the Static and Dynamic analysis code • Parallelization of IDARC code for Nonlinear analysis and Benchmarking the simulations. • Feasibility of project on Vulnerability assessment of Existing Stock of R/C Structures under Earthquake hazards • OpenSees • Grid and TF Applications and usage • INTCOMP – Project on FRP Composites • Free Vibration and Bucklinh analysis modules are planned to be incorporated in next version ATIP 1st Workshop on HPC in India @ SC-09

  26. Seismic Data Processing • Recent Projects • Seismic Full Waveform Elastic Inversion. • Seismic Traveltime Tomographic Inversion. • Pre-Stack Migration and Velocity Analysis. • Parallel Seismic Migration and Modeling Algorithm. • Earthquake Research Grid in India. • 35 Publications in National and International Conference and Journals. • Department of Science and Technology, Gov. India award for best project in 1998. ATIP 1st Workshop on HPC in India @ SC-09

  27. Seismic Data Processing • Future Plans • To develop a parallel GA Engine for Seismic Inversion problems. • To develop GUI's for all the developed applications. • To attempt Ant Colony Optimization for Seismic optimizations problems. • To develop 2D Seismic Inversion using Elastic Modeling. ATIP 1st Workshop on HPC in India @ SC-09

  28. Seismic Data Publications • Multiple realisation of real-coded genetic algorithm: A tool for 2D traveltime tomographic inversion(SEG,2009)‏ • Seismic Full Waveform Inversion and Modeling(SPG , 2008) • Imaging subsurface geology with seismic migration on a computing cluster(Current Science,2005) • Earthquake Engineering grid in India – A concept(IGU,2004)‏ • AVA inversion using real-coded genetic algorithm(EAGE,2004)‏ • Seismic Transmission and Electrical Resistivity Tomography for the delineation of mine galleries in the Raniganj Coalfield India(First Break,2004)   • Seismic Numerical Modeling On PARAM Padma(SPG,2004)‏ • Aperture width selection criterion in Kirchhoff Migration (AEG,2000) • On improving performance of migration algorithms using MPI and MPI-IO(SEG,2000)‏ • Marine Synthetic Seismograms using Elastics Wave Equation(SEG,2000) • Efficient Parallel I/O for Seismic Imaging in a Distributed Computing Environment(SPG,2000) • A PVM implementation of 2D acoustic wave modelling on PARAM 10000(International Journal of Applied Science and Computations,1999) • Implementation of wave equation based Imaging Techniques on PARAM 10000(IGU,1999) ATIP 1st Workshop on HPC in India @ SC-09

  29. Seismic Data Processing • Potential US Collaborations: • Mrinal Sen, Department of Geophysics, University of Texas, Austin • Subhashish Mallick, University of Wyoming. • Chris Liner, Colorado School of Mines ATIP 1st Workshop on HPC in India @ SC-09

  30. Computational Fluid Dynamics • Major Recent Projects: • Flow over a wind turbine airfoil and blade • Three Dimensional Flow in a single passage of Transonic Compressor Rotor • Conjugate heat transfer of compressor disc cavity of an aero engine • Performance optimization and control of emissions in IC engine • Performance Improvement of Shell & Tube Heat Exchanger • Development of a CFD model for cooling of eggs under forced convective conditions and experimental validation of CFD model ATIP 1st Workshop on HPC in India @ SC-09

  31. Computational Fluid Dynamics • Notable Achievements: • Published research papers in International Journals (10) • Presented research papers in National and International Conferences (20) • Conducted training and workshop on Computational Fluid Dynamics (5) ATIP 1st Workshop on HPC in India @ SC-09

  32. Computational Fluid Dynamics • “Recent Advances in HPC for Computational Fluid Dynamics”, Indo-Australian CFD Workshop, IIT Roorkee, April 12 – 14, 2007. • “Numerical Modeling for Air Pollutant Dispersion”, National Workshop on Modeling on Fluids- Macro to Nano Scale- IIT, Kharagpur, September 20-21, 2007. • “Fluid Flow Simulation using PARAM systems”, Seventh Asian CFD Conference (ACFD7), NAL, Bangalore, November 26 – 30, 2007. • Conjugate Heat Transfer Analysis of an Egg, COMSOL user conference, Boston, USA, 2007 • Simulation Studies of Shell & Tube Heat Exchanger with Helical Baffle, International Journal of Heat Exchangers, 2008 ATIP 1st Workshop on HPC in India @ SC-09

  33. Computational Fluid Dynamics • Future Plans • Solution of internal and external fluid flow/conjugate heat transfer problems, e.g., I.C. Engine, HVAC (Heating, ventilation, and air conditioning) • Simulation of the 3-D Flow in Multiple passages of a Transonic Compressor Rotor ATIP 1st Workshop on HPC in India @ SC-09

  34. Computational Atmospheric Sciences • Real time weather forecast • Short range weather forecast modeling using mesoscale models e.g WRF model. • Monsoon Modeling • Long range monsoon modeling using high resolution T170 modelDevelopment of regional coupled atmosphere-ocean modeling using WRF-ROMS. • Aerosol Modeling • Radiative forcing studies using Indian emissions in climate modelsDevelopment of Atmosphere-chemical transport modeling system - WRF-STEM. • Urban air quality modeling • Urban air quality modeling for Pune City using WRF-AERMOD coupled system • Air quality models inter comparison AERMOD, CALPUFF, ISC3 • Urban air quality modeling of Indian cities using WRF-CMAQ system • Development of offline WRF-Chem model system. ATIP 1st Workshop on HPC in India @ SC-09

  35. Computational Atmospheric Sciences • Collaborations • University of California, Riverside, USA. • NOAA/FSL , Colorado, USA. • University of Iowa, USA. • University of Lille, France . • Future Plans • Decision Support System for Urban Air quality Management. • Coupled regional atmosphere-ocean modeling for climate change studies. • Computational performance analysis of Atmosphere and Ocean systems. • Grid based ensemble modeling using mesoscale models. ATIP 1st Workshop on HPC in India @ SC-09

  36. Evolutionary Computing & Materials Modeling • Protein Structure Prediction • Sequential, data parallel, island and distributed genetic algorithms have been implemented on HPC systems. • Engineering Optimisation problems • IC Engine performance optimisation using micro genetic algorithms • Seismic inversion using island genetic algorithms • FRP structure optimisation using sequential and parallel genetic algorithms • Accelerated optimisation using Taguchi's method in conjunction with genetic algorithms, gene expression programming • Materials simulations • Cadmium selenide and zinc selenide clusters, their ground state and optical properties. • Wang-Landau Algorithm to simulate liquid crystals on HPC systems. • INDMOL - A suite of codes to study ab initio electronic structure of molecules using Hatree Fock and Moeller Plesset methods • INDPROP - A suite of codes to calculate the properties of the molecules based on the electronic structure • MTA - Molecular tailoring approach to optimise geometry of the molecules for handling large molecules using parallel approach ATIP 1st Workshop on HPC in India @ SC-09

  37. Evolutionary Computing & Materials Modeling • Large scale nano cluster simulations of ZnSe • Multi-scale materials modeling • Multiple instance learning • Content based image retrieval ATIP 1st Workshop on HPC in India @ SC-09

  38. Services/ Solutions in HPC • Data Center Consultancy • Integration Services • Enterprise application services • Operations and Research support services • Grid deployment & management services • Enterprise application services ATIP 1st Workshop on HPC in India @ SC-09

  39. A Partial List of Our Clients • CTSF, Government of India, India • NCMRWF, New Delhi, India • NCL, Pune, India • ONGC, India • NIO, Goa • TIFR, India • IITM, Pune India • PRL, Ahmedabad, India • IUCAA, Pune, India • Bharathidasan University, Trichy, India • NML, Jamshedpur, India • CCSHAU, HISAR, India • PARAM provided to all IITs in India ATIP 1st Workshop on HPC in India @ SC-09

  40. Foreign Collaborations • Government of Ghana, Ghana • Russian Indian Centre For Advanced Computing Research (RICCR) • Center for Excellence in ICT, Govt. of Myanmar • Center for Excellence in ICT, Govt. of Vietnam • Center for Excellence in ICT, Govt. of Tanzania • Center for Excellence in ICT, Govt. of Armenia • Center for Excellence in ICT, Govt. of Belarus ATIP 1st Workshop on HPC in India @ SC-09

  41. Education & Training • C-DAC Advanced Computing Training School • Short term programmes in computing technology. • Workshops in specialized areas in computing ATIP 1st Workshop on HPC in India @ SC-09

  42. Thank You! www.cdac.in ATIP 1st Workshop on HPC in India @ SC-09

More Related