1 / 10

High Performance Computing Challenges and Trends

Explore the increasing need for competitive HPC systems in various fields such as scientific computing, data mining, video processing, and molecular biology. Discover key factors affecting HPC systems, observations on parallel computing evolution, alternative trends, and outstanding achievements in the field. Delve into advanced computing technologies like the K Computer and the Sequoia System while considering factors like sustained performance, energy consumption, and system design. Learn about programming models, algorithmic paradigms, and parallel programming techniques crucial for high-performance computing systems.

hiltz
Download Presentation

High Performance Computing Challenges and Trends

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. High Performance Computing Challenges and Trends Claude TADONKI Mines ParisTech – LAL / CNRS / INP2P3 University of Oujda (Morocco) – October 7, 2011

  2. The need of competitive HPC systems Increasing Need of HPC (range of applications and computing power) Large-scale scientific & technical computing (numerical and non numerical) Large-scale data mining and statistics in experimental physics Image and signal processing Video and 3D animations Gaming High Performance Computing: Challenges and Trends Claude TADONKI Molecular biology and structural genomic Sorting and pattern matching Meteorology, Atmospheric studies, Medical research Scientific and technical simulation High-standard industrial activities, services, and research investigations And more … Key Factors Massively parrallel computers & systems Dedicated architectures Specialized processors Processor frequency High level integration Memory space, latency, and bandwidth High speed interconnection Advances in parallel algorithm synthesis and programming language features Powerful compilers University of Oujda (Morocco) – October 7, 2011

  3. Observations Parallel computing easily justifies nowadays (processor frequency evolution) • Frequency has been multiplied by 10 since 1993 • The number of transistors in Intel proc has been multiplied by … 100 000 since 1971 • Core voltage has been reduced by 10 (1,2V , the min is 0,7V) High Performance Computing: Challenges and Trends Claude TADONKI However, this evolution is closed to its asymptotic threshold !!! HPC interest covers a larger spectra of applications, hence a wider audience Performance expectations in some specific areas are beyond the capacity of standard computers Alternatives and trends Smallpox Research Grid (Oxford University/IBM/United Devices) Oustanding achievment in large-scale molecular analysis. Multi-core processors TLP-based parallel machines GPU (assume a skillful use!) Hardcoded (embedded) solutions Reconfigurable HPC Grid/Meta Computing University of Oujda (Morocco) – October 7, 2011

  4. The K Computer RIKEN / Fujitsu ( JAPAN ) Number one the 37th TOP500 8.162 petaflops (Linpack) 93% 68,544 energy-efficient CPUs High Performance Computing: Challenges and Trends Claude TADONKI 672 computer racks Complete deployment in 2012 10 petaflops expected (2012) 800 computer racks (2012) Worldwide shared use http://www.fujitsu.com/global/news/pr/archives/month/2011/20110620-02.html University of Oujda (Morocco) – October 7, 2011

  5. The Sequoia System LLNL / IBM ( USA ) BlueGene technology 500 teraFLOPS 1.6 million of cores High Performance Computing: Challenges and Trends Claude TADONKI 96 computer racks 98,304 compute nodes https://asc.llnl.gov/computing_resources/sequoia/ 1.6 petabytes of memory 10 times faster than today’s Most powerful system Sequoia in 1 hour = 6.7 billion people calculating 24h/24h during 320 years University of Oujda (Morocco) – October 7, 2011

  6. About sustained performance Even an optimal algorithm will run at a fraction of the peak performance !!! High Performance Computing: Challenges and Trends Claude TADONKI Before we calculate, we need data Time-to-CPU could be long % flops Memory space decreases with level Shared use of memory slowdown Synchronization and data exchange Control flow (if, while, for, case, …) University of Oujda (Morocco) – October 7, 2011

  7. vital on embedded systems Important considerations significant heat and cause of failure Energy consumption and dissipation Integration ( more powerful unit/system in a smaller chip/surface ) Total cost of the system and maintenance issues High Performance Computing: Challenges and Trends Claude TADONKI Programmability (consider the case of the IBM CELL) Computing nodes interconnection (topology and speed) Accessibility (remote and shared use among several entities) Software and tools (system, programming, monitoring, profiling, …) Lifetime and evolution of the system (extensibility, devices change/upgrade, …) University of Oujda (Morocco) – October 7, 2011

  8. Fundamental aspects Design of efficient parallel algorithms (modelling & scheduling) Complexity & Performance analysis High Performance Computing: Challenges and Trends Claude TADONKI Algorithmic and programming paradigms Code generation and transformations (automatic parallelization) Compilation techniques University of Oujda (Morocco) – October 7, 2011

  9. Programming models Distributed memory parallel programming (MPI) Shared memory parallel programming (OpenMP, Pthreads) High Performance Computing: Challenges and Trends Claude TADONKI Accelerator-based programming (GPU, FPGA, CELL, …) Vector programming (SSE, VMX, SPU intrinsics, …) Hybrid programming (MPI+OpenMP/Pthread, CPU+GPU, PPU+SPU, …) University of Oujda (Morocco) – October 7, 2011

  10. High Performance Computing: Challenges and Trends Claude TADONKI University of Oujda (Morocco) – October 7, 2011

More Related