1 / 24

Chapter 2 Computer Clusters

Chapter 2 Computer Clusters. Lecture 2.1 Overview. Outline. Cluster definition and significance Cluster development trend Cluster family classification Analysis of the Top 500 Supercomputers. Definition and Significance. Definition

corbin
Download Presentation

Chapter 2 Computer Clusters

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Chapter 2 Computer Clusters Lecture 2.1 Overview

  2. Outline • Cluster definition and significance • Cluster development trend • Cluster family classification • Analysis of the Top 500 Supercomputers

  3. Definition and Significance • Definition • A Collection of interconnected stand-alone computer which can work together collectively and cooperatively as a single integrated computer resource pool • Clustering explores massive parallelism at the job level and achieves high availability though stand-alone operations

  4. Significance • Of the top 500 supercomputers reported in 2010, 85% were computer clusters or MPPs built with homogeneous nodes. • Computer clusters have laid the foundation for today’s supercomputers, computational grids and Internet clouds build over data centers

  5. Cluster Development Trends • Computer clustering started with the linking of large mainframe computers such as the IBM Sysplex and the SCI Origin 3000. • Subsequently, the clustering trend moved toward the networking of many minicomputers, such as Dec’s VMS cluster. • In the early 1990s, the next move was to build UNIX-based workstation clusters represented by the Berkeley NOW (network of workstations) and IBM SP2 AIX-based server cluster • Beyond 2000, we see the trend moving to the clustering x86 PC engines.

  6. Milestone Cluster Systems • Clustering has been a hot research challenge in computer architecture. • Fast communication, • job scheduling, • SSI • HA • The following tables lists some milestone cluster research projects and commercial cluster products, each of which has contributed some unique features.

  7. Cluster Family Classification • Based on application demand, computer clusters are divided into three classes: • Computer Clusters • High-Availability Clusters • Load-balancing Clusters

  8. Compute Clusters • These are clusters designed mainly for collective computation over a single large job, such as large scale simulation and modeling. • The cluster typically shares a dedicated network, and the nodes are mostly homogeneous and tightly coupled. • This type of clusters is also known as a Beowulf cluster. • Beowulf cluster typically runs Linux, or other Unix-like operating systems such as BSD, and contain shared libraries. Such as Message-Passing Interface (MPI), the Beowulf cluster behaves more like a single (super)computer.

  9. High-Availability clusters HA • (high-availability) clusters are designed to be fault-tolerant and achieve HA of services. • HA clusters operate with many redundant nodes to sustain faults or failures. They are designed to avoid all single points of failure. • Many commercial HA clusters are available for various operating systems.

  10. Load-balancing clusters • For this type of clusters, requests initiated from the user are distributed to all node computers, which results in a balanced workload among different machines. • Middleware is needed to achieve dynamic load balancing by job or process migration among all the cluster nodes.

  11. Analysis of the Top 500 Supercomputers • Every six months, the world’s Top 500 supercomputers are evaluated by running the Linpack Benchmark program over very large data sets. The ranking varies from year to year, similar to a competition. • We will analyze the trend of top 500 supercomputers over time from the following perspectives: • Architectural Evolution • Speed Improvement over time • Operating System Trends

  12. Architectural Evolution

  13. Speed Improvement Over Time

  14. Operating System Trends in the Top 500 • The five most popular operating systems have more than a 10 percent share among the Top 500 Computers in November 2010. • 410 supercomputers are using Linux with a total processor count exceeding 4.5 million. This constitutes 82 percent of the systems adopting Linux. • The IBM AIX/OS is in second place with 17 systems (a 3.4 percent share) and more than 94,288 processors. • Third place is represented by the combined use of the SLES10 with the SGI ProPack5, with 15 systems (3 percent) over 135,200 processors. • Fourth place goes to the CNK/SLES9 used by 14 systems (2.8 percent) over 1.13 million processors. • Finally, the CNL/OS was used in 10 systems (2 percent) over 178,577 processors. • The remaining 34 systems applied 13 other operating systems with a total share of only 6.8 percent.

  15. The Top Five Systems in 2010

  16. Image from www.nscc-tj.gov.cn/

  17. Image from http://en.wikipedia.org/wiki/File:Jaguar_Petascale_Supercomputer.jpg

  18. Image from aibob.blogspot.com

  19. Image from http://en.akihabaranews.com/51762/desktop/japans-first-petaflop-supercomputer-tsubame-2-0-to-be-launched-this-autumn

  20. Top-10 2012

More Related