310 likes | 1.26k Views
Parallel Processing. Group Members : PJ Kulick Jon Robb Brian Tobin. Topics. Theory of parallel computers SUPERCOMPUTERS Distributed Computing. What is parallelism???. Parallelism is the process of performing tasks concurrently. Real life examples: Definition.
E N D
Parallel Processing Group Members: PJ Kulick Jon Robb Brian Tobin
Topics • Theory of parallel computers • SUPERCOMPUTERS • Distributed Computing
What is parallelism??? • Parallelism is the process of performing tasks concurrently. • Real life examples: • Definition • A pack of wolves hunting its prey. • An orchestra.
Vector processor Array processor Shared memory Distributed memory Clusters Symmetric multiprocessor (SMP) Nonuniform memory access (NUMA) Flynn’s Hardware Taxonomy Processor Organizations Single instruction, single data (SISD) stream Single instruction, multiple data (SIMD) stream Multiple instruction, single data (MISD) stream Multiple instruction, multiple data (MIMD) stream Uniprocessor
Taxonomy of parallel computing paradigms Parallel Computer Synchronous Asynchronous Vector/Array MIMD SIMD Systolic
Vector 1-dimensional Single-stage MIMD 2-dimensional Multi-stage Hypercube Cross-bar Interconnection Networks(IN) IN topology Distributed Memory Shared Memory Static Dynamic
Distributed Memory – Static Networks Linear array (1-d) 2-dimensional networks ring tree mesh star
Distributed Memory – Static Networks (cont’d) Fully connected network
Distributed Memory Dynamic configurations multi-stage single-stage cross-bar
Deep Blue • First computer to defeat a world chess champion • 32-node IBM Power Parallel SP2 • 6-move look ahead capability
SP2 Architecture • “The IBM SP2 is a general-purpose scalable parallel system based on a distributed memory message passing architecture.” • 2 to 128 nodes • POWER2 technology RISC System/6000 processor
Super Computers – “Real World” • RISC System technology • Running a high-volume scalable WWW server • Forecasting the weather • Designing cars • Compaq AlphaServer technology • Human Genome Project
Sun Systems MAJC Chip
MAJC • Implements parallel processing on one chip • Can operate in standalone or with up to several hundred others in parallel • First version contains two separate processors • As time goes many more will be included on one chip
Four function units per processor Each function unit contains local registers Global registers can be accessed by all FU’s Operates as SIMD Multiple function units allow multiple instructions to be done simultaneously Each function unit can act as RISC/DSP processor itself Features
SGI Onyx 3000
Developed for visualization and supercomputing Modular design allows for scalability ease Snap together approach Growth in multiple dimensions NUMAFlex architecture Designed for different generations to work together Onyx 3000 Series
Applications of Onyx 3000 • High speed processing • Real time graphic to video • High-definition editing • Integral support for virtual reality, real-time six degrees of freedom (6DOF) interaction, and sensory immersion
Real World Example The Cave(Iowa State University) • Recreation of Forbidden City • John Dear Factory • Molecular Structuring
References • http://www.sun.com • http://www.sgi.com • http://www.ibm.com • http://www.vrac.iastate.edu • Stallings, Williams. Computer Organization and Architecture,5th Edition.Upper Saddle River, New Jersey: Prentice Hall 2000 • Lewis, Ted G. Introduction to Parallel Computing. Englewood Cliffs, New Jersey: Prentice Hall 1992 • Kumar, Vippin. Introduction to Parallel Computing. Redwood City,California: The Benjamin/Cummings Publishing Company 1994 • Moldovan,Dan I. Parallel Processing: From Applications to Systems. San Mateo, California: Morgan Kaufmann 1993