1 / 12

Parallel Architectures Based on Parallel Computing , M. J. Quinn

Parallel Architectures Based on Parallel Computing , M. J. Quinn. CIS 5930-04 – Spring 2006: Parallel Computing. Ashok Srinivasan www.cs.fsu.edu/~asriniva Florida State University. Outline. Interconnection Networks Mesh Binary Tree Hypercube Architectures Processor Arrays

aleda
Download Presentation

Parallel Architectures Based on Parallel Computing , M. J. Quinn

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Parallel ArchitecturesBased on Parallel Computing, M. J. Quinn CIS 5930-04 – Spring 2006: Parallel Computing Ashok Srinivasan www.cs.fsu.edu/~asriniva Florida State University

  2. Outline • Interconnection Networks • Mesh • Binary Tree • Hypercube • Architectures • Processor Arrays • Multiprocessors • Centralized Multiprocessors • Distributed Multiprocessors • Multicomputers • Flynn’s Taxonomy • SISD • SIMD • MIMD

  3. Mesh • 2-D Mesh • N = d2 • Diameter = 2 N0.5 • Bisection width = N0.5 • Edges/node = 4 • 2-D Mesh with wraparound (2-D torus) • 3-D Mesh • 3-D torus

  4. Binary Tree • Binary Tree • Diameter = 2 log N • Bisection width = 1 • Edges/node = 3 • Fat Tree • Double the number of edges at each level up the tree

  5. Hypercube • Hypercube • N = 2d • Diameter = log N • Bisection width = N/2 • Edges/node = log N

  6. Processor Arrays

  7. Centralized Multiprocessors • Also called SMP/UMA

  8. Cache Coherence Problem • Solve through snooping

  9. Distributed Multiprocessors • Also called NUMA

  10. Cache Coherence - Directory Based Solution

  11. Multicomputers • Also called a distributed memory system

  12. Flynn’s Taxonomy • SISD • Single Instruction, Single Data • Traditional computer • SIMD • Single Instruction, Multiple Data • MIMD • Multiple Instruction, Multiple Data

More Related