1 / 17

Parallel Computer Architecture: Essentials for Both Computer Scientists and Engineers

Parallel Computer Architecture: Essentials for Both Computer Scientists and Engineers Edward F. Gehringer †* Yan Solihin* † Dept. of Computer Science * Department of Electrical & Computer Engineering North Carolina State University. Why parallel computer architecture? The students

denise-carson
Download Presentation

Parallel Computer Architecture: Essentials for Both Computer Scientists and Engineers

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Parallel Computer Architecture: Essentials for Both Computer Scientists and Engineers Edward F. Gehringer†* Yan Solihin* †Dept. of Computer Science *Department of Electrical & Computer Engineering North Carolina State University http://courses.ncsu.educsc506/lec/001

  2. Why parallel computer architecture? The students Course organization Example animations Conclusion Outline http://courses.ncsu.edu/csc506/lec/001

  3. Computer architecture courses • Most popular—processor architecture • For both CE & CS • Most relevant—parallel architecture • Esp. for CS http://courses.ncxu.edu/csc506/lec/001

  4. Our course and curriculum ECE 463, Adv. Micro- processor Design CSC/ECE 506: Arch. of Parallel Computers ECE 521, Computer Design & Technology CSC 706: Adv. Parallel Computer Architecture ECE 721, Advanced Computer Architecture ECE 743, High Perf. Computer Architecture http://courses.ncxu.edu/csc506/lec/001

  5. The textbook http://courses.ncxu.edu/csc506/lec/001

  6. Why parallel computer architecture? The students Course organization Example animations Conclusion Outline http://courses.ncsu.edu/csc506/lec/001

  7. The students • Majority are masters, but … • Both masters programs are large • Core course for CE students • Core course for CS students http://courses.ncxu.edu/csc506/lec/001

  8. Why parallel computer architecture? The students Course organization Example animations Conclusion Outline http://courses.ncsu.edu/csc506/lec/001

  9. Syllabus • Concurrency • Bus-based multiprocessors • Memory consistency • Distributed multiprocessors • Interconnection networks 11 classes 6 classes 2 classes 4 classes 3 classes http://courses.ncxu.edu/csc506/lec/001

  10. Concurrency • Taxonomy of parallel processors • Nodes • Interconnect • Models of parallel computation • Shared memory • Message-passing • Data parallel • Parallelization constructs • DOALL DOACROSS DOPIPE • Function parallelism • Data-parallel programming • SCAN REDUCE • Parallelizing linked data structures http://courses.ncxu.edu/csc506/lec/001

  11. Bus-Based Multiprocessors • The need for synchronization • Invalidation coherence protocols • Update coherence protocols • Performance aspects http://courses.ncxu.edu/csc506/lec/001

  12. Memory Consistency • Contrast with cache coherence • Sequential consistency • Improving performance • Prefetching • Speculation • Relaxed consistency models • Processor consistency • Weak ordering • Release consistency http://courses.ncxu.edu/csc506/lec/001

  13. Distributed multiprocessors • Scalable multiprocessors • Coherence without a shared bus • Directory organization • Directory-based coherence protocols • Full bit vector • SCI (Scalable Coherent Interface) • Case study: Origin 2000 http://courses.ncxu.edu/csc506/lec/001

  14. Interconnection networks • Topologies • Ring • Mesh • Hypercube • Fat tree • Routing • E-cube • Turn model • Adaptive http://courses.ncxu.edu/csc506/lec/001

  15. Why parallel computer architecture? The students Course organization Example animations Conclusion Outline http://courses.ncsu.edu/csc506/lec/001

  16. Why parallel computer architecture? The students Course organization Example animations Conclusion Outline http://courses.ncsu.edu/csc506/lec/001

  17. Conclusion • Important concept: • Parallel programming • Parallel architecture affect each other • Need to know this to … • Write efficient programs • Design an efficient architecture • This course covers “nuts and bolts” • We’d love to share … http://courses.ncxu.edu/csc506/lec/001

More Related