170 likes | 282 Views
Parallel and Distributed Processing CSE 8380. January 20 2005 Session 3. Contents. OS Review (Cont.) Four Decades of Computing Flynn’s Taxonomy SIMD & MIMD Organization Interconnection Networks. Code. Data. Stack. OS – Review (cont.). Process. Code. Private Data. Shared Data.
E N D
Parallel and Distributed ProcessingCSE 8380 January 20 2005 Session 3
Contents • OS Review (Cont.) • Four Decades of Computing • Flynn’s Taxonomy • SIMD & MIMD Organization • Interconnection Networks
Code Data Stack OS – Review (cont.) Process
Code Private Data Shared Data Private Stack Parallel Process
Feature Batch Time-Sharing Desktop Network Decade 1960s 1970s 1980s 1990s Location Computer Room Terminal Room Desktop Mobile Users Experts Specialists Individuals Groups Data Alphanumeric Text, numbers Font,Graphs Multimedia Objective Calculate Access Present Communicate Interface Punched Card Keyboard, CRT See & Point Ask & Tell Operation Process Edit Layout Orchestrate Connectivity None Peripheral Cable LAN Internet Owners Corporate Computer Ctrs Divisional IS Shops Dept. End Users Everyone Four Decades of Computing
Flynn’s Taxonomy • Single Instruction Single Data (SISD) • Single Instruction Multiple Data (SIMD) • Multiple Instruction Multiple Data (MIMD) • Multiple Instruction Single Data (MISD)
Instruction Stream Control Unit Processor (P) Memory (M) I/O Data Stream Instruction Stream SISD
Data Stream P1 M1 Instruction Stream Data loaded from front end Control Unit Data Stream Pn Mn Program loaded from front end SIMD
Instruction Stream Data Stream Control Unit-1 P1 M1 Instruction Stream Instruction Stream Data Stream Control Unit-n Pn Mn Instruction Stream MIMD
P P P P P P P P P P P P P P P P M M M M M M M M M M M M M M M M Processor Memory SIMD Computers von Neumann Computer Some Interconnection Network
Control Unit P1 P2 P3 Pn-1 Pn M1 M2 M3 Mn-1 Mn Interconnection Network SIMD - 1
Control Unit P1 P2 P3 Pn-1 Pn Interconnection Network M1 M2 M3 Mn-1 Mn SIMD –2
M M M M Interconnection Network P P P P MIMD Shared Memory
P P P P C C C C C C C P P P M M M M Bus Based & switch based SM Systems Global Memory
M M M M Interconnection Network P P P P MIMD Message Passing
Interconnection Network • Mode of Operation (Synchronous vs. Asynchronous) • Control Strategy (Centralized vs. Decentralized) • Switching Techniques (Packet switching vs. Circuit switching) • Topology (Static Vs. Dynamic)
Interconnection Network Taxonomy Interconnection Network Dynamic Static Bus-based Switch-based 1-D 2-D HC Crossbar Single Multiple SS MS