300 likes | 546 Views
Network-on-Chip. An Overview System-on-Chip Group, CSE-IMM, DTU. Introduction – intra chip communication. Memory. m P. RF. Network. Keypad. DSP. Introduction – intra chip communication. Memory. m P. RF. BUS. Keypad. DSP. Introduction – intra chip communication. Memory. m P. RF.
E N D
Network-on-Chip An Overview System-on-Chip Group, CSE-IMM, DTU
Introduction – intra chip communication Memory mP RF Network Keypad DSP © System-on-Chip Group, CSE-IMM, DTU
Introduction – intra chip communication Memory mP RF BUS Keypad DSP © System-on-Chip Group, CSE-IMM, DTU
Introduction – intra chip communication Memory mP RF Point-to-Point Keypad DSP © System-on-Chip Group, CSE-IMM, DTU
Overview • Important Paradigms • Network Abstraction • Performance Evaluation • Research Opportunities © System-on-Chip Group, CSE-IMM, DTU
Important Paradigms for NoC • Re-use • Flexibility • GALS • Low Power Core Network Adapter Routing Node Link © System-on-Chip Group, CSE-IMM, DTU
On-Chip Cheap Wires Power Limited Area Limited Unreliable Wire Models Off-Chip Wire/pin Limited High Latency Higher Node Complexity Viable On-Chip vs Off-Chip © System-on-Chip Group, CSE-IMM, DTU
Network Usage Example Mem. N-ACK µP NI NI µP Mem. WRT DATA DATA DATA DATA ACK Typical P2P Write Session (3 comm. events) “Networked” Write Session (4 comm. event) © System-on-Chip Group, CSE-IMM, DTU
Network Abstraction - OSI Application/ Presentation Layers Source Core Sink Core Core Interface Socket Socket Session/ Transport Layer Network Interface Network, Link and Physical Layers © System-on-Chip Group, CSE-IMM, DTU
Network Dataflow View Source Core Sink Core Socket Socket Messages Packets Flit Phif © System-on-Chip Group, CSE-IMM, DTU
Application Layer Traffic Characterization Freq. of Comm. Events µP, Dedicated Hardware DSP, Application Specific Blocks high Memory I/O (sensors, wired/wireless) low small large Communication Msg. Size © System-on-Chip Group, CSE-IMM, DTU
Application Based Communication Network Design The consistent theme in the literature is to design on-chip network for the application the chip is utilized for, but there is a growing integration of various application cores within a single chip. Hence the need for the network to be flexible and robust so that it can support diverse types and volume of traffic generated by different cores. An example is the Nokia’s future mobile set that can provide real-time application needs as well as “low latency” data needs. © System-on-Chip Group, CSE-IMM, DTU
Traffic Distribution ‘Normal’ (bulk) traffic high Bandwidth Utilization Streaming Control, interrupts, requests, et al? Critical events low low high QoS © System-on-Chip Group, CSE-IMM, DTU
Network Abstraction • Session / Transport Layer • Plug and play interface • Traffic encapsulation • Network / Link Layer • Topology • Protocol © System-on-Chip Group, CSE-IMM, DTU
Network Abstraction • Physical Layer • Sub-micron technologies pose challenges • Circuit design • Low-swing drivers • Differential signaling • Asynchronous • Link implementations such as virtual circuits © System-on-Chip Group, CSE-IMM, DTU
Networks-on-Chip Many combinations! How to judge trade-offs?! © System-on-Chip Group, CSE-IMM, DTU
Boil Down of OSI Application Presentation Message Source/Sink Application Session • Network Configuration • Error Correction • Packet Creation, Message Reconstruction • Addressing Transport Interface Network • Flow Control • Prioritization (Bandwidth Reservation) Network Data Physical Link Point-to-point Channels (wires) OSI NoC Job Description © System-on-Chip Group, CSE-IMM, DTU
Quantitative terms Latency Bandwidth Power Area Qualitative terms QoS Load balancing Reconfigurability Fault tolerance … more features? Performance Evaluation © System-on-Chip Group, CSE-IMM, DTU
Tools and Testing NoC is a subset of SoC • Tools • Design • Simulation • Testing • Pre-fabrication • Post-fabrication © System-on-Chip Group, CSE-IMM, DTU
Issues • At Application Layer • Minimizing the end-to-end latency • Making network communication “transparent” • Support for different traffic types • At Interface Layer • Message-to-packet overhead (and vice versa) • Breaking up and re-sequencing? • Error Correction cost? • Addressing techniques? • End-to-end flow control • Message buffer sizing? • Circuit-switching-like properties? • QoS (Network setup cost, BW reservation)? © System-on-Chip Group, CSE-IMM, DTU
Issues, cont… • At Network Layer • Need specialized technique for “fast and dedicated routing” • Combination of deterministic and non-deterministic routing? • Topology • Link-to-link Flow Control • Packet buffer sizing? • Virtual channels (deadlock avoidance)? • Back pressure (Congestion look-ahead)? • Routing Mechanism • Address resolution • Bandwidth reservation • At Link Layer • Fast flexible links • Virtual channels? • Split channels for multi-flit-per-cycle communication? • Dedicated Address / Control lines? © System-on-Chip Group, CSE-IMM, DTU
Overhead Considerations • Routing Protocol • Congestion control • Error-correction • Network setup/tear-down • Synchronization © System-on-Chip Group, CSE-IMM, DTU
Research Opportunities • Traffic + Application • Topology + Protocol • Reconfigurability • Area + Power Issues • Interfaces (GALS) • Sub-micron Technology Exploitation © System-on-Chip Group, CSE-IMM, DTU
References • BJERREGAARD, T. and MAHADEVAN, S. 2004. “NoC Survey Manuscript”, Submitted. • HO, R.,MAI, K. W., AND HOROWITZ,M. A. 2001. The future of wires. Proceedings of the IEEE. • ITRS. 2001. International technology roadmap for semiconductors (ITRS) 2001. Tech. rep., International Technology Roadmap for Semiconductors. • JANTSCH, A. AND TENHUNEN, H. 2003. Networks on Chip. Kluwer Academic Publishers. • LEE, K. 1998. On-chip interconnects - gigahertz and beyond. Solid State Technology. • OCPIP. The importance of sockets in soc design. White paper downloadable from http://www.ocpip.org. • BENINI, L. AND MICHELI, G. D. 2002. Networks on chips: A new soc paradigm. IEEE Computer. • DALLY, W. J. AND TOWLES, B. 2001. Route packets, not wires: On-chip interconnection networks. In Proceedings of the 38th Design Automation Conference. • DIELISSEN, J., RADULESCU, A., GOOSSENS, K., AND RIJPKEMA, E. 2003. Concepts and implementation of the phillips network-on-chip. In Proceedings of the IP based SOC IPSOC’03. • GOOSSENS,K.,MEERBERGEN, J. V., PEETERS, A., AND WIELAGE, P. 2002. Networks on silicon: Combining best-effort and guaranteed services. In Proceedings of the 2002 Design, Automation and Test in Europe Conference (DATE’02). IEEE. © System-on-Chip Group, CSE-IMM, DTU