1 / 7

InfiniBand HW Architecture

Link. Link. Mem Cntlr. Mem Cntlr. Mem Cntlr. Mem Cntlr. CPU. CPU. CPU. CPU. HCA. HCA. HCA. HCA. InfiniBand HW Architecture. InfiniBand Unified Fabric. Topology Switched Fabric (vs shared bus) 64K nodes per sub-net Multiple subnets bridged w/routers IPv6 addressing x-subnet

chul
Download Presentation

InfiniBand HW Architecture

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Link Link MemCntlr MemCntlr MemCntlr MemCntlr CPU CPU CPU CPU HCA HCA HCA HCA InfiniBand HW Architecture InfiniBand Unified Fabric • Topology • Switched Fabric (vs shared bus) • 64K nodes per sub-net • Multiple subnets bridged w/routers • IPv6 addressing x-subnet • Fabric Transactions • Unified fabric for IPC, Networking, and Storage • Channel based interconnect • Closely integrated with Mem Ctrlr • QoS (Service Levels, Virtual Lanes) • Reliability • Automatic fail-over in switch • Support for redundant fabrics • Physical Layer • Cost Effective Four wire link (2 pairs) • Enables volume deployments • 2.5Gb/sec signaling rate • Copper & Fiber support • Multiple link widths • 1x - 2.5 Gbits/sec • 4x - 10 Gb/sec • 12x - 30 Gb/sec Hosts Storage 1 InfiniBand Switch Network 2 3 . . . . Router n InfiniBand Architecture Storage Target TCA 1 Link Link Switch 2 Link Link Link TCA N/W Target 3 Link Link Link Link xCA Router n 1

  2. 2

  3. 3

  4. Virtual Lane (VL) • Multiplex multiple independent data streams onto a single physical link which provides: • Differentiated services on a packet-boundary basis • Increase fabric utilization in the face of head-of-line blocking on a given VL and via VL-based routing across multiple paths • Support for up to 16 VLs with 1 VL reserved for fabric management • Implementations shall support a minimum of 1 VL application usage and 1 VL for fabric management Packets Packets De-Mux Mux 4

  5. Messages & Packets Transaction • Applications, drivers, devices, adapters, etc. execute transactions via logical units of work termed messages. • H/W-based memory / resource protection to prevent unauthorized access to messages • Message semantics supported are: • Memory - RDMA Read / Write • Channel - Send / Receive • Atomics (optional functionality) • Multicast (optional functionality) • InfiniBandtechnology H/W provides automatic message segmentation and re-assembly via packets • End-to-end fabric unit of transfer Message Message Message Packet Packet Packet Packet Packet Packet Packet Packet 5

  6. 6

  7. 7

More Related