1 / 10

Progress in Standardization of RDMA technology

Progress in Standardization of RDMA technology. Arkady Kanevsky, Ph.D Chair of DAT Collaborative. Existing RDMA Transport Standards. Virtual Interface Architecture - http://www.intel.com/design/servers/vi/developer/ia_imp_guide.htm PRO: first standard RDMA architecture

drake
Download Presentation

Progress in Standardization of RDMA technology

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Progress in Standardization of RDMA technology Arkady Kanevsky, Ph.D Chair of DAT Collaborative

  2. Existing RDMA Transport Standards • Virtual Interface Architecture - http://www.intel.com/design/servers/vi/developer/ia_imp_guide.htm • PRO: first standard RDMA architecture • CONS: no protocol, no APIs • FC-VI and VI/TCP protocols have been developed for it • InfiniBand - http://www.infinibandta.org • PRO: fully defined protocols on all levels, suitable for cluster interconnect, storage interconnect – single network for data center • CONS: no APIs, verbs only

  3. Emerging RDMA Transport Standards • RDMA Consortium - http://www.rdmaconsortium.org • PRO: open protocol specs over existing IP infrastructure: • MPA (TCP framing), Direct Data Placement, RDMAP • upper layer protocols • verbs • feeding to IETF • CONS: early specifications, work in progress • IETF RDDP WG - http://www.ietf.org/html.charters/rddp-charter.html • Work just starting on iWARP

  4. RDMA API Standards • VIDF - http://www.vidf.org/ • Based on Intel API example (VIPL-1.0) • On September 13, 2001 the VIDF ratified VIDF Extensions to VIPL 1.0 Revision A. • User level APIs only • DAT Collaborative – http://www.datcollaborative.org/ • Direct Access Transport • uDAPL • kDAPL • ICSC - http://www.opengroup.org/icsc/ • Interconnect Software Consortium (under The Open Group) • ITWG (user level) • User level sockets • Fabric management APIs

  5. What is the DAT Collaborative? Mission statement: Define and standardize set of APIs that are: • OS independent • Transport independent • InfiniBand • IETF RDDP & RDMA Consortium • VI/TCP & FC-VI • Fully exploit the capabilities of RDMA fabrics Reference Implementation:http://sourceforge.net/projects/dapl

  6. Mgmt APIs Socket APIs uDAPL (RDMA Transport) Common High-Level Architecture & APIs Mgmt Apps User Apps User Apps Open Group ICSC DAT API IB Access OS User Infrastructure HCALibrary OS Kernel Infrastructure kDAPL SRP, IPoIB DAT API IB Access = supplied by HCA vendor HCA Driver = IB Consumers IB HCA VI/IP FC-VI Other Interconnects…

  7. DAT Collaborative – Progress Lightweight organization, low overhead • No Promoters • No Sponsors • Members have all the rights of Promoters and Sponsors Inaugural meeting at Veritas 6/27/2001 Web page www.datcollaborative.org Reflector – dat-discussions @ yahoogroups.com Major Milestones: • kDAPL-1.0 API ratified (available on the web site) • uDAPL-1.0 API ratified (available on the web site) • Currently in Errata Phase (started in August 2002) Weekly conference calls and monthly face to face meetings

  8. ICSC • The purpose of the Interconnect Software Consortium is to develop and publish software specifications, guidelines and compliance tests that enable the successful deployment of fast interconnects such as those defined by the InfiniBand™ specification. • Software specifications include programming interfaces and protocols. The specifications to be developed include: • Extensions to the UNIX Sockets API; • An API that provides direct user application access to interconnect transport; • uDAPL-1.0 is the starting point • APIs that provide application access to interconnect fabric management infrastructure.

  9. RDMA ULPs • SDP – Socket Direct Protocol • IBTA defines SDP (Annex A4) • RDMAC working on changes needed for RDMA Protocol • DAFS – http://www.dafscollaborative.org/ • Direct Access File System (DAFS) Protocol - a new file-access protocol designed to take advantage of emerging RDMA (remote direct memory access) interconnect technologies such as InfiniBand, VI and iWARP. • Products shipping from Network Appliance • Demonstrated working systems by Fujitsu, Duke U., Harvard U., U. of BC, Broadband Storage • iSCSI extensions over RDMA • RDMA Collaborative

  10. Application Application Buffers Buffers FS Switch FS Switch BufferCache BufferCache FileSystem NFS SCSIDriver TCP/IP PacketBuffers HBA Driver NIC Driver NIC HBA Comparison of File Access Methods NFS Local FS DAFS Application User Space Buffers DAFS DAPL OS Kernel HCADriver HCA H/W

More Related