1 / 8

Chelsio Communications OFED (iWarp) Enhancements

This presentation discusses the enhancements made to the Chelsio Communications OFED (iWarp) technology, including the support for additional iWarp verbs and improved memory handling capabilities. It also explores the iWarp connection setup process and proposes a peer-to-peer support solution. The presentation concludes with an overview of the latest Chelsio iWarp projects and future developments.

stump
Download Presentation

Chelsio Communications OFED (iWarp) Enhancements

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. ChelsioCommunications OFED (iWarp) Enhancements Felix Marti, felix@chelsio.com Open Fabrics Alliance Workshop Sonoma, April 2008

  2. Verbs • OFED does not support all iWarp Verbs; MIA are • Stag Alloc • Stag Dealloc • Fast Register Non-Shared Memory Region • RDMA Read Invalidate Local Stag • Invalidate Local Stag • User and Kernel space availability • Currently Bind Memory Window Kernel only? • APIs need to enable ‘fast path’ QP operations • Currently Bind MW not QP operation?` Verbs should remain/become transport neutral 2

  3. Memory Handling Verbs • OFED consumers ask for better Memory Handling capabilities • i.e. NFSoverRDMA Memory Handling Dilemma: Table courtesy of Tom Talpey 3

  4. iWarp Connection Setup • iWarp connections start life as TCP connections • Endpoints negotiate to upgrade to iWarp • Upgrade requires ‘initiator’ to send first iWarp PDU • Some (many) ULPs/Apps don’t adhere to the requirement – ahhh, fix the ULPs/Apps, pleeze 4

  5. iWarp Connection Setup (2) • Proposal (referred to as Peer 2 Peer support): • Negotiate p2p using MPA private data • MPA initiator advertises if it supports p2p • MPA responder advertises if it wants RTR and what type (OB RDMA Read, RDMA Write or Send) • MPA responder defers ‘initiating iWarp operations’ until RTR is received • MPA initiator sends RTR after successfully processing the MPA start response • Enhance RDMA-CM API to allow ULP/App to enable/disable p2p OFED only solution – do we need standardization (IETF)? 5

  6. Latest Chelsio iWarp Projects • Peer 2 Peer Connection upgrade • OpenMPI (and the other MPIs) • RDS • NFSoverRDMA Chelsio is heavily investing into iWarp/OFED! 6

  7. Future • ULPs/Apps should migrate to RDMA-CM to take advantage of iWarp • i.e. ib_* tests shipping in OFED • As OFED becomes more transport neutral, life becomes easier • [4-tuple sharing with the host stack] Call To Action! Help Out! Maybe we can donate HW? 7

  8. Thank You! 8

More Related