1 / 20

pNFS BOF FAST 2009 2009-02-25

pNFS BOF FAST 2009 2009-02-25. Sorin Faibish, EMC Mike Eisler, NetApp Brent Welch, Panasas Piyush Shivam , Sun Microsystems. Outline. What is pNFS? pNFS Timeline Standards Status Industry Support pNFS Vendors Status. What is pNFS?. pNFS protocol standardized: NFSv4.1

herman
Download Presentation

pNFS BOF FAST 2009 2009-02-25

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. pNFS BOFFAST 20092009-02-25 Sorin Faibish, EMC Mike Eisler, NetApp Brent Welch, Panasas Piyush Shivam, Sun Microsystems

  2. Outline • What is pNFS? • pNFS Timeline • Standards Status • Industry Support • pNFS Vendors Status pNFS FAST09 BOF 2009-02-25

  3. What is pNFS? • pNFSprotocol • standardized: NFSv4.1 • Storage-access protocol • files (NFSv4.1) • blocks (FC, iSCSI, FCoE) • objects (OSD2) • Control protocol • Outside of the pNFS standard Client pNFS protocol Storage-access protocol Metadata Server Control protocol Data Servers pNFS FAST09 BOF 2009-02-25

  4. pNFS Value Proposition • Distributes data across storage cluster • Eliminates or reduces load and capacity balancing • And yes: can accelerate I/O pNFS FAST09 BOF 2009-02-25

  5. pNFS Layouts • Client gets a layout from the NFSv4.1 server • The layout maps the file onto storage devices and addresses • The client uses the layout to perform direct I/O to storage • At any time the server can recall the layout • Client commits changes and returns the layout when it’s done • pNFS is optional, the client can always use regular NFSv4.1 I/O layout Storage Clients NFSv4.1 Server pNFS FAST09 BOF 2009-02-25

  6. Linux pNFS Client • Transparent to applications • Common client for different storage back ends • Fewer support issues for storage vendors • Normalizes access to clustered file systems Client Apps • files (NFSv4.1) • objects (OSD2) • blocks (SCSI) • Future back ends … NFSv4.1 Layoutgrant & recall pNFS Client Layout Driver pNFS Server Storage Protocol Cluster File System Control Protocol pNFS FAST09 BOF 2009-02-25

  7. Timeline • 2004 – CMU, NetApp and Panasas draft pNFS problem and requirement statements • 2005 – CITI, EMC, NetApp and Panasas draft pNFS extensions to NFS • 2005 – NetApp and Sun demonstrate pNFS at Connectathon • 2005 – pNFS added to NFSv4.1 draft • 2006 - 2008 – specification baked • Bake-a-thons, Connectathons • 26 iterations of NFSv4.1/pNFS spec pNFS FAST09 BOF 2009-02-25

  8. pNFS Standards Status • NFSv4.1/pNFS were standardized at IETF • NFSv4 working group (WG) • All done except for RFCs: • WG last call (DONE) • Area Director review (DONE) • IETF last call (DONE) • IESG approval for publication (DONE) • IANA review (TBD) • RFC publication (Expected 2009) • Will consist of several documents: • NFSv4.1/pNFS/file layout • NFSv4.1 protocol description for IDL (rpcgen) compiler • blocks layout • objects layout • netid specification for transport protocol independence (IPv4, IPv6, RDMA) pNFS FAST09 BOF 2009-02-25

  9. Industry Contributors to pNFS Standard pNFS FAST09 BOF 2009-02-25

  10. Timeline - pNFS Vendors Group • February 2008 – FAST 2008 Garth Gibson (Panasas/CMU) propose creation of pNFS vendors group • April 2008 – Storage Panel and pNFS Vendors Group Created at HPC User Forum Meeting: EMC, NetApp, Panasas, SUN • EMC organizes monthly calls attended by pNFS vendors • Preparation for creation of SNIA pNFS marketing forum • Presentation of pNFS BoF at Super Computing 2008 conference attended by all major vendors and new supporters: CITI, StorSpeed, EMC, IBM, LSI, NetApp, Panasas and SUN • Presentation of pNFS Tutorial at SC08 pNFS FAST09 BOF 2009-02-25

  11. Clients Linux Sun (Open Solaris) Servers Desy EMC IBM Linux NetApp Panasas Sun (Open Solaris) Industry Support - Implementations Several other implementations have been tested at Bake-a-thons and Connectathons pNFS FAST09 BOF 2009-02-25

  12. Linux Status • Client • Consists of generic pNFS client and “plug ins” for “layout drivers” • Supports files, blocks, objects • Contributors: CITI, EMC, NetApp, Panasas • Server • Supports files, blocks, objects • Contributors: CITI, EMC, IBM, NetApp, Panasas • Finalizing patches for kernel.org – NFSv4.1 sessions • Predicted timeline: • Basic NFSv4.1 features 1H2009 • NFSv4.1 pNFS and layout drivers by 2H2009 • Linux distributions shipping supported pNFS in 2010. pNFS FAST09 BOF 2009-02-25

  13. OpenSolaris Status Developing both pNFS client and server in open • nfsv41-discuss@opensolaris.org File-based implementation exploiting ZFS capabilities Management via Simple Policy Engine (SPE) pNFS data path over RDMA (on Infiniband) pNFS FAST09 BOF 2009-02-25

  14. Summary and Call to Action • pNFS is the first open standard for parallel I/O across the network • pNFS has wide industry support • commercial implementations and open source • Start using NFSv4.0 today • Eases transition to pNFS Urge your O/S (including Linux) distributor and storage vendor to include pNFS pNFS FAST09 BOF 2009-02-25

  15. EMC and pNFS Sorin Faibish – EMC DE Per Brashers – EMC pNFS Architect pNFS BOF, FAST 2009, San Francisco, 2009-02-25

  16. Apps Jobs Compute Engines CONNECTIVITY NFS S E R V E R S pNFS EMC Celerra and pNFS deliver high I/O speeds Storage must be Networked pNFS addresses storage access issues • Remove servers layer between CE and shared storage • Separates MD traffic from Data Traffic • Asymmetric storage architectures increase scalability • Leverages SSD to increase I/O speed • Automatic tiering • Improves utilization to any SAN infrastructure: • FCoE, Infiniband, FC, iSCSI • Enable access to PB’s of storage at GB’s/sec speeds • Demonstrated by existent MPFS deployments • Combine multiple MD servers in a unified storage system • MD server is any Celerra NAS server supporting: • NFSv3, CIFS, MPFS and pNFS • Tiered services for increased scalability HPC Architecture MIDDLEWARE CONNECTIVITY SAN STORAGE pNFS FAST09 BOF 2009-02-25

  17. Clustered Data ONTAP pNFS ServerpNFS BOF, FAST 20092009-02-25 Mike Eisler Pranoop Erasani pNFS FAST09 BOF 2009-02-25

  18. Clustered Data ONTAP and pNFS Clustered Data ONTAP derived from Data ONTAP 10 GX http://www.usenix.org/events/fast07/tech/eisler.html Every storage cluster node can be metadata server and/or data server Simplify storage management Striping with WAFL Striped volumes Avoid single-node data bottleneck Unstriped volumes also supported Will be in a future release of Data ONTAP 8 1 1 2 2 1 1 2 2 1 Metadata server operations Data server operations 2 18 pNFS FAST09 BOF 2009-02-25

  19. Accelerating Industry-wide Adoption of Parallel Storage Solutions “The Leader in Parallel Storage” pNFS FAST09 BOF 2009-02-25Confidential Confidential

  20. Panasas and pNFS Co-Led the kick-off workshop in November 2003 that drew representatives from all leading vendors of cluster file systems Thank you Peter Honeyman/CITI for hosting and all their subsequent support for pNFS Co-Published initial internet drafts on pNFS Thank you to the nfsv4 working group for being so receptive Contributed to Linux open source for iSCSI/OSD Experienced in Linux open source culture for code adoption Leading/Coordinating Linux development for pNFS Ushering patches upstream is a full time job Panasas storage cluster is pNFS compatible today

More Related