1 / 15

IDC HPC User Forum Panasas Update April 5, 2011 Houston, TX

IDC HPC User Forum Panasas Update April 5, 2011 Houston, TX. Panasas Focused on Growth within HPC Markets. Strong Financial Position Five consecutive years of revenue growth 42% revenue growth in FY10, year-over-year Loyal, Brand Name Customers >75% repeat buyers Global Presence

minna
Download Presentation

IDC HPC User Forum Panasas Update April 5, 2011 Houston, TX

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. IDC HPC User ForumPanasas UpdateApril 5, 2011Houston, TX

  2. Panasas Focused on Growth within HPC Markets • Strong Financial Position • Five consecutive years of revenue growth • 42% revenue growth in FY10, year-over-year • Loyal, Brand Name Customers • >75% repeat buyers • Global Presence • >300 active customers in over 50 countries • Expecting 50% Headcount Increase in 2011 Worldwide support with over 25 global resellers

  3. Panasas® PAS 12 • Hardware • 4U chassis (eleven blades) houses up to 40TB of storage at 1.5GB/s performance throughput • 10 chassis per standard 40U rack – 400TB/15GB/s per rack • Blades are form, fit, function backward compatible – investment protection • Performance • Aggregate performance scales from 1.5GB/s to a staggering 150GB/s, the industry’s highest per gigabyte performance • Capacity • Expansion from 40TB to 4PB in 40TB increments • Scalability • Add blades, chassis, or entire racks, without system disruption, to extend performance and capacity. Additional capacity is self configured. • Blades are managed in a global namespace and can be easily networked to create extremely large storage pools

  4. Unprecedented Performance and Scale with Parallel Architecture

  5. Why a Standard for Parallel I/O? • NFS is the only network file system standard • Proprietary file systems have unique advantages, but aren’t right for everyone • NFS widens the playing field • Panasas, IBM, EMC want to bring their experience in large scale, high-performance file systems into the NFS community • Sun/Oracle and NetApp want a standard HPC solution • Broader market benefits vendors • More competition benefits customers • What about open source • NFSv4 Linux client is very important for NFSv4 adoption, and therefore pNFS • Still need vendors that are willing to do the heavy lifting required in quality assurance for mission critical storage

  6. NFSv4 and pNFS • NFS originally created in ’80s to share data among engineering workstations • NFSv3 widely deployed • NFSv4 several years in the making • Integrated Kerberos (or PKI) user authentication • Integrated File Locking and Open Delegations (stateful server!) • ACLs (hybrid of Windows and POSIX models) • Official path to add (optional) extensions • NFSv4.1 adds even more • pNFS for parallel I/O • Directory Delegations for efficiency • RPC Sessions for robustness, better RDMA support

  7. pNFS: Standard Storage Clusters • pNFS is an extension to the Network File System v4 protocol standard • Allows for parallel and direct access • From Parallel Network File System clients • To Storage Devices over multiple storage protocols • Moves the NFS (metadata) server out of the data path data metadata Block (FC) / Object (OSD) / File (NFS) Storage pNFS Clients control NFSv4.1 Server

  8. The pNFS Standard • The pNFS standard defines the NFSv4.1 protocol extensions between the server and client • The I/O protocol between the client and storage is specified elsewhere, for example: • SCSI Block Commands (SBC) over Fibre Channel (FC) • SCSI Object-based Storage Device (OSD) over iSCSI • Network File System (NFS) • The control protocol between the server and storage devices is also specified elsewhere, for example: • SCSI Object-based Storage Device (OSD) over iSCSI Client Storage MetaData Server

  9. pNFS Layouts • Client gets a layout from the NFS Server • The layout maps the file onto storage devices and addresses • The client uses the layout to perform direct I/O to storage • At any time the server can recall the layout • Client commits changes and returns the layout when it’s done • pNFS is optional, the client can always use regular NFSv4 I/O layout Storage Clients NFSv4.1 Server

  10. pNFS Client • Common client for different storage back ends • Wider availability across operating systems • Fewer support issues for storage vendors Client Apps pNFS Client 1. SBC (blocks)2. OSD (objects)3. NFS (files) 4. PVFS2 (files)5. Future backend… Layout Driver NFSv4.1 pNFS Server Layout metadatagrant & revoke Cluster Filesystem

  11. Key pNFS Participants • Panasas (Objects) • ORNL and ESSC/DoD funding Linux pNFS development • Network Appliance (Files over NFSv4) • IBM (Files, based on GPFS) • BlueArc (Files over NFSv4) • EMC (Blocks, HighRoad MPFSi) • Sun/Oracle (Files over NFSv4) • U of Michigan/CITI (Linux maint., EMC and Microsoft contracts) • DESY – Java-based implementation

  12. pNFS Standard Status • IETF approved Internet Drafts in December 2008 • RFCs for NFSv4.1, pNFS-objects, and pNFS-blocks published January 2010 • RFC 5661 - Network File System (NFS) Version 4 Minor Version 1 Protocol • RFC 5662 - Network File System (NFS) Version 4 Minor Version 1 External Data Representation Standard (XDR) Description • RFC 5663 - Parallel NFS (pNFS) Block/Volume Layout • RFC 5664 - Object-Based Parallel NFS (pNFS) Operations

  13. pNFS Implementation Status • NFSv4.1 mandatory features have priority • RPC session layer giving reliable at-most-once semantics, channel bonding, RDMA • Server callback channel • Server crash recovery • Other details • EXOFS object-based file system (file system over OSD) • In kernel module since 2.6.29 (2008) • Export of this file system via pNFS server protocols • Simple striping (RAID-0), mirroring (RAID-1), and RAID-5 • “Most stable and scalable implementation” • Files (NFSv4 data server) implementation • Open source server based on GFS • Layout recall not required due to nature of underlying cluster file system • Blocks implementation • Server in user-level process, Ganesha/NFS support desirable • Sponsored by EMC

  14. Linux Release Cycle • Then comes Linux distribution support…

  15. A Few Predictions • pNFS will be in production use in 2012, fully supported by major Linux distributions and by leading storage vendors (including Panasas) • Proprietary protocols like DirectFlow will continue to provide higher performance and reliability advantages for some time as pNFS matures • pNFS will see most of its early adoption within HPC, especially in NFS environments • Storage systems leveraging pNFS objects will be the ones capable of delivering the highest parallel file system performance • pNFS will eventually make parallel file systems commonplace

More Related