1 / 9

The Next Evolution of PVFS

The Next Evolution of PVFS. OrangeFS. PVFS2. Brought Us…. Modular Architecture Support for Standard out of the box kernels Distributed Meta-data Scalability Direct MPI Support Hardware Independence Stateless Operations. OrangeFS … (Current 2.8.4). Added…

tyanne
Download Presentation

The Next Evolution of PVFS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Next Evolution of PVFS OrangeFS

  2. PVFS2 Brought Us…. • Modular Architecture • Support for Standard out of the box kernels • Distributed Meta-data • Scalability • Direct MPI Support • Hardware Independence • Stateless Operations

  3. OrangeFS… (Current 2.8.4) Added… • Commercial Grade support (from Omnibond) • Dedicated Professional Development Team • Improved stability • improved meta-data performancefor better small file throughput • replicated data for immutable files • Supports SSD for Metadata Still… • Empower Research • Community Driven • 100% Open Source

  4. OrangeFS… (This Year 2.8.5 & 2.8.6) Will Bring… • Distributed Directories • Based on / Derived from Giga+ • Capability Based Security • Enhanced Client Libraries • Can preload for applications that use standard POSIX calls • Client Side Caching (Single System Coherence) • Windows Client (with Certificate based Authentication) • WebDavLibrary (mod_dav_orangefs) • Enhanced performance Counters and Debugging Tools

  5. Where is OrangeFS Going

  6. Similar Requirements Differing Reasons Exascale Enterprise / otherResearch Areas • Data / IO growth • Resilience • Security • Management • Decade old problem on an exponential path • Something is always down • Distributed User-base • Mass System Management • Glimpse of the HEC Space • Up-Time • Shared File Systems • Ease of Administration

  7. OrangeFS-Next… • 128bit UUID Handles • Data Replication • Lazy, On Commit, Continuous • Data Tiering • Hardware Life-Cycle activities (keep the data online) • Self Connecting Storage Nodes • Ultimately Storage nodes will not need to know about all other nodes (~only ones it shares data with) • Nodes will need to understand locality, classes of server, replica info • Background self healing processes

  8. PXFS Sterling, Ligon • ParalleX FS • Similar to PGAS (Partitioned Global Address Space) • Active Messages (Sending Message Invokes Thread) • Futures Synchronization • Integrate the file system • Blur the line between memory and File System • Highly Object Oriented (C++) • Exascale Think of Bucky-Compute-Balls that can be flung to the data it needs

  9. Thanks! Boyd Wilsonb@clemson.edu

More Related