1 / 7

Data Evolution: 101

Data Evolution: 101. Parallel Filesystem vs Object Stores. Amazon S3. CIFS. NFS. Summary: Parallel Filesystem vs Object Stores. WOS Testing Limits. Extents-based Traditional File System Approach. Ease of use is limited at Scale FSCK challenges Inode data structures

zareh
Download Presentation

Data Evolution: 101

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Evolution: 101

  2. Parallel Filesystem vs Object Stores Amazon S3 CIFS NFS

  3. Summary: Parallel Filesystem vs Object Stores

  4. WOS Testing Limits

  5. Extents-based Traditional File System Approach • Ease of use is limited at Scale • FSCK challenges • Inode data structures • Fragmentation issues • Filesystem expansion tricky • No native understanding of distribution of data • RAID management and hot-spare management

  6. WOS (Web Object Scaler) • Not POSIX-based • Not RAID-based • No Spare Drives • No inode references, no FAT, no extent lists • No more running fsck • No more volume management • Not based on single-site/box architecture

  7. DDN | WoSSoftware Stack Data Protection Replicate and/or Erasure Code Global, Peer:Peer Distribute data across 100s of sites in one namespace Connectors Object ID Management GRIDScaler HSM WOS API C++, Java, Python, PHP, HTTP, HTTP CDN Caching Android, iOS & S3 Multi-Tenancy Layer Distributed Objects EXAScaler HSM Self-Healing Intelligent Data Management system recovers from failures rapidly and autonomously NFS & CIFS WOS Core: Peer-to-Peer Object Storage API-based Integrate applications and devices more robustly WOS Cluster Management Utility Latency-Aware Access Manager WOS Policy Engine Policy driven Manage truly via policy, rather than micromanaging mulitiple layers of traditional filesystems User-Defined Metadata Self-Healing Object Storage Clustering Small files, large files, streaming files Low seek times to get data WOS cacheing servers for massive streaming data Replication Engine ObjectAssure™ Erasure Coding De-clustered Data Management & Fast Rebuild

More Related