80 likes | 195 Views
Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity Power & Space Efficiency. S2A Technology Update A Tradition of HPC Data Leadership 2008 HPC User Forum Spring Meeting Jeff Denworth: Director of Platform Solutions.
E N D
Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity Power & Space Efficiency S2A Technology Update A Tradition of HPC Data Leadership 2008 HPC User Forum Spring Meeting Jeff Denworth: Director of Platform Solutions
Total Worldwide Digital Archive Capacity: 2007-2012 Source: Enterprise Strategy Group DataDirect NetworksTarget Applications • Servicing performance and capacity-bound applications experiencing compounding storage management issues • These application profiles collide in the HPC data center • 2 Sample Data Points • Defensive I/O: Multi-Core = More Memory = More data to Checkpoint • Scalable, High-Performance WRITE-INTENSIVE storage is required • Low-Cost, High Density RAM (eg. MetaRAM) will only compound this problem • Productive I/O: Data Volume is Exploding • CERN LHC will produce 27TB per day! • That data needs to be distributed to 7000 researchers worldwide
SATA Usage & Capacity Increases Vulnerability Implications The Appeal of SATA Technology: • Lower price per GB • Larger capacity • Lower power consumption • Less heat than Enterprise drives The Trade-Off: Performance is 1/2 - 1/3 of SCSI SATA exacerbates storage issues • Lower seek performance • Less reliability controls (mechanically) • Less robust electronically • Rebuild Times Grow w/ Capacity • Not Complimentary to Reliability • Many Drives not even dead • Sick/Slow Drives are Common DataDirect Networks 4th Largest Linux TB Shipped ‘06
High Performance ComputingTraditional Storage Issues • We believe that traditional storage technologies are incapable of responding to the growing data challenge. • Issues with traditional storage in HPC • Systems deliver substantially lower write performance than read performance – often ½ less • Systems are not designed to provide predictable I/O and handle failures • Striped storage environments realize degrading performance as the cluster grows – Amdahl’s Law Peak System Performance Not delivered in clustered environments System Performance Degraded shared file performance as systems encounter sluggish / failed drives Capacity
2008 Winner Visionary Product DataDirect Networks S2A9900
DataDirect Networks Product Family Announced Today!! Announced Today!!
S2A Storage = The Gold Standard in HPC I/O Common Platform: Processing, Backup and Archiving OPEN storage application & file system flexibility DirectRAID Algorithms optimized for large data transfer Writes as fast as reads; Unrivaled real-world performance – with SATA Green Storage: SleepMode and up to 660 drives/rack The Performance & Capacity Storage Leader 40 of the top 100 supercomputers choose S2A Technology Tight Integration with Parallel and Archival File Systems Lustre, GPFS, pVFS, Quantum StorNext, CXFS + DMF, HPSS, etc. Worldwide HPC Experience Partners: • Case Study: LLNL • Requirements: • Multi-Cluster, Massively Scalable Site-Wide Lustre Platform • Includes world’s fastest BlueGene/L • 130GB/s GPFS System for Capability System (Purple) • Maximum SATA data integrity • Solution: • 150GB/s+ S2A Systems providing scalable I/O and Data Availability Sample Customers: Variety of Applications
Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity Power & Space Efficiency