1 / 27

Dell 高性能存储解决方案

Dell 高性能存储解决方案. 詹健 高级存储产品经理 戴尔（中国）有限公司. Bigger, Better, Faster 更大，更强，更快！. HPC: Bigger, Better, Faster HPC is all about High Performance Solving Bigger problems Better answers to problems Solving problems Faster

sammy
Download Presentation

Dell 高性能存储解决方案

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Dell 高性能存储解决方案 詹健 高级存储产品经理 戴尔（中国）有限公司

  2. Bigger, Better, Faster更大，更强，更快！ • HPC: Bigger, Better, Faster • HPC is all about High Performance • Solving Bigger problems • Better answers to problems • Solving problems Faster • The TeraFLOPS barrier was broken in June 1997 (1 trillion operations per second) • The PetaFLOPS barrier is now being routinely broken (1000x) • HPC Data Explosion • This means more data (capacity) • This means more IO performance (throughput) • New technology is going to accelerate data growth by an average of 2-4 times • Result – more storage capacity is needed and more storage performance is needed

  3. 灵活性, 适应性, 选择性 • The performance importance of data changes over the life of the data • At first, performance is very important • After a period of time, the performance is less important • Why keep data on high-performance storage that isn’t being used? • Based on applications and performance importance there are three basic categories of data requirements: • Fast Scratch • Performance, performance, performance • Primary (/home) • Reliability • Long-term • Capacity (very little performance)

  4. Dell 对高性能计算存储解决方案的观点 Cluster working space High performance and scalability Dell HSS 快速 HSM, Data retention retention Archive, backup User Data Home directories Applications Dell NSS Dell TSS 归档 用户 HPC Storage Reliability and good performance High capacity and cost effective

  5. Dell 集成高性能计算存储解决方案根据规模和工作负载来定位 Super Computer 快速: Dell | Terascala HSS Division 用户: Dell NSS Capacity: Dell HPC Tiered Storage Solution (TSS) Department Scale Workgroup 用户: Dell NSS Workstation Data Archiving, HSM: TSS Primary Storage: Dell HPC NFS Storage solution (NSS) for local data, home directories Scratch Space: (DT-HSS) High speed cluster working space for application data ~1-2 GB/s Throughput Conceptual, not to scale

  6. Dell 所提供的高性能计算存储解决方案 • Dell is delivering solutions using two approaches: • Complete solutions - Fully vetted, tested, supported • Come with end-to-end support from Dell and partners • Detailed documentation including best practices, performance and sizing guidance • Deployment services • Roll-Your-Own • Dell creates technical whitepapers containing: • Recommended configurations • Configuration best practices and sizing guidance • Customer buys hardware and uses whitepapers as a reference • Full Dell warranty and support on Dell components • Limited or no deployment services; no solution type services • Overtime, deliver building blocks that will integrate into the larger HPC storage ecosystem

  7. Dell-Terascala HPC Storage Solution (DT-HSS) Fast Scratch/scratch

  8. DT-HSS 架构概览 (Scratch Space) Clients IB/10Gb Management Server Management Interconnect Single name space across object servers Storage Interconnect One or more Object Pairs • Metadata Storage Server (MDS) Pair • Active/Stand-by Servers • Shared storage between two servers • Serves metadata for user data on Object Storage Servers • Object Storage Server (OSS) Pair • Active/Active Servers • Shared storage between two servers • Stores user data • Object Storage Server (OSS) Pair • Active/Active Servers • Shared storage between two servers • Stores user data

  9. DT-HSS架构 : Metadata Server Pair Object Server (Active) Object Server (Active) Metadata Server (Active) Metadata Server (Stand-by) Failover Failover PowerEdge R710 PowerEdge R710 PowerEdge R710 PowerEdge R710 6Gbps SAS redundant interconnect 6Gbps SAS redundant interconnect PowerVault MD3200 PowerVault MD3200 PowerVault MD1200 PowerVault MD1200 DT-HSS Architecture: Object Server Pair PowerVault MD3220 PowerVault MD1200 PowerVault MD1200

  10. DT-HSS 简化的管理 Single Snapshot of Entire System Alerts and Notifications on Status Comprehensive Failover System Reduced Complexity in common FS Tasks

  11. DT-HSS 性能 • QDR InfiniBand connectivity from clients to storage • Single OSS Pair with total of 96 3.5” 2TB NL SAS disks • Up to 64 clients, 1-2 threads per client • Tests using IOZone, 1024KB block size, 60GB file size, 16 LUNs • Max Reads: 6.5GB/s | Max Writes: 4.3GB/s

  12. DT-HSS – 扩展性 QDR InfiniBand switch GigE for Management 2x IB 2x IB 2x IB 2x IB 2x IB GigE • Add another OSS pair • Two OSS servers • 144TB raw (~109 TB formatted) • Up to 4.8 GB/s (read) • Up to 3.9 GB/s (write) • HSS3 144TB configuration • 144TB raw (~109 TB formatted) • Up to 4.8 GB/s (read) • Up to 3.9 GB/s (write) • MDS: 1.5 billion files • Add two more OSS pairs • Additional 288TB raw (~218TB formatted) • 9.6 GB/s (read) • 7.8 GB/s (write) Scale in Performance and Capacity

  13. 总结 DT-HSS • Scale out storage appliance for throughput intensive applications • Leverages Lustre, industry’s leading open-source parallel file system • Rich management interfaces simplifies end to end storage management 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 Metadata Pair OSS Pair User Data

  14. Dell NFS Storage Solution (NSS)Primary/home

  15. NSS 解决方案组成 NSS NSS-HA • NFS Gateway • Dell Server (R710) • IB, 10GigE options (GigE management standard) Hardware (NFS gateway) • Single NFS Gateway • Perc H800 RAID card(s) in NFS gateway • Dell MD1200 JBOD’s connected to RAID card(s) • RAID-60 or RAID-60+LVM Software and Support • RHEL 6.1 OS w/ NFS v4 (v3 optional) • Red Hat Scalable File system (XFS) • Red Hat Cluster Suite (for HA) Common Aspects • Two Active-Passive NFS Gateways • Dell MD3200 RBOD contains RAID card • Dell MD1200 JBOD’s are connected to RBOD • RAID-6 + LVM Scale up to 288TB under a single name space!

  16. NSS-High Availability (NSS-HA) 架构 IB/10GigE IB/10GigE • Two PowerEdge R710s configured in active/stand-by serving a single file system • HA requires the ability to shut-down a misbehaving server • Private network for heartbeat and control (including power control) • Plug power into controllable PDU’s • Enterprise iDRAC is the primary fencing device used to control misbehaving server • APC PDU is the secondary fencing device • HA software shuts down server and cuts power to it 2 2 Private GigE Switch (PowerConnect 5524) Dell R710 Active Server Dell 710 Standby Server 1 1 PowerVault MD3200 APC PDU APC PDU PowerVault MD1200 GigE Power Cords IB or 10GigE SAS (6Gbps)

  17. NSS-HA 性能最大达 288TB Dell Storage Forum 2012 June 10–13, 2012 | Boston, Massachusetts

  18. Dell NSS解决方案的优势 • Performance tuned NFS storage • Best possible performance • No need to experiment with tuning options – already tuned 30%

  19. HPC Tiered Storage Solution(HTSS)HSM and Archive/archive

  20. HPC解决方案中数据的快速增长 • Explosive growth in research data is leading to data management challenges • Huge amount of data needs to be stored for future analysis • Example: One institute can generate approximately 400TB of data per week • Increasing compliance requirements direct preserving data for long periods of time • Example: NSF can ask for data preservation for up to 20 years • Majority of data produced is rarely touched 2-3 weeks after creation • Cold data occupies space on primary and scratch space • All the data does not need to be on high performance storage!

  21. Dell HPC 分级存储解决方案 (HTSS) Dell Compute Cluster Dell DL2200 powered by CommVault Fibre Channel IB/ 10GbE Ethernet Primary Storage: Dell NSS Dell DX Object Storage Dell ML6000 Tape Libraries

  22. 策略集合 • Time Based Policy • “If the atime of a file is greater than 60 days, migrate the data blocks to HSM” • Size Based Policy • “If the file is larger than 100 GB, migrate the data blocks to HSM” • Directory Based Policy • “If the data is in a certain directory, migrate data blocks to HSM” User/Group “If the data is owned by user laytonj, then migrate the data blocks to HSM” Combination of Policies “If a file is older than 60 days, larger than 10GB, and is in a certain directory, then migrate the data blocks to HSM”

  23. Dell 存储产品家族

  24. 戴尔拥有全面的存储产品线 Compellent：智能分层，应用优化的虚拟存储，业界最佳ＴＣＯ EqualLogic：横向扩展，云就绪，最佳虚拟环境存储 PowerVault：高性价比、功能充实的入门级存储 DR：提升数据存储保护效率 DX：面向大数据的目标对象数据、实现长期低TCO Compellent Storage Center EqualLogic PS & FS PowerVault MD & NX PowerVault DL, TL & MTL DX 目标存储平台 DR4000 存储平台 D2D 和D2T 备份应用 简单易用的数据保护和恢复 多协议的企业级存储 功能强大，自我优化 统一的、虚拟化的存储 简单易用且功能多样 模块化的存储系统 兼顾价值和性能 大规模扩展的归档存储 简单、易于承受、固定的内容 基于磁盘的备份系统 稳定可靠，满足创新的需求 “要记得，戴尔是一个具有全面存储产品的‘选手’” – John Webster, Evaluator Group, CNET 新闻, 2011年3月22日 27

  25. Dell NAS – 根据客户需求选择最适合产品 • Clustered scalability and high availability NAS for Compellent SANs • Based on Compellent hardware and Windows Storage Server 2008 Enterprise • Simplified Management, easily-accessible snapshots, file level dedupe (Single Instance Storage) • Versatile SAN connectivity with support for both Fibre Channel and iSCSI Compellent Storage Center NAS EqualLogic FS7x00 • Multiprotocol scale-out NAS for EqualLogic Storage • Based on Dell Hardware and Dell Fluid File System • High Performance Scalable Architecture, unified management • Alignment with EqualLogic Family Values, inclusive software feature delivery Midrange & advanced • Multiprotocol scale-up NAS for PowerVault MD Storage • Based on Dell Hardware and Dell Fluid File System • High availability NFS and CIFS capability that scales beyond traditional file servers • Robust replication, snapshot, dedupe and compression features * PowerVault NX3x00 Basic deployments • Primarily for Windows Environments with emphasis on CIFS performance • Based on two R710 servers and Windows Storage Server 2008 R2 Enterprise • Flexible Deployments with a variety of iSCSI and SAS storage backend options • Advanced Windows File Management features, High Availability and native Active Directory PowerVault NX3000HA * Dedupe later in CY2012

  26. 在存储领域，戴尔正在成为一个更有活力的引人注目的参与者在存储领域，戴尔正在成为一个更有活力的引人注目的参与者 在IDC的终端用户调查中，戴尔EqualLogic在虚拟服务器环境存储中排名第一4 Gartner魔力象限 2011年中端和高端的模块化磁盘阵列2 挑战者 领导者 执行力 探索者 补缺者 前瞻性 2011年11月 1 IT Knowledge Hub，2011年3月21日 2 Gartner Group，面向中端和高端模块化磁盘阵列的魔力象限（Magic Quadrant for Midrange and High-End Modular Disk Arrays），2011年11月5日 4 IDC Multiclient Report，服务器虚拟化2010年（Server Virtualization 2010），2010年9月 Dell Confidential

  27. 谢谢！

More Related