1 / 65

Past, Present and Future of Windows-based NAS: A Growing Market for Highly Available Solutions

Required Slide. SESSION CODE: WSV323. Past, Present and Future of Windows-based NAS: A Growing Market for Highly Available Solutions. Scott M. Johnson Program Manager Microsoft Corporation. Session Objectives and Takeaways. Session Objective(s): What, Where and Why Windows NAS ?

saburo
Download Presentation

Past, Present and Future of Windows-based NAS: A Growing Market for Highly Available Solutions

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Required Slide SESSION CODE: WSV323 Past, Present and Future of Windows-based NAS:A Growing Market for Highly Available Solutions Scott M. Johnson Program Manager Microsoft Corporation

  2. Session Objectives and Takeaways • Session Objective(s): • What, Where and Why Windows NAS? • Customer Challenges and data growth projections • Microsoft is in the storage business? • File Services and NAS • Why Windows NAS? • FSCT - Reference Design Performance Testing Results • Introducing Windows Storage Server 2008 R2 • New Windows Editions • Demonstrations • Windows Server 2008 R2 Storage Features

  3. Customer Challenges Budget Constraints Growth of users and data Heterogeneous environments Distributed computing ? ?

  4. Data Explosion Increased Digitization of content • Retain and retrieve information for Governance & compliance policies • Emergence of data as a revenue generating product Source: IDC's 2009 Enterprise Disk Storage Consumption Model

  5. Growth (Exabytes) Source: IDC's 2009 Enterprise Disk Storage Consumption Model

  6. Growth File growth will out-pace block by a factor of 3 (Exabytes) Source: IDC's 2009 Enterprise Disk Storage Consumption Model

  7. 2006 2003 2000 A Decade of Storage Solutions at Microsoft 2010 • Windows Storage Server • Configurable NAS Appliances • Single Instance Storage • Heterogeneous Access to Centralized Data Management • System Center Data Protection Manager • Continuous Data Protection: Disk-to-Disk-to-Tape and cloud • iSCSI Software Target • Clustered Block Storage with MPIO • Windows Server • Leading platform enabling storage fabric adoption • Preferred platform for developing, deploying, and using storage devices • Storage Reporting (FSRM) • Storage Manager for SANs 2008 2007 2005

  8. Windows Storage Server • Storage Server appliances are for dedicated file, block, and print workloads • Optimized for… • Efficient storage utilization • Cost-effective file serving • IT consolidation • OEM partners deliver… • Preconfigured OEM hardware and software integrated. • Headless and highly available configurations

  9. Windows Server SKUs for Storage Appliances Consumer / SOHO Small Business Enterprise Mid-size Business & Branch offices Lower Small Business (1-4 PCs) Core Small Business (5- 24 PCs) Lower Mid-Size (25- 49 PCs) Core Mid-Size (50 - 249 PCs) Upper Mid-Size (250 - 499 PCs) (500 & Up PCs) (1-3 PCs) Target Market 22 M 10 M 250 M 1.2 M 18 K Entities Influencer Retail OEM Direct & VAR/VAP IT Generalist/Pro CIO Segments Scale-up Consumer: entry level Commercial: entry level HA & Scale-out Windows Home Server Windows Storage Server Workgroup Windows Storage Server Standard and Enterprise

  10. NAS Configurations • Network File Shares • SMB is the premier technology for network file serving • NFS is included in Windows Server • Block Storage • iSCSI Software Target • Support SQL, Exchange, Sharepoint • Gateway to a SAN • Enable file protocols to reach SAN storage

  11. Why Windows NAS? Microsoft is a NAS market leader Industry Standard Hardware Provision storage without expertise Integrates into existing IT Anti-Virus and Backup Applications AD, GP, Security Familiar Windows UX Heterogeneous file serving Customer trust OEM and Microsoft Supported Solutions • When NAS? • Dedicated storage servers • Need iSCSI access to data • File serving via a SAN Gateway • Pre-configured HW for HA storage • No CAL environments • General Purpose File Server? • Reuse existing hardware • Multi-use needed (i.e. DC + files) • Running non file-related applications (SQL, Exchange, SharePoint) • License restrictions don’t fit your situation.

  12. Common Configurations Stand-alone initiator & target, single path HA & Multi-pathing: Application Server iSCSI Initiator Cluster heartbeat Ethernet Switch Windows Storage Server 2008 iSCSI Software Target 3.2 Cluster heartbeat Storage Backend

  13. WSS Partner Ecosystem is growing!

  14. NAS Quality Awards These products were included in the Quality Awards for NAS IV survey. • BlueArcCorp. Titan 1100, Mercury 50/100 • Dell Inc. PowerVault NF100/NF500/NF600, NX300/NX1950/NX3000/NX4 (60) • EMC Corp. Celerra NX4, NS-120 (53) • Hewlett-Packard (HP) Co. ProLiant DL Storage Servers, StorageWorks Network Storage System X1000/X3000 (63) • Hitachi Data Systems Essential NAS Platform 1000 Series (13) • IBM Corp. N3000/N5000 (38) • LSI Corp. (formerly ONStor) Cougar 3000 NAS Gateway • NetApp FAS200/FAS900, FAS2000 (all with NAS interface) (69) • Overland Storage Inc. (formerly Adaptec) Snap Server 620/650 • Panasas Inc. ActiveStor 7 Series/8 Series • Silicon Graphics Inc. (SGI) InfiniteStorage NAS2000/NAS3000, NEXIS 2000/NEXIS 7000 • Sun Microsystems Inc. StorEdge 5210/5220, Sun Storage 7110/7210/7310 Unified Storage System (28)

  15. Award Winning Solutions! NetApphas been nudged aside by Hewlett-Packard (HP) Co., among midrange vendors Windows Storage Server solutions built by HP and Dell were the #1 and #2 rated Midrange NAS solutions per a recent Storage Magazine survey Storage Magazine:http://searchstorage.techtarget.com/storageMagazine/images/vol9iss1/p.30.pdf

  16. Large SM/Small Enterprise Large SMB/Enterprise Small/Remote/Departmental Integrated HA Solutions XP/EVA/MSA/LHN Gateways Standalone Unified Systems HP StorageWorks X1000/X3000 Network Storage Systems X3000 WSS2008 Enterprise Edition WSS2008 Standard Edition X1800 X1800sb X3820 2-node X3800sb Gateway X3800 Gateway X1000 X3420 2-node X1400 X1600 X3400 Gateway Includes HP ASM X3410 1-node Clustering standard 17

  17. Dell NAS:NX3100NX3000NX300

  18. AberDeen

  19. Buffalo • TeraStationIII WSS network attached storage solution. Features four quick-swap SATA hard drives, heavy-duty power supply, and redundant RAID technology. 

  20. Performance Characterization (FSCT) • File Server Capacity Tool (FSCT) • Free download • Simulate user activity for file servers • Provides stress test capabilities to identify bottlenecks in test configurations • Leveraged within Microsoft to test performance characterization • Testing shows between 20-30% scalability improvements between Windows Server 2008 and Windows Server 2008 R2 on same hardware • Improvements in the SMB Protocol, TCP and the Storage Stack

  21. FSCT TESTBED – 24 HDD W2K8+SP2 (4500+ Users) CPU: 11.22% Memory: 44% Disk: 112 MB/s Network: 121 MB/s W2K8R2+Optimized (7500+ Users) CPU: 28.40% Memory: 58% Disk: 167 MB/s Network: 183 MB/s W2K8R2-RTM (6500+ Users) CPU: 25.1% Memory: 52% Disk: 147 MB/s Network: 161 MB/s W2K8R2+Optimized Windows Server 2008 R2 W2K8R2-RTM Windows Server 2008 R2 RTM W2K8+SP2 Windows Server 2008 + SP2 • Disks: 24 RAID-10 (Single Controller Pair) • CPU: 1 x X5560 2.8GHz • Memory: 16GB • HBA: 1 x 8Gb FC • Network: 1 x 10G • Disk IO bottleneck

  22. FSCT TESTBED – 96 HDD W2K8R2+Optimized (16500+ Users) CPU: 48.30% Memory: 17% Disk: 419 MB/s Network: 457 MB/s W2K8R2-RTM (12500+ Users) CPU: 21.60% Memory: 34% Disk: 312 MB/s Network: 343 MB/s W2K8+SP2 (7500+ Users) CPU: 12.90% Memory: 17% Disk: 179.57 MB/s Network: 197.84 MB/s W2K8R2 Windows Server 2008 R2 W2K8R2-RTM Windows Server 2008 R2 RTM W2K8+SP2 Windows Server 2008 + SP2 • Disks: 96 RAID-10 (Single Controller Pair) • CPU: 2 x X5560 2.8GHz • Memory: 72GB • HBA: 2 x 8Gb FC • Network: 1 x 10G • Disk controller bottleneck

  23. FSCT TESTBED – 192 HDD 23000Users CPU: 63.10% Memory: 23% Disk: 601 MB/s Network: 650 MB/s • Disks: 192 RAID-0 (Dual Controller Pair) • CPU: 2 x X5560 2.8GHz • Memory: 72GB • HBA: 4 x 8Gb FC • Network: 2 x 10G • Bottleneck not analyzed

  24. Software Configuration for FSCT - Optimized • Performance Tuning Guidelines for Windows Server 2008 R2 • Additional 10% performance for 8.3 names/aliasing • Server Configuration • AdditionalCriticalWorkerThreads • Default Value: 0x0 (0) • Modified Value: 0x32 (50) • MaxThreadsPerQueue • Default Value: 0x0 (0) • Modified Value: 0x32 (50) • Client Configuration • DormantFileLimit • Default Value: 0x0 (0) • Modified Value: 0x1 (1) • DisableLargeMTU • Default Value: 0x0 (0) • Modified Value: 0x1 (1) • FSCT users step = 500 • Power setting to high, unjoin domain, Disable BFE, IPSec, ISATap, IPv6, Antivirus & Indexing • FSCT file set creation & restore • 100MB/user, ~30,000 users = 10hrs • Accelerating the file set restore

  25. Windows Storage Server Features…

  26. Initial Configuration Tasks New title, icon, header Default tasks hidden Custom OEM section

  27. Single Instance Storage • TransparentVolumes de-duped to save disk space in acommon store folder. On first-write are moved back to the original location. • FastLow server overheadFiles are written immediately and evaluated later Reparse points and sparse files for links. • UsefulRemote administration via cmd line • WMI scripting supported • Ability to undo single instancing • ScalableScales to 128 volumes including clustersTested with 2.2 million duplicates on volumes with 5.6 million files, 10,000 duplicates of each file while reading and writing 35,000 files.

  28. Microsoft iSCSI Software Target iSCSI: An Internet Protocol (IP) based storage networking standard for linking data storage facilities. iSCSI Targets are instances of hard disk storage that connect over IP or Ethernet networks. Targets listen to initiator commands and perform the required I/O. iSCSI Initiator iSCSI Software Target Gigabit Ethernet Switch

  29. iSCSI Software Target and Hyper-V Microsoft iSCSI Software Target LUN 2 LUN 3 LUN 1 Hyper-V ParentPartition ChildPartition iSCSI iSCSI iSCSI Y:\V2\V2.VHD  VHD2 VHD2  E: LUN 1  Y: Uses Storage Data Path LUN 2  F: LUN 2 pass-through LUN 3  G: Uses Network Data Path

  30. Remote Administration Terminal Shell HyperTerminal with a serial cable for full command-line support Remote Desktop MSTSC.exe RDP with a Browser Point browser to: http://servername/desktop Tested with: Red Hat Enterprise Linux SUSE Linux Enterprise Server 10 Java Runtime Environment 6 Firefox v3

  31. The Future of Windows NAS… ?

  32. Introducing Windows Storage Server 2008 R2 ANNOUNCING

  33. iSCSI Software Target 3.3 • PowerShell cmdlets! • Differencing VHDs: Golden Masters • Diskless Servers • HPC boot • Performance improvements using new thread model • Scalability improvements, including 75% more cluster resources • Improved Snapshots, Local Mount • SCOM Management Pack • Quality Metrics • Support for dynamic disks

  34. High Performance Clusters – iSCSI Booting • Boot huge clusters off of a single iSCSI Target using PXE, gPXE and iSCSI Differencing VHDs • A single golden master and multiple differencing VHDs that are created in ~ 2 minutes. • Reference Testingon 128 Nodes:

  35. Manageability User Assistance • Core Engineering Criteria • PowerShell cmdlets • Best-Practice Analyzers • Software Quality Metrics • Management Packs • Certified for Windows • Documentation and Collateral • OEM Guide w/ extensibility • End-user Getting Started guides • Deployment and Planning Guides • Best Practices • Migration • Backup/recovery

  36. 2-Node Cluster OOBE SIS • Create a 2-node cluster in 30 minutes, instead of 3 hours! • One console experience: • EULA • Region and language settings • Join the domain on both nodes • Prepare shared disk access • Create the cluster • Prepare resource groups • Validate cluster setup • Bring the cluster online • PowerShell Support! • SCOM Management Pack • Clustering Improvements • Scales to 128 Volumes • Mini-Filter Implemented

  37. 2-Node Cluster Setup Problems Solved: Sysprep doesn’t support clustering MSOOBE doesn’t initiate Network Clusters don’t auto-replicate settings Provisioning storage and starting a cluster couldn’t be done from a single node.

  38. 2-Node Cluster OOBE • Technologies used: • Image File Execution • Remote Application • PowerShellRemoting DEMO

  39. Windows Storage Server Platform • Based on 2008 R2 OS. (Standard and Enterprise) • Languages Supported: English, Chinese – Simplified , Chinese – Traditional, German, Spanish, French, Italian, Japanese, Korean, Russian. New: Brazilian-Portuguese (11 languages total) • Product Keys: Regular OS keys and OEM Activation • Licensing: Embedded • In-place Upgrade: Not available from WSS 2003 or 2008 • Migration: • Storage Server Migration TechNet Page • iSCSI PowerShell Migration • Windows Server Migration ToolsPowershell scripts to quickly Migrate File Services, Print Services, Branch-Cache, file data and shares, IP configuration data, and local users and groups.

  40. Windows Server 2008 R2 • Why deploy Windows Server 2008 R2 file servers? • Windows Server 2008 R2 offers a low acquisition cost file serving platform, while reducing operational and management costs. Cost effective • Windows Server 2008 R2 delivers high performance and scalability for the largest of enterprise data centers, while offering optimizations for small offices and branches. Enterprise ready platform • Windows Server 2008 R2 enables easy collaboration across Windows and non-Windows clients, Microsoft and 3rd Party infrastructure. Better Together

  41. Windows Server 2008 R2Cost Effective • Acquisition Costs • Up to 4 times less expensive compared to a proprietary appliance* • Operational Costs • Up to 60% bandwidth savings compared to Windows Server 2008 through BranchCache™ • Up to 20% energy savings compared to Windows Server 2003 R2 due to power optimization • Management Costs • Introducing Policy based classification, quota & file management with File Classification Infrastructure (FCI + FSRM) • Expire files • RMS protect files • Simplified Cluster setup is 10X reduction compared to Windows Server 2003 R2 * InfoWorld article : http://akamai.infoworld.com/Network_Appliance_FAS2020/product_91714.html?view=1&curNodeId=61 ** http://technet.microsoft.com/en-us/library/dd335038.aspx ** http://download.microsoft.com/download/4/5/9/459033a1-6ee2-45b3-ae76 a2dd1da3e81b/Windows_Server_2008_Power_Savings.pdf

  42. Windows Server 2008 R2Enterprise-ready • Scalable and reliable • Faster browsing & access to shares - 60000 DFS-N links supported (12x) • 264files and shares supported • High Performance • Up to 10X file access performance than WS ’03 R2 environments (SMB 2.1) • Faster remote file transfers with 16 concurrent file downloads (DFS-R) • 4x WS ‘03 environments • Branch Ready • Reduction in bandwidth with BranchCache™ • Enhanced Security • RODC support • Reduced SMB attack surface

  43. Windows Server 2008 R2 Better Together • Windows & Non-Windows Clients • No manual configuration needed to support access for UNIX clients • Single identity mapping solution with Active Directory® to map Windows and non Windows clients • Microsoft infrastructure • Active Directory® • Forefront® • System Center® • Data Protection Manager • 3rd Party Infrastructure • Rich ISV and IHV eco-system • Antivirus, Backup, Replication • Hierarchical storage management

  44. Server Message Block (SMB)Fast and efficient remote file access Windows File Services Technologies Network File System (NFS)Remote file access for heterogeneous file serving Data Access DFS-NVirtualized namespaces Offline filesAllow roaming/mobile users to access files BranchCacheBandwidth savings for clients accessing the WAN Data Movement DFS-REfficient replication engine Folder RedirectionCentralized data management and protection File Server Resource Manager (FSRM)Control data and monitor storage resources Data Management File Classification Infrastructure (FCI)Manage cost and risk through classification and policies

  45. Windows File Services – DFS and BranchCache Branch Office (Local Server) Head Office Centralize User Data (DFS-R) BranchCache Hosted Cache Publish Content (DFS-R) NFS Folder Redirection/ Offline Files • Data Management • Quotas • File Screens • Classification Win 7 MAC OS Win 7 Virtual Namespaces (DFS-N) HA File Servers Branch Office (Serverless) Win 7 Win 7 BranchCache Peer to Peer Win 7

  46. Multi-threaded Robocopy • With 128 threads, Robocopy is now 3-22 times faster than Explorer on high-latency (WAN) connections • Syntax: robocopy /mir /mt:128 /log:nul Lower is better

  47. Windows SMB 2.1! • SMB 2.1 Greatly Increases Scalability • Number of open files and shares • SMB 2.1 Protocol Improvements • Reduced “chattiness” • Symbolic links • Durable handles • SMB 2.1 Server and Client must match to get the best benefit More Secure Greater Scalability Compound Packets Increased Buffer Sizes Symbolic Links Durable File Handles

More Related