WS2012 File System Enhancements: ReFS and Storage Spaces

1. WSV316 WS2012 File System Enhancements: ReFS and Storage Spaces Rick Claus Sr. Technical Evangelist @RicksterCDN http://RegularITGuy.com

3. The Storage and File Systems (SFS) group builds the platform storage features shipping across all versions of Windows

4. Storage Platform Overview Benefit Capability Feature • Maximize data availability • Modern NTFS CHKDSK • Next-generation scale, availability, and integrity • Resilient File System (ReFS) Maximize Availability Minimize Cap-Ex • Storage virtualization and resiliency • Storage Spaces • Ease of storage administration • Storage Management PowerShell with SMI-S integration Minimize Op-Ex Maximize Existing Hardware • Efficient capacity utilization • Thin provisioning integration • Dynamic data movement • Offloaded data transfers

5. Enabled Deployment Models SAS SAS FC iSCSI FC iSCSI CA File Servers App Servers App Servers CA File Servers App Servers App Servers JBODS JBODS \db \db File File

6. Windows Server 2012 is the most cost-efficientplatform for continuously available and highly scalable data access

7. Storage Virtualization and Resiliency Storage Spaces

8. Storage Spaces delivers a new category of highly capable storage solutions to all Windows customer segments at dramatically lower price-points and maximized operational simplicity

9. Cost-Efficient Business Critical Storage • Powerful new platform abstractions • Storage pools: Units of aggregation, administration, isolation • Storage spaces: Resiliency, provisioning, and performance • Industry standard commodity storage • Interconnects: SAS, USB, and SATA • Enclosures: Shared SAS JBOD arrays

10. Storage Spaces Model Physical orVirtualized Servers Windows Server 2012 Capabilities File and Storage Manager ReFS & NTFS SMB v3 RDMA Failover Clustering & CSV v2 Hyper-V Storage Mgmt. PowerShell Virtualized Resilient Storage Parity Space Mirror Space Parity Space Mirror Space Parity Space Mirror Space Mirror Space Mirror Space Mirror Space Mirror Space Parity Space Mirror Space Cost-efficient shared SAS JBOD arrays

11. Physical Deployment Topologies Shared SAS OR SAS

12. Capabilities Overview

13. Optimized and Flexible Capacity Utilization • On-demand provisioning with automated capacity reclamation (trim/unmap) • Capacity reclamation for deleted files (NTFS and ReFS) • Sub-file capacity reclamation (e.g. through Hyper-V) • Scheduled optimization for slab reclamation • Elastic capacity expansion • Simply add more drives Thinly provisioned storage spaces Company A Storage Pool Company A Storage Pool 60TB Space 60TB Space 60TB Space 60TB Space 60TB Space 60TB Space 60TB Space 60TB Space Industry standard commodity storage 36 TB across 72 disks 48 TB across 96 disks

14. Resiliency to Drive Failure • Resilient storage • Mirror spaces with dirty region tracking • Parity spaces with integrated journaling • Rapid recovery via per-pool hot spares Resilient Spaces Industry standard storage Mirror Space Parity Space Mirror Space Mirror Space Mirror Space Parity Space Mirror Space Mirror Space Hot Spare

15. Operational Simplicity • Managed via Storage Management PowerShell • Enclosure awareness • Flexible and granular administrative control with self-service agility and tenant isolation Granular management control Company A Pool Company B Pool Workload Admin Workload Admin Simple Space Mirror Space Parity Space Simple Space Mirror Space Parity Space Tenant Admin Tenant Admin Multi-tenant deployment Hoster Admin

16. Effectively Utilize Hardware Investment • Enables mixed deployments • Utilize both SSD and HDD media types • Control placement at storage space granularity Diverse spaces for diverse workloads Gold Silver Bronze Home Space Archive Space Finance Space ERP Space Industry standard commodity storage Solid state 15K RPM 7200 RPM

17. Standalone Server • Low number of individual servers, each with directly-attached storage • Acceptable periods of planned downtimes for traditional maintenance Storage spaces with a diverse set of workloads Space Space Space Standalone Deployment

18. Standalone Configuration Standalone Dell R710 server with dual LSI 9205-8e SAS adapters Dell MD1200 12-bay JBOD array with 300GB 15K RPM disks

19. Performance of a Well-tuned Standalone System

20. Clustered Storage Spaces Deployment Element • Building block for scalable, highly available deployments • Easily expandable through additional DeploymentElements • Can move HA workload off a cluster node for maintenance without disruption • Live Migration for running VMs • Simple “Move” Operation for others Enterprise Workloads \CRM Unified Cluster Shared Volume Namespace Clustered Storage Spaces Space Space Space 2-4 servers Shared SAS storage Deployment Element

21. Scalable and Continuous Availability Logical View (Highly available, scalable, cost-efficient) .\VHD .\db .\Home Enterprise Workloads CA File Server \CRM \Finance \File-Shares Unified Cluster Shared Volume Namespace Deployment Element Deployment Element VMs Clustered Pools and Storage Spaces Space Space Space Space Space Space Space Space Space Physical View (64 servers max) 2-4 servers Shared SAS storage Deployment Element

22. Representative Deployment Element 60-bay SAS array 60-bay SAS array 60-bay SAS array 60-bay SAS array 3TB Near-line SAS HDDs 600GB 15K SAS HDDs 400GB SAS SSDs 144TB Mid-Perf 96TB High-Perf 720TB High-Cap

23. 64 Node Cluster

24. Storage Spaces delivers a new category of highly capable storage solutions to all Windows customer segments at dramatically lower price-points and maximized operational simplicity

25. Next-generation scale, availability, and integrity Resilient File System (ReFS)

26. ReFS is a new file system delivering on demanding customer needs while providing a foundation for significant future innovations. Windows Server 2012 customers can deploy the most cost-efficientplatform for available and scalable data access using commodity storage, by utilizing an integrated storage stack comprising ReFS and Storage Spaces.

27. ReFS Overview (1/2)

28. ReFS Overview (2/2)

29. Integrity

30. ReFS and Storage Spaces With ReFS, Scrubber verifies checksums on all copies and auto-corrects as needed Scrubber With NTFS, Scrubber verifies all copies can be read Data Volume - NTFS Data Volume - ReFS CHK CHK CHK Data Data Data Data Data Data Copy0 Copy1 Copy2 Copy0 Copy1 Copy2 Checksum is inspected on all copies of the data If corruption detected, trigger auto-correct and return a healthy copy of the data On media failure, NTFS will get an alternate copy of the data Mirror Space Mirror Space Storage Pool

31. ReFS Auto Correction Application accesses data ReFS volume detects corruption and automatically replaces the corrupt data with correct data ReFS Mirror space offers all data copies to the file system

32. Scalability

33. Application Compatibility • While delivering on new capabilities, ReFS also builds on NTFS’ 20 years of application compatibility • ReFS largely reuses the upper-layer to provide API compatibility to applications while providing a new on-media engine that enables new capabilities Upper API Layer Upper API Layer On-media Store MinStore NTFS.SYS ReFS.SYS

34. Application Compatibility • ReFS supports the majority of the Win32 APIs • However, there are certain features that ReFS does not support • Legacy • Short Names • TxF • NTFS-specific • Reparse Index • Named Streams • MFT • Other • Hard Links           • Extended Attributes • Object IDs • Superseded • NTFS Encryption • NTFS Quotas • NTFS Compression

35. ReFS Deployments • Deployable on cost-efficient commodity hardware • Optional integrity streams guarantee user data integrity • Storage Spaces provides resiliency against media failure • Failover Clustering provides high availability for File Server • Considerations • Only available with Windows Server 2012 • Can only be deployed as a data volume • Does not guarantee the same level of application compatibility as NTFS \VHDs \Home \Docs VHDs Mark’t Dept. Home Dirs VHD Library Highly Available File Server ReFS volumes with integrity streams Clustered Storage Spaces Space Space Space 2-4 servers Shared SAS storage Deployment Element

36. ReFS is a new file system delivering on demanding customer needs while providing a foundation for significant future innovations. Windows Server 2012 customers can deploy the most cost-efficientplatform for available and scalable data access using commodity storage, by utilizing an integrated storage stack comprising ReFS and Storage Spaces.

37. Storage Platform Overview Benefit Capability Feature • Maximize data availability • Modern NTFS CHKDSK • Next-generation scale, availability, and integrity • Resilient File System (ReFS) Maximize Availability Minimize Cap-Ex • Storage virtualization and resiliency • Storage Spaces • Ease of storage administration • Storage Management PowerShell with SMI-S integration Minimize Op-Ex Maximize Existing Hardware • Efficient capacity utilization • Thin provisioning integration • Dynamic data movement • Offloaded data transfers

38. Windows Server 2012 is the most cost-efficientplatform for continuously available and highly scalable data access

39. Some Windows Storage Resources • Virtualizing Storage for Scale, Resiliency, and Efficiency • http://go.microsoft.com/fwlink/?LinkID=254536 • How to Configure Clustered Storage Spaces in Windows Server 2012 • http://go.microsoft.com/fwlink/?LinkID=254538 • Storage Spaces FAQ • http://go.microsoft.com/fwlink/?LinkID=254539

40. © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.