410 likes | 626 Views
Module 4: Storage in Windows Server 2012 R2. Rick Claus Microsoft Sr. Technical Evangelist Corey Hynes Lead Technical Architect, holSystems. Jump Start Target Agenda. Storage in Windows Server 2012 R2. Talk with our Experts in Chat tool. #WS2012R2JS. Hands-On Labs.
E N D
Module 4: Storage in Windows Server 2012 R2 Rick Claus Microsoft Sr. Technical Evangelist Corey Hynes Lead Technical Architect, holSystems
Jump Start Target Agenda • Storage in Windows Server 2012 R2
Talk with our Experts in Chat tool. #WS2012R2JS Hands-On Labs DOWNLOAD System Center 2012 R2 Preview aka.ms/sc2012r2 DOWNLOAD Windows Server 2012 R2 Preview aka.ms/ws2012r2 http://www.microsoftvirtualacademy.com System Center 2012 R2 Jumpstart July 15th - http://aka.ms/SCR2JS
Agenda Introduction Make it real • Enterprise-class storage platform built on Windows • Simplified Storage Management • Protecting your data • Maximizing existing storage investments • Industry proof points and recommended configurations Get started • This presentation explores how Windows Server 2012 R2 Preview helps you build highly available and reliable storage solutions with cost-effective hardware, provides an overview of the greater variety of choices for deploying storage infrastructure, and highlights new storage and file system features in Windows Server 2012 R2 Preview.
Storage challenges Rapid data growth – over 20% per year Increasing storage costs Storage management Data protection Big data analytics
Storage changes are creating opportunities New options are decreasing the cost of high-performance, scalable network storage Customers are moving data to the cloud Recovery and the cloud is becoming a reality Three storage changes have already begun:
Scenario summary Enterprise-class storage platform built on Windows Simplified Storage management Protecting your data Maximizing existing storage investments Know the facts and get started
Just the facts Enterprise-class storage platform built on Windows ALWAYS ON,ALWAYS UP SERVICES Storage management SM-API (Enhanced in R2) Storage management with VMM(Enhanced in R2) Storage spaces with Tiering (Enhanced in R2) Application storage support with SMB 3.0 (Enhanced in R2) Data Deduplication (Enhanced in R2) SMB Direct (Enhanced in R2) Storage QoS (New in R2) Live Storage migration PowerShell support SMB multichannel SMB transparent failover Protecting your data Proof Points Maximizing existingstorage investments DPM Storage architecture with Microsoft stack Feature comparison across different Storage subsystems ODX Windows Azure backup File system enhancements Workload performance on Microsoft stack Customer Evidence Thin provisioning Hyper-V replica(Enhanced in R2) and Hyper-V recovery manager(New in R2) Performance and price-point comparison Virtual fiber channel
What did we want to accomplish? • Help customers reduce storage costs. • Build a scalable, high performance storage solution powered by Windows. • Build SAN like capabilities in the OS. • Help optimize SAN investments. • Simplify storage management and provisioning. • Innovate with partners. SAN
Enterprise-class storage platform built on Windows Storage virtualization with Storage Spaces File Server Enhancements Delivers enterprise-class performance. • Optimizes capacity utilization. Data Deduplication Performance and Reliability improvements Resilient to component failures. • Lowers the cost of acquisition, deployment, and operations.
ENTERPRISE-CLASS STORAGE PLATFORM BUILT ON WINDOWS Cloud deployment storage vision Hyper V SMB Scale out file server Storage space Storage space Storage space Block based storage Storage pool Storage pool Storage pool
ENTERPRISE-CLASS STORAGE PLATFORM BUILT ON WINDOWS Storage Spaces • Virtualization of storage with storage pools and storage spaces. • Storage resilience and availability with commodity hardware. • Data automatically tiered across memory, SSD and spinning disks. • Write-back cache to absorb spike in random writes. • Resiliency and data redundancy through n-way mirroring or parity mode. • Utilization optimized through thin and trim provisioning and enclosure awareness. • Integration with other Windows Server 2012 capabilities. • SSD, Serial Attached SCSI (SAS) and Serial AT Attachment (SATA) interconnects. Windows application server or file server Physical or virtualized deployments Integrated with otherWindows Server 2012 R2 Preview capabilities Management with PowerShell, server manager Hyper-V SMB multichannel Failover clustering NTFS, ReFS, NFS SMB direct Cluster shared volume Storage QoS Windowsvirtualizedstorage Storage space storage space Storage space Storage pool Storage pool SSD Tiered physicalstorage HDD (Shared) SSD, SAS or SATA
ENTERPRISE-CLASS STORAGE PLATFORM BUILT ON WINDOWS Hybrid storage pools & tiered storage Hot data • SSDs and HDDs used as different tiers in the same storage pool. • Windows automatically tracks data temperature and moves them at sub-file level. • Write-back cache improves performance for real-world workloads. • Only hot regions of a file (VHD, database, etc.) need to move to SSDs, the cold regions can reside on HDDs. • Ability to pin files to different tiers Cold data Tiered space Hybrid storage pool SSDs HDDs
ENTERPRISE-CLASS STORAGE PLATFORM BUILT ON WINDOWS Application storage support – SMB 3.0 Hyper-V cluster • SMB file shares for application storage • Clustered Windows Server configurations expose shared storage • Highly available, shared data store for SQL Server databases and Hyper-V workloads. • Increased flexibility, easier provisioning and management. • Near line rate performance for both small and large IOs. • Use existing storage and network investments. • Built-in encryption support. Microsoft SQL server SMB Single logical server \\foo\share File server cluster Single file system namespace Cluster shared volumes Windowsvirtualizedstorage Storage space Storage space Storage space SAN RAID array RAID array RAID array Storage pool Storage pool SSD Tiered physicalstorage HDD
ENTERPRISE-CLASS STORAGE PLATFORM BUILT ON WINDOWS SMB transparent failover SQL server • Provides continuous availability during failures of cluster nodes • Failover transparent to server applications with zero downtime and with only a small I/O delay. • Support for planned moves, load balancing, operating system restart, unplanned failures, and client redirection (scale-out only). • Resilient for file and directory operations. • All servers involved should have Windows Server 2012 and above. 1 Normal operation. \\foo\share Failover share – connections and handles lost, temporary stall of I/O. 2 \\foo1\share1 \\foo2\share1 • Windows Server file server cluster Connections and handles auto-recovered Application I/O continues with no errors. 3
ENTERPRISE-CLASS STORAGE PLATFORM BUILT ON WINDOWS File server optimizations • Per-share SMB scale-out • Finer grained load distribution. • Avoids unnecessary traffic redirection by managing SMB per share. • Optimized rebalancing of scale-out file server • Scale-out file server clients automatically redirected to best node. • SMB sessions redirected to node with best storage connectivity. • Dynamically maintained as volume ownership changes. • Automatically rebalances CSV and SMB shares based on traffic. Hyper-V host \\SOFS\Share2 SMB Scale-out file server File server 1 File server 2 Share1 Share2 Share1 Share2 Storage spaces
ENTERPRISE-CLASS STORAGE PLATFORM BUILT ON WINDOWS Efficient storage through Data Deduplication • Maximize capacity by removing duplicate data. • Works with live VHD/VHDX files on remote VDI storage. • Increased scale and performance. • Better VM performance in VDI scenario • Low CPU and memory impact. • Configurable compression schedule. • Transparent to primary server workload. • Improved reliability and integrity. • Redundant metadata and critical data. • Checksums and integrity checks. • Increase availability through redundancy. • Faster file download times with BranchCache. Operating system VHDs VHD library Software deployment share General file share 0% 20% 40% 60% 80% 100% Source: ESG Lab and Microsoft Internal Testing Average savings with data deduplication by workload type
ENTERPRISE-CLASS STORAGE PLATFORM BUILT ON WINDOWS Network fault tolerance with SMB multichannel SMB client SMB server Network • Automatic detection and use of multiple network connections between SMB client and server. • Helps server applications be resilient to network failure. • Transparent Failover with recovery of network failure if another connection is unavailable. • Improved throughput. • Bandwidth aggregation through NIC Teaming. • Multiple nodes/CPUs for network processing with RSS-capable network adapters. • Automatic configuration with very little administrative overhead. NIC NIC File copy File copy NIC NIC
So what platform capabilities do we have inbox? SMB client • Managing physical storage and storage virtualization • Application support on file servers • Parity, mirrored and simple configurations • Hardware offloading with SMB direct • Data dedup • Storage tiering, Write Back Cache • Transparent failover • SMB multichannel (MPIO equivalent) • Storage QoS • SMB encryption • Thin and trim provisioning • Storage live migration Reads and writes go to new destination VHD Hot data SMB client SMB server Network \\SOFS\Share2 Cold data File client File server Host running Hyper‑V Operating system VHDs Virtual machine Application Application App buffer App Buffer NIC NIC Scale-out file server File server 1 File server 1 File server 2 File server 2 File copy File copy SMB client SMB Client SMB server SMB Server VHD library SMB Buffer SMB buffer SMB buffer SMB Buffer Scale-out file server Share1 Share2 Share1 Share2 Spaces-based virtualized storage NIC NIC Transport protocol driver Transport Protocol Driver Transport Protocol Driver Transport protocol driver OS buffer OS buffer Software deployment share Source device Target device NIC driver NIC Driver NIC driver NIC Driver Driver buffer Driver buffer Tiered space Storage spaces General file share Block storage Hybrid storage pool VHD VHD rNIC NIC rNIC NIC SSDs HDDs iWARP Adapter buffer Adapter Buffer Adapter buffer Adapter Buffer 19 InfiniBand Source: ESG Lab and Microsoft Internal Testing Average savings with data deduplication by workload type
Improved operational efficiency through simplified manageability Enables consistent, repeatable, and reliable automation. • Comprehensive storage management with SMI-S support • Managing storage using VMM. • Windows PowerShell, Server Manager. Makes complex tasks easier to perform with a simple wizard-driven experience. • Provides a richer set of tools for IT pros and developers.
SIMPLIFIED STORAGE MANAGEMENT Unified storage managementSMI-S and WMI • Centralized storage management interface for administrators. • Supports management of diverse set of storage. • 10x faster disk/partition enumeration operations. • Enables storage spaces to be managed via System Center Virtual Machine Manager. Management software File server manager Third-party management application Microsoft System Center Storage management APIs Windows storage management API (Windows PowerShell and WMI) Pass-through API for extensibility (WMI) Storage management provider (SMP) interface Windows standards-based storage management services SMP: Third-party providers SMP: Storage spaces SMI-S hardware provider SMI-S hardware provider Proprietary transport and/or protocol Storage vendor hardware and software Storage array/RAID controller Storage array/RAID controller Storage array/RAID controller Industry standard storage
SIMPLIFIED STORAGE MANAGEMENT Storage managementwith System Center Virtual Machine Manager Storage discovery • SAN discovery: FC,iSCSI, SAS • NAS discovery: Self-contained NAS, NAS head. • File server discovery: Windows scale-out file server • SAN/NAS/file server discovery levels. • Level 0: Provider, subsystem (array), file server and all relevant associations. • Level 1: Storage pool, file share and all relevant associations. • Level 2: LUN, masking sets, initiator ports (array knows about), target ports, iscsi portal, file share ACLs, and all relevant associations. • Level 3: Physical disks and all relevant associations. Capacity management • Pool/volume/file share classification. • File share ACL management. • VM workload deployment to file shares. • Bare metal deployment of file server. • Creation of scale-out file server cluster. • Adding/removing file server nodes. • File share management. Scale-out file server deployment Spaces provisioning • Discovery of physical spindles. • Storage pool creation and deletion. • Mirror and Parity Spaces creation and deletion.
SIMPLIFIED STORAGE MANAGEMENT Diverse management options Server manager UI Management packs for Microsoft System Center include: • SMB. • NFS. • iSCSI. • Deduplication. • File server resource manager and File Classification Infrastructure (FCI). • DFS-N and DFS-R. Robust automation with Windows PowerShell and WMI Best Practice Analyzer (BPA) available for all components Improved SMB diagnosability • Get-Command –module [ ] • SMBshare • NFS • FileServerResourceManager • DFSN • Deduplication • iSCSITarget • Storage • FailOverClusters
PROTECTING YOUR DATA Protecting your data Makes applications resilient to underlying hardware failures. Provides low-cost, high availability solutions on cost-effective hardware. • Windows Azure backup. Data protection manager. Supports continuous availability across storage, networking, and Hyper-V. Protects data across the stacks File system enhancements. Hyper-V replica and Hyper-V recovery manager. StorSimple.
PROTECTING YOUR DATA Protecting your data Windows Azure backup StorSimple 10111001 10111001 10010010 10010010 • Datacenter protection • Server and workload protection Resilient file system and CHKDSK • Disk protection • File protection Hyper-V replica Data protection manager and Windows Azure backup Storage spaces System Center Data Protection Manager 2012 SP1 R2
PROTECTING YOUR DATA Protecting files and directories: File system enhancements NTFS improvements • Rapid recovery from file system corruption without affecting availability • Data corruption virtually eliminated through allocate-on-write • Period checksum validation of file system meta-data • Seamless data integrity protection Resilient File System (ReFS) CHKDSK • Rapid recovery from file system corruption without affecting availability. • Resilient against power outage corruption. • Periodic checksum validation of file system metadata. • Improved data integrity protection. • ReFS remains online during subdirectory reconstruction and knows where orphaned subdirectories exist andautomatically reconstructs them. • Ideal for file server volumes. • Seconds to fix corrupted data. • No offline time when used with CSV. • Disk scanning process separated from repair process. • Online scanning with volume and offline repair. Hours Source: “ESG Lab"
PROTECTING YOUR DATA Disk resiliency with storage spaces Simple • Data is striped across disks. Mirror • Data mirrored to a duplicate disk. • Two and three-way mirroring. • Mirrored configuration with clustering for workloads. Parity • Data striped to all-but one of the disks. The remaining disk contains a checksum bit enabling data to be generated for a failed disk. • Parity with clustering for archives.
PROTECTING YOUR DATA Online protection: StorSimple Applicationsin physical orvirtual servers F: StorSimple iSCSI Cloud Volume What is it Appliance that connects Windows servers to Azure storage in minutes with no application modification. Benefits Data tiered to Azure depending on usage patterns. Fast on-ramp to the cloud. Seamlessly integrates cloud based archive, backup, DR with primary storage. Reduce enterprise storage TCO by 60-80%. Ideal for File server workloads, SharePoint Archives, VM Archives
MAXIMIZING EXISTING STORAGE INVESTMENTS Getting the most out of your storage investments $ $ Maximize your SAN investments $ Offloaded Data Transfer (ODX) • Virtual fibre channel in Hyper-V Thin and trim provisioning
MAXIMIZING EXISTING STORAGE INVESTMENTS Offloaded Data Transfer (ODX) • Offloaded Data Transfer (ODX) • Token-based data transfer between intelligent storage arrays • Benefits • Rapid virtual machine provisioning and migration. • Faster transfers on large files. • Minimized latency. • Maximized array throughput. • Less CPU and network use. • Performance not limited by network throughput or server use. • Improved datacenter capacity and scale. Offload copy request Write request token Successful write result Token External intelligent storage array Actual data Token Virtual disk Virtual disk
MAXIMIZING EXISTING STORAGE INVESTMENTS Virtual Fibre Channel in Hyper‑V Access Fibre Channel SAN data from a virtual machine Hyper‑V host 1 Hyper‑V host 2 • Unmediated access to a storage area network (SAN) • Hardware-based I/O path to virtual hard disk stack • N_Port ID Virtualization (NPIV) support • Single Hyper‑V host connected to different SANs • Up to four Virtual Fibre Channel adapters on a virtual machine • Multipath I/O (MPIO) functionality • Supports Live migration Virtual machine Virtual machine LIVE MIGRATION Worldwide Name Set A Worldwide Name Set B Worldwide Name Set A Worldwide Name Set B Live migration maintaining Fibre Channel connectivity
Industry Proof Points and Recommended Configurations Understand performance, cost and features available with Windows based storage Recommended storage configuration for Hyper-V. • Feature comparison of various storage subsystems. Price-point comparison. Workload performance on Microsoft stack. Offer a wide range of choices to meet customer needs. Maximize returns on storage investments. Windows clusterin a box. Windows storage server.
INDUSTRY PROOF POINTS AND RECOMMENDED CONFIGURATIONS SAN vs. Microsoft solution feature comparison Traditional storage with FC/iSCSI storage array Windows file server cluster with storage spaces • Storage tiering. • Data deduplication. • RAID resiliency groups. • Pooling of disks. • High availability. • Persistent write-back cache. • Copy offload. • Snapshots. • Storage tiering. (new with R2) • Data deduplication. (enhanced with R2) • Flexible resiliency options. (enhanced with R2) • Pooling of disks. • Continuous availability. • Persistent write-back cache. (new with R2) • SMB copy offload. • Snapshots.
INDUSTRY PROOF POINTS AND RECOMMENDED CONFIGURATIONS Familiar deployment model Windows file server cluster with storage spaces Traditional storage with FC/iSCSI storage array Hyper-V compute nodes Hyper-V compute nodes FC/iSCSI (Block) SMB direct (File) Storage compute Storage compute EmbeddedCPUs and controllers (proprietary hardware) Windows file server cluster (commodity hardware) Shared SAS JBOD FC/SAS disk shelf FC/SAS disk shelf Shared SAS JBOD FC/SAS disk shelf Shared SAS JBOD
INDUSTRY PROOF POINTS AND RECOMMENDED CONFIGURATIONS Recommended configuration NIC SAS module NIC SAS HBA NIC R-NIC File server 2 SAS HBA SAS module R-NIC NIC NIC Switch 5 vNIC NIC SAS module Clients Switch 3 Switch 1 NIC SAS module vSwitch SMB 3.0 Client SMB 3.0 server NIC teaming Switch 6 Router NIC SAS module R-NIC R-NIC SAS HBA NIC Hyper-V host File server 1 SAS module NIC R-NIC R-NIC SAS HBA Clients Switch 4 Switch 2 JBODs File server cluster Hyper-V cluster Clients
INDUSTRY PROOF POINTS AND RECOMMENDED CONFIGURATIONS Windows cluster in a box Failover cluster Failover cluster Hyper-V Host Hyper-V Host Hyper-V Host Hyper-V Host Hyper-V host Hyper-V host Hyper-V host Hyper-V host • Appliance built on Windows Server 2012 R2 that supports continuous availability. • Pre-packaged, pre-connected –no additional setup required. • Direct attached JBODs connected through storage spaces or clustered RAID controller. • Ideal for a “Business-in-a-Box”, “Branch-in-a-Box,” or enterprise-level storage server solution. • Multiple vendors. Share Share Share Share Share Share Share Share VHDX VHDX VHDX VHDX VHD VHD VHD VHD Cluster in a box Cluster in a box File server File server File server File server Storage spaces RAID array RAID array RAID array Shared SAS
Cluster in a Box Design Considerations 1/10G E or Infiniband 1/10G E or Infiniband Network Network Server Enclosure x8 PCIe x8 PCIe • Flexibility • PCIe slots for flexible LAN options • External SAS ports for JBOD expansion • Office-level power, cooling, and acoustics to fit under a desk • Availability • At least one node and storage always available, despite failure or replacement of any component • Dual power domains Server A Server B • Simplicity • Pre-wired, internal interconnects between nodes, controllers, and storage 1/10G Ethernet cluster connect (through midplane) CPU CPU x8 PCIe x8 PCIe x4 SAS (through midplane) Storage Controller Storage Controller x4 SAS (through midplane) x4 SAS DataOn – DNS 9220 http://dataonstorage.com/cluster-in-a-box/ SAS Expander SAS Expander SAS Expander SAS Expander x4 SAS 1 1 23 23 0 0 B ports … … A ports External JBOD B ports A ports Additional JBODs …
INDUSTRY PROOF POINTS AND RECOMMENDED CONFIGURATIONS Windows Storage Server 2012 R2 • Windows Server for NAS appliances that are preconfigured and enterprise ready. • Ideal file-based storage solution that is fault tolerant, continuously available, scalable, and cost effective. • Workgroup and standard editions. • Multiple vendors.
Scenario summary Enterprise-class features delivered on cost-effective hardware. Storage solutions that deliver continuous application availability. Innovation with industry partners to maximize performance, scalability, and choice. Improved operational efficiency through simplified manageability. Flexible storage configurations for organizations of all sizes.
Talk with our Experts in Chat tool. #WS2012R2JS Hands-On Labs DOWNLOAD System Center 2012 R2 Preview aka.ms/sc2012r2 DOWNLOAD Windows Server 2012 R2 Preview aka.ms/ws2012r2 http://www.microsoftvirtualacademy.com System Center 2012 R2 Jumpstart July 15th - http://aka.ms/SCR2JS