1 / 50

Hyper-V Storage

Hyper-V Storage. Senthil Rajaram Senior PM Microsoft Corporation. agenda. Deep Dive - Existing and New Options Virtual Storage Stack Improvements Example Configurations. Survey:. Top Impediment To Increased Virtualization? Memory Network Storage CPU . 35 %. 27 %. 45 %. 0 %.

kayla
Download Presentation

Hyper-V Storage

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hyper-V Storage Senthil Rajaram Senior PM Microsoft Corporation

  2. agenda • Deep Dive - Existing and New Options • Virtual Storage Stack Improvements • Example Configurations

  3. Survey: • Top Impediment To Increased Virtualization? • Memory • Network • Storage • CPU 35 % 27 % 45 % 0 %

  4. Hyper-V Enables Multiple Storage OptionsAt Flexible Price-Performance Points That Offer Continuously Availability & High Scalability

  5. Hyper-V & Shared Storage • More Options For Hyper-V Storage Deployments External Storage Arrays New for Windows Server 2012 Remote File Servers Storage Spaces Clustered PCI RAID

  6. Hyper-V Storage Light Up External Storage Arrays

  7. Virtual Fibre Channel • Extends Fibre Channel Into VM’s • High Performance Workloads • Guest Clustering • Exposes SAN Functionality • Utilizes NPIV Functionality • Support • Host: Windows Server 2012 • Updated NPIV HBA driver • Guest: >= Windows Server 2008 • Live Migration Just Works Hyper-V Server VM VM WWN WWN vHBA vHBA NPIV HBA LUN External Storage Array

  8. Virtual Fibre Channel and Live Migration WWPN A: C0:03:FF:78:22:A0:00:14 WWPN B: C0:03:FF:78:22:A0:00:15 WWPN A: C0:03:FF:78:22:A0:00:14 WWPN B: C0:03:FF:78:22:A0:00:15 1. Create A Temporary VM On Destination Hyper-V Server 2. Connect Temporary VM’s HBAs To FC Fabric Using WWPN B 3. Verify Temporary VM Has Connectivity To Shared Storage 4. Complete Normal VM Live Migration (copy memory etc..) Limit IO Queue Depth To 1 5. Pause Source VM 6. Change Temporary VM To Permanent VM and Start IO 7. Logout of FC Fabric and Delete Source VM Live Migrate Shared Storage

  9. Hyper-V Storage Virtual Fibre Channel Senthil Rajaram Senior PM Microsoft Corporation

  10. Increased Storage Efficiency – Unmap • Unmap • Storage Informed Of Unused Space • Efficiencies At Virtual Layer • Allows Reuse Of Unused Blocks • Efficiencies At Physical Layer • VMs Unmap Passed To Hardware • Supported On • VHDX & PassThru Disks • Virtual SCSI or Virtual Fibre Channel Hyper-V Host VM VHD Stack VHDX External Storage Array

  11. Hyper-V Storage Unmap Integration Senthil Rajaram Senior PM Microsoft Corporation

  12. Offloaded Data Transfer (ODX) • Traditional Data Copy Model • Server Issues Read Request To SAN • Data Is Read Into Memory • Data Is Written From Memory To SAN • Problems • Increased CPU & Memory Utilization • Increased Storage Traffic • Inefficient For SAN Hyper-V Host VHD Stack External Storage Array LUN1 LUN2

  13. Offloaded Data Transfer (ODX) • Offload Enabled Data Copy Model • Server Issues Offload Read Request To SAN • SAN Returns Token Representing Request • Server Issues Write Request To SAN Using Token • SAN Completes Data Copy Internally • SAN Confirms Data Was Copied • Reduce Maintenance Time • Merge, Mirror, VHD/VHDX Creation • Increased Workload Performance • VM’s Are Fully ODX Aware and Enabled Hyper-V Host VHD Stack Token Token External Storage Array LUN1 LUN2

  14. Hyper-V Storage ODX Integration Senthil Rajaram Senior PM Microsoft Corporation

  15. Hyper-V Storage New Storage Options

  16. SMB File Storage • Supports All Existing Scenarios • Enables New Scenarios • Shared Nothing LM • Cross-Cluster LM • Requires SMB 3.0 Hyper-V Host VM VM Share1 VHD VHDX File Server • VIR304-Building Flexible Hyper-V Env… • VIR306-Hyper-V over SMB

  17. Handling Intermittent Network Failure • Resiliency: • Transparently Re-establishes Network Connection Hyper-V Host 1 Normal Operation X Temporary Disconnect X 3 1 \\FS\Share • File Server Connections & Handles Re-established Application Does Not Receive IO Error 3

  18. Handling Permanent Network Failure • Multichannel: • Transparently Uses Alternate Network Path Hyper-V Host 1 Normal Operation X 3 1 1 X Permanent Disconnect \\FS\Share • File Server Connections & Handles Failover, Application Does Not Receive IO Error 3

  19. Handling File Server Node Failure • Continuous Availability • Transparently Fails Over Share To Different File Server Hyper-V Host 1 Normal Operation 1 3 Clustered \\FS\Share \\FS\Share Failure of File Server, Share Failed Over To New Node X X • File Server Node B • File Server Node A Connections Re-established, Application Does Not Receive IO Error 3

  20. Handling Hyper-V Node Failure • Cluster Client Failover (CCF) • VMs communicate identity • Enables Quick Recovery Clustered Hyper-V Host A Hyper-V Host B X 1 3 1 Normal Operation Hyper-V Host Failure, VM Starts On Different Hyper-V Node X \\FS\Share File Server Stale Handles Shot Down, New HandlesOpened Without Delay 3

  21. Host based Backup And Restore • Virtual Shadow Service For SMB • No Change in Flow For Backup Hyper-V Host VSS Service Backup Agent Remote VSS Provider \\FS\S1 \\FS\S1~ Snap File Server Remote VSS Agent VSS Service/ Provider

  22. Performance • SMB Direct (SMB over RDMA) • Minimal CPU utilization for I/O processing • High Throughput With Low Latency • SMB MultiChannel • Active – Active Configuration

  23. Setup & Administration • Management - Hyper-V & SMB PowerShell • Full Permissions On SMB Share & NTFS Folders • Hyper-V Host Machine-Accounts • VM Administrators

  24. Storage Spaces • Inbox Solution Provides • Pooling • Thin provisioning • Resiliency • Simple Space • Mirror Space • Parity Space Hyper-V Host Pool Space Space JBOD • WSV327-Vast Storage Capabilities for Everyone

  25. Storage Spaces & Clusters • Cluster Supports Spaces • Not For Parity Spaces • Simple • Direct IO from all Nodes • Mirrored Space • CSV Redirection From Non-Owning Nodes • Use Low Latency Network (10G or RDMA) For Cluster Network Clustered Hyper-V Host Hyper-V Host S-Space S-Space CSV M-Space M-Space Shared JBOD SAS

  26. Clustered PCI RAID • Host Hardware RAID In A Cluster • Resiliency To Node Failure • LUN Fails Over • Resiliency To Disk Failure • RAID Clustered Hyper-V Host Hyper-V Host CSV SAS PCI RAID PCI RAID LUN Shared JBOD SAS • WSV310-Cluster-in-a-Box, RDMA, and More

  27. Hyper-V Storage Virtual Storage Stack Improvements

  28. VHDX The New Default Format for Virtual Hard Disks Up To 64 TB MB Alignment Internal Log Enhanced Perf Embed Custom Metadata Larger Block Sizes User Defined Metadata Large Sector Support Enhanced Resiliency Larger Virtual Disks

  29. VHDX Performance - 32KB Random Writes IOPS Queue Depth 16

  30. VHDX Performance - 1MB Sequential Writes MB/S 25% 25% Queue Depth 16

  31. Large Sector Support • Advanced Format/Large Sector Disk Types: • Physical Media 4K • 512e • Emulated 512-byte Logical Interface • Read-Modify-Write ( RMW ) • 4K Native: • Exposes 4K Interface Directly 512B Hardware 4K 4K Hardware 4K

  32. Large Sector Support – 512e Disks • Sub-Optimal Performance For Existing VHDs ~30% • 512b structures - Sector Bitmap, Header, Footer Parent Locators • Hardware Read-Modify-Write • Windows Server 2012 • New VHDs 4K Aligned - Padding • Better Performance, Reduced Need For RMW • No Auto Align For Existing VHDs Hyper-V Host VM 4K Aligned Offset LegacyVHD VHD Aligned F(Off)+4 KB Unaligned F(Off)+512b Hardware RMW 512e Disk

  33. VHD Performance on 512e IOPS IOPS 40% 6000% 6000%

  34. Large Sector Support – Native 4K Disks • Windows Server 2012 Supports Native 4K Disks • Software Read-Modify- Write • 512b Logical Sector Virtual Disk • Performance Penalty For RMW • 4K Logical Sector VHDX • No Performance Penalty Hyper-V Host VM 512 4K 512 VHDX VHDX VHD Software RMW 4K 4K 4K Native 4K Disk

  35. Reduce Downtime - Online MetaOperations • Reclaim Deleted Snapshot Space • Online Virtual Disk Merge • VM Storage Mobility • Online Virtual Disk Mirror • Quick Deployment • Online SetParent

  36. Hyper-V Storage Reclaim Deleted Snapshot SpaceQuick VM Deployment Senthil Rajaram Senior PM Microsoft Corporation

  37. IO SCALING • IO Throughput Was Limited By • 1 Channel Per VM • Fixed VP For IO Interrupt Handling • 256 Queue Depth/SCSI, Shared For All Attached Devices • Windows Server 2012 • 1 Channel/16 VPs , Per SCSI • 256 Queue Depth/Device, Per SCSI • IO Interrupt Handling Distributed Amongst VPs Parent Partition VM Dev Virtual Storage Stack VM Dev Hyper-V Host

  38. Hyper-V Storage Scaling IO Senthil Rajaram Senior PM Microsoft Corporation

  39. Related Technologies • CSV Read Cache • Block Cache • Very Effective For VDI Boot Storm • Inbox De-Duplication Engine • Block Level De-Duplication • Very Effective For VHD Library Server • Not supported For Live VM Virtual Hard Disks

  40. Hyper-V Storage Example Configurations

  41. SAN Configuration Hyper-V Server Cluster Hyper-V Server Cluster SAN Virtual FC Virtual FC Shared Virtual Fibre Channel LUN Cluster Shared Volume Block Storage Fibre Channel or iSCSI Cluster Shared Volume Block Storage Fibre Channel or iSCSI

  42. File Share Configuration With Storage Spaces Hyper-V Server Cluster Hyper-V Server Cluster File Share File Share Cluster Shared Volume Cluster Shared Volume Storage Space Storage Space Windows Continuously Available File Servers Mulit-Channel SMB Mulit-Channel SMB Shared SAS JBOD Array(s)

  43. Two Server High Availability Hyper-V Server Cluster Cluster Shared Volume Cluster Shared Volume Cluster Shared Volume Cluster Shared Volume Storage Space Storage Space PCI RAID PCI RAID Hyper-V Server Hyper-V Server Hyper-V Server Hyper-V Server Shared SAS JBOD Array(s) Shared SAS JBOD Array(s)

  44. Related Content • Breakout Sessions

  45. Related Content Hands-on Labs (session codes and titles)

  46. Related Content Product Demo Stations (demo station title and location) Find Me Later At…

  47. SIA, WSV, and VIR Track Resources #TEVIR301 Talk to our Experts at the TLC Hands-On Labs DOWNLOAD Windows Server 2012 Release Candidate microsoft.com/windowsserver DOWNLOAD Windows Azure Windowsazure.com/ teched

  48. Resources Learning TechNet • Connect. Share. Discuss. • Microsoft Certification & Training Resources http://europe.msteched.com www.microsoft.com/learning • Resources for IT Professionals • Resources for Developers • http://microsoft.com/technet http://microsoft.com/msdn

  49. Evaluations Submit your evals online http://europe.msteched.com/sessions

  50. © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

More Related