520 likes | 720 Views
WSV430. Cluster Shared Volumes Reborn in Windows Server 2012. Subhasish Bhattacharya Program Manager Microsoft Corporation. Steve Wienfeld TMEA Microsoft Lead NetApp Corporation. Agenda Cluster Shared Volumes (CSV) in Windows Server 2012. Overview
E N D
WSV430 Cluster Shared Volumes Reborn in Windows Server 2012 Subhasish Bhattacharya Program Manager Microsoft Corporation Steve Wienfeld TMEA Microsoft Lead NetApp Corporation
AgendaCluster Shared Volumes (CSV) in Windows Server 2012 • Overview • What’s changed in Windows Server 2012 • New architecture • Performance enhancements • Improved Backup of volumes
What is Cluster Shared Volumes (CSV) • Clustered file system in Windows Server 2012 • Layer of abstraction above NTFS • All cluster nodes can read/write to the CSV volume • LUN ownership by node abstracted from application • Applications failover without drive ownership changes • No dismounting and remounting of volumes • Faster failover times (less downtime)
Flexibility • LUN - smallest unit of failover • Manageability • Multi-path • Masking several LUN’s CSV Helps Address Management ComplexityChallenges managing large numbers of LUN’s • Scalability • Complexity with drive letters • Capacity • Poor SAN space utilization
Cluster Shared Volumes as you know it TodayWindows Server 2008 R2 • First introduced in Windows Server 2008 R2 • Only supported Hyper-V workload • Focused v1 release targeted at enabling Hyper-V • Implemented as file system mini-filter • Intercepted and routed I/O
CSV Motivations for Windows Server 2012 • Expand CSV to more workloads • File Server in addition to Hyper-V • Improve Backup • Improved performance • Direct I/O for more scenarios • Support for Spaces storage virtualization • Multi-subnet support
New CSV ArchitectureWhat it delivers • Improved interoperability with file system mini-filter drivers • Better interoperability • Anti-virus software • Backup Software • Application consistent distributed backups • Removed external authentication dependencies • Improved performance and resiliency • No longer Active Directory dependencies • Support for memory mapped files • Allows volume encryption • BitLocker encrypted volumes • Integrated with new File System features • Support for Offloaded Data Transfer (ODX) • Spot-fixing integrated to do online correction
Under the hood CSV Architecture
Cluster Shared Volumes (CSV)I/O synchronization overview Metadata Simultaneous read/write access on all Cluster Nodes Server side metadata synchronization - Avoids I/O interruptions Read/Write Shared Storage Shared LUN VHD VHD VHD
When do Metadata Updates Occur • Virtual Machine • Creation/deletion • Power on/off • Mobility (live/storage migration) • Extending dynamic VHD • Renaming VHD • Backup - Snapshot creation
Coordination Node Node 1 Node 2 Node 3 CSVFS VM VM VM Share Share Share Server / SMB MUP/RDBSS/SMB MUP/RDBSS/SMB CSV File System Filter CSV Proxy File System CSV Proxy File System CSV Proxy File System NTFS CSV VolumeMgr CSV VolumeMgr Volume Manager CSV VolumeMgr LBFO/RDMA Disk Disk Storage Connection Broken or not present Direct I/O SAN
Simplified SetupConfiguring a CSV Disk • Failover Cluster Manager Storage view integration • “Cluster Shared Volumes” container removed • CSV integrated into Failover Cluster core feature • No longer needs to be explicitly enabled • Simple right-click to add to CSV • That’s it!
Single NamespaceConsistent view across the cluster • Single consistent file name space • Files have same name and path on any cluster node • Volumes exposed under “ClusterStorage” root directory • VolumeX directory name can be renamed
CSV NamespaceMount Points • Used custom reparse points in Win2008 R2 • Win2012 uses standard Mount Points • Delivers better interoperability with: • Performance Counters • System Center Operations Manager • Monitoring free space on CSV volumes • Better interoperability with backup software
CSV Proxy File System • CSV enabled volumes now appear as “CSVFS” • NTFS file system under the covers • Enables applications to be CSV aware • Ensures compatibility
demo Setting up Clustered Shared Volumes Subhasish Bhattacharya Program Manager Clustering and High Availability
Resiliency How CSV Enables Even Higher Availability
Fault Tolerant Application HandlesCSV Resiliency • CSV provides I/O fault tolerance • Transparently handles node, network, and HBA failures • CSVFS virtualizes file handles to applications • Volume Paused - I/O queued • Reopens “true” files handles and remaps the “virtual” handles • Volume Resumed – I/O completed • Failover is transparent to application!
I/O Connectivity Fault Tolerance I/O Redirected via network VM running on Node 2 is unaffected Coordination Node SAN Connectivity Failure VM’s can then be live migrated to another node with zero client downtime VHD
Node Fault Tolerance New Coordinator Node Node Failure VM running on Node 2 is unaffected Coordination Node Brief queuing of I/O while volume ownership is changed Volume relocates to a healthy node VHD
Network Fault Tolerance Metadata Updates Rerouted to redundant network VM running on Node 2 is unaffected Volume mounted on Node 1 Network Path Connectivity Failure Fault-Tolerant TCP connections make a path failure seamless VHD
demo Cluster Shared Volume Resiliency Subhasish Bhattacharya Program Manager Clustering and High Availability
Continuously Available Scale out File ServerFlexible storage choices for the private cloud • Cluster platform for a continuously available scale out file server • Cluster-wide client access point • Consistent cluster-wide file server configuration • CSV cluster-wide file system • Zero client downtime failover – both planned and unplanned downtime Accessing VHDs over SMB Hyper-V Cluster Single Logical Server (\\Foo\Share) Single File System Namespace File Server Cluster Cluster Shared Volumes
Maximized File System AvailabilityFrom Hours to Seconds … <3 sec of downtime • Disk scanning process separated from repair process • Online volume scanning • Volume offline only to repair • Based on number of errors to fix, not size of volume • Zero offline time with CSV • Chkdsk/Spotfix integrated
Performance Improved CSV Performance
Cluster Shared Volumes CachingImproved CSV I/O Performance • Windows Cache Manager integration • Buffered read and write I/O’s cached like traditional NTFS • CSV Block Cache • Read-Only cache for un-buffered I/O • I/O which is excluded from Cache Manager • Distributed cache consistent across cluster • Huge value for Pooled VM VDI scenarios • 512 MB recommended value • Disabled by default • No downtime to modify
demo Cluster Shared Volume Block Cache in action Subhasish Bhattacharya Program Manager Clustering and High Availability
Redirected I/O Less OftenCSV Optimizations • Direct I/O for more scenarios • Delivers faster I/O performance and lower network overhead • Direct I/O for all types of file opens • Buffered Reads and Writes • Better VM creation and copy performance • New algorithm for I/O redirection detection • Opportunistic Locking as distributed locking mechanism
Block Level I/O RedirectionHigh Performance fault condition I/O redirection VM VM Share Share Node 2 Node 1 Coordination Node CSVFS Server / SMB MUP/RDBSS/SMB CSV File System Filter CSV Proxy File System CSV Proxy File System Avoids traversing file system stack twice NTFS CSV VolumeMgr Volume Manager CSV VolumeMgr 2x performance over File System redirection LBFO/RDMA Disk Storage Connection Broken or not present
SMB 3.0 Performance ImprovementsInherit gains for CSV redirection performance • Improved Performance of refactored SMB 3.0 client (98%) • Network transport optimizations • TCP/IP – SMB multi-channel & NIC Teaming, TCP offloads, DC-TCP • RDMA – Lowest network CPU overhead (cycles/byte)
High Speed CSV I/O RedirectionSMB 3.0 integration • SMB multi-channel • Traffic streamed across multiple networks • Improved I/O performance in redirected mode • SMB Direct (SMB 3.0 over RDMA) VM with I/O being redirected Coordinator Node 10.10.10.X 20.20.20.X CSV Streaming I/O Across Multiple Networks VHD
Performance Improvements – RecapCSV Redirected mode enhancement summary Many Pieces Come Together for Radical Improvement
Deployment CSV Deployment Considerations
Planning VM Density Per CSV VolumeDeployment considerations • How many VMs per CSV volume? • No CSV volume restrictions • VMFS limitations do not apply to CSV • CSV volume Metadata updates orchestrated server side and parallelized How many IOPS can your storage array handle?
Asymmetric Storage Configurations Deployment considerations • Tradeoff Between Storage Connectivity and Network Bandwidth • Asymmetric node – Redirected I/O mode • SMB multi-channel – I/O streamed in parallel • Private interfaces used for cluster traffic if available • Recommendation: Distribute CSV coordinator nodes across cluster
Backup CSV Backup
CSV Backup Key Wins • Distributed Snapshots • Distributed app consistent snapshot creation across cluster • Parallel Backups • On same or different • CSV volumes • Cluster nodes • Improved Interoperability • Backup applications / requestors not required to be ‘CSV aware’ • With filter drivers • Non-disruptive backups • CSV volume ownership does not change during backup • Improved I/O performance • Direct I/O mode for software snapshots
NetApp CSV Backup using NetApp SnapManager Alex Jauch Architect, Microsoft Private Cloud NetApp
NetAppSnapManager® for Hyper-V • Policy-based Backup and Restore of Hyper-V VMs • Protects VMs running on multiple Hyper-V clusters and/or nodes • Single pane of glass for multi-host Hyper-V backups • VMs grouped into “Datasets” for ease of backup administration • Data-protection policies applied to datasets
CSV Backups in Windows Server 2012 • Distributed application consistent VM backups • Uses New ‘VSS CSV Writer’ and ‘VSS CSV Provider’ • CSV value for Hyper-V backups • Initializes VSS backup once on ‘backup node’ • VSS providers only called on ‘backup node’ • Faster backups, Fewer snapshots
Backup Architecture SMHV MMC Snap In PowerShell CLI • Backup Node • Non Requestor Nodes SMHV Service (VSS Requester) VSS Requester (no participation) VSS Service VSS Service Hyper-V writer CSV writer Hyper-V writer CSV writer CSV Providers CSV Providers Data ONTAP Hardware provider Hardware provider (no participation) VM1 VM3 “Host1” Demosvr-01 “Host2” Demosvr-02 VM4 VM2 CSV iSCSI, FCP, FCoE Single Windows Volume VHD VHD VHD Data ONTAP®
Backup Demo CSV Backup using NetApp SnapManagerfor Hyper-V Steve Wienfeld TMEA Microsoft Lead NetAppCorporation
SummaryKey Takeaways • CSV significantly enhanced in Windows Server 2012 • Support for more workloads • High performance • Name a concern, it’s gone! • CSV is a core infrastructure to enable your private cloud INFRASTRUCTURE as a SERVICE
Related Content • WSV310 Windows Server 2012: Cluster-in-a-Box, RDMA, and More • WSV324 Building a Highly Available Failover Cluster Solution with Windows Server 2012 from the Ground UP • VIR301 Windows Server 2012 Hyper-V Storage • VIR302 Enabling Disaster Recovery for Hyper-V Workloads Using Hyper-V Replica • VIR304 Building Flexible Hyper-V Environments Windows Server 2012 Hyper-V Live Migration and Live Storage Migration • VIR306 Hyper-V over SMB: Remote File Storage Support in Windows Server 2012 Hyper-V • VIR401 Hyper-V High-Availability and Mobility: Designing the Infrastructure for Your Private Cloud Find Us Later at the “Availability” Booth
Resources • Failover Clustering Blog • Failover Discussion Forum http://social.technet.microsoft.com/Forums/en/winserverClustering/ http://blogs.msdn.com/b/clustering/
SIA, WSV, and VIR Track Resources Talk to our Experts at the TLC #TEWSV430 Hands-On Labs DOWNLOAD Windows Server 2012 Release Candidate microsoft.com/windowsserver DOWNLOAD Microsoft System Center 2012 Evaluation microsoft.com/systemcenter
Resources Learning TechNet • Connect. Share. Discuss. • Microsoft Certification & Training Resources http://europe.msteched.com www.microsoft.com/learning • Resources for IT Professionals • Resources for Developers • http://microsoft.com/technet http://microsoft.com/msdn
Evaluations Submit your evals online http://europe.msteched.com/sessions