570 likes | 577 Views
Achieve raw device performance through file system for database applications. First journaling file system for UNIX. Block-level incremental backup for databases - 10-100X backup performance improvement. First logical volume manager with GUI for UNIX. First cluster volume manager for UNIX. VERITAS Foundations: A History of Innovation & Leadership.
E N D
On-Line Storage Management for Windows Environments Matt Fairbanks VERITAS Software matt.fairbanks@veritas.com
Achieve Raw Device performance through File System for database applications First Journaling File System for UNIX Block Level Incremental Backup for databases - 10-100X backup performance improvement First Logical Volume Manager with GUI for UNIX First Cluster Volume Manager for UNIX VERITAS FoundationsA History of Innovation & Leadership Domain-wide Array Management 1991 1995 2000 1998 1999 1997 Multi-OS CFS
NT Mission Critical • Windows NT apps frequently considered mission-critical • Windows NT data is within an organization’s disaster recovery plans • Price Sensitivity for Windows NT?? • Value of the data, not price, drives users’ storage decisions. Source: Dataquest 1999
Enterprise Needs on NT? “Mission-Critical” on NT Application Deployed Mission-Critical • Internet/Web 80% 47% • MS SQL Server 69% 55% • Exchange 59% 77% • Lotus Notes 43% 70% • ERP 16% 72% Source: Dataquest 1999
Centralized Management • In 1998, 90 percent of Windows NT RAID spending was internal or PCI • Single server attached storage is costly (TCO) • Single server attached storage is initially cheaper. BUT, overall management costs are substantially higher Source: Dataquest June 1999
Centralized Management In a study of over 250 large IT organizations... • 56% of respondents are unable to use 50% of present RAID capacity on NT • 30% of respondents have high labor costs associated with supporting numerous RAID systems on NT • 20% percent of respondents have had to purchase additional NT servers to access additional storage capacity Source: Dataquest June 1999
Windows Storage Challenges • ‘Windows NT staffs are less efficient in supporting RAID capacity compared to UNIX staff’ • ‘NT is consuming twice the amount of IT staff time as UNIX’ • ‘… configuring Windows NT systems consumes incredible IT resources’ • ‘From an overall management perspective, users have difficulty justifying TCO benefits of distributed Windows NT environment’ Source: Dataquest 1999
Windows NT Mgmt. Costs Source: Dataquest 1998
Inode Blocks Data Blocks Foundation Products • VERITAS Volume Manager • Disk and storage subsystem management • Fault tolerance • High performance • VERITAS File System • Highly available, high performance file system • VERITAS Foundation • Enhanced availability, scalability and performance • Financial, .com, telco, etc... Engineering Disk Group Finance Disk Group Sales Disk Group
Why Volume Manager • Higher performance from your existing disk resources • Reconfigure your disk environment online, while applications are running • Better management of all the disks (and space) you have today • Reduce or eliminate outages or performance problems caused by your disk environment • Better clustering, backup, etc...
500 Mb 500 Mb 200 Mb 500 Mb 300 Mb 500 Mb 300 Mb 200 Mb 200 Mb 500 Mb 500 Mb 300 Mb 4 GB 2 GB 9 GB 9 GB VERITAS Volume Manager Without Volume Manager • Server sees many separate physical drives • FS & applications constrained to characteristics of drive • System vulnerable to drive and path failure • Change means downtime (backup/reconfigure/restore) • No load balancing, tuning or performance optimization • Multiple array management tools Disk Drives or Disk Arrays
300 Mb 500 Mb 200 Mb 300 Mb 500 Mb 500 Mb 500 Mb 500 Mb 300 Mb 200 Mb 200 Mb 500 Mb 2 GB 9 GB 9 GB 4 GB VERITAS Volume Manager • Volume Manager • Group disks into logical storage pools • Logical storage devices presented to the host • Reconfigure on-line Striped Set 50GB • Benefits • Fault tolerance • Performance • Availability • Management Mirror Set 200GB
D:\ H:\ Logical Storage Pool Logical Volume Management Enables administrators to: • Create file systems spanning multiple drives • Increase the size of logical disks in place • Reconfigure storage layouts to improve performance and fault tolerance • … ALL without interrupting user data access Provides logical, flexible disk administration with continuous access to data
File Copy Pt. 1 File Pt. 2 File Pt. 3 File Pt. 1 Copy Pt. 2 Copy Pt. 3 Copy Pt. 1 File Pt. 2 File Pt. 3 File Parity VM Fault Tolerance RAID - 1 or Mirroring: Exact duplicate volumes. Full Redundancy. RAID - 0 + 1 or Mirrored Stripes:Stripes data across all drives. Mirror with another RAID 0 column.Full Redundancy with Full Performance. RAID - 5: Stripes data across all drives with parity. Full Redundancy. Doesn’t require duplicate storage investment.
File Copy Pt. 1 File Pt. 2 File Pt. 3 File Pt. 1 File Pt. 2 File Pt. 3 File Parity VM Performance RAID - 0 or Striping: Stripes data across all drives.Accelerated Reads/Writes RAID - 1 or Mirroring: Exact duplicate volumes. Enhanced read performance through load balancing. RAID - 5: Stripes data across all drives with parity. Full Redundancy. Enhanced read performance through load balancing
Fault Tolerance • Array Loss • Application continues with service from mirrored array • Server Loss • Application fails over and disk group is imported SAN Environments • Volume Manager provides platform for scaling clusters to 32 nodes
Hot Relocation • Protects against failure of redundant components • Storage on bad disk or sub-disk is relocated • Relocates storage to designated spares and free space • Alerts system administrator • Maintains redundancy characteristics
Pt. 2 File Additional Protection Hot Relocation • Automatically restores data redundancy after media failure • Data is relocated to “spare disks” and/or free space • Protection from subsequent media failure Spare Disks Pt. 1 File Pt. 2 File Pt. 3 File Pt. 1 Copy Pt. 2 Copy Pt. 3 Copy
On-Line Performance Tuning • Flexible I/O throughput analysis • Disk-based (not limited to database schemas) • Volume Optimization • Easy to recognize “hot spots” and isolate bottlenecks • On-line relocation of “hot spots” • Soft partitioning provides additional flexibility • Move data to a new location • Balance I/O loads without downtime Low Traffic Medium High
VM Performance Monitoring • Online Performance Tuning • IO statistics with IO history
Volume Manager Features • Online Performance Tuning • Hot spot detection • Identify high I/O activity disk • Online sub-disk move • Relocate a high I/O activity sub-disk region to another low I/O activity disk to smooth out the I/O bottle neck
Intelligent & Proactive Disk Mgmt. • Alerts can be sent for... • Failed/offlined disks • Reduced fault tolerance • Definable I/O (over-) load levels • Flexible alert delivery • Event log alerts • Desktop alerts, network alerts, e-mail alerts • Performance monitoring • I/O load statistics maintained at the disk, disk region, and/or volume level • Accumulated or instantaneous performance data • Flexible performance monitoring options • Hot spot detection
Col 1 Col 2 Col 3 Col 1 Col 2 Col 3 Increase Volume Size Col 1 Col 2 Col 3 Col 4 Availability • On-line Relayout • Ability to change configuration ONLINE • Enables volume growth by adding columns • Allows ONLINE changing of stripe unit size
VM Administration • Remote and many-to-many administration • Managing multiple servers from a single client • Managing a server from multiple clients • Adherence to the Windows NT Security Model • Monitoring storage • Unified view of the storage subsystem • Disk and volume views • Graphical and text views • Detailed object views • Windows NT MMC-compliant GUI • Network-wide volume management • Disk and disk array management • File system administrative operations
Manageability Multi-Server Management Storage Enterprise Via any workstation
Logical Volume Mgmt SAN Fabric VM for SANsNon-Disruptive On-Line Storage Management • Volume ownership for multi-server topologies • Each disk group is assigned to a host • All hosts can “see” all disk groups, but won’t use them unless they have ownership Works for both JBOD and RAID !
SAN Fabric VM for SANsNon-Disruptive On-Line Storage Management • Relocation of hot spots to manage bottlenecks • SAN topologies may cause bottleneck at array controller- results in poor performance • Can move Volumes to another array while keeping data in-sync Underutilized Link Over Utilized Link
SAN Fabric VM for SANsNon-Disruptive On-Line Storage Management • Remote Mirroring for Disaster Protection • Create remote mirror up to 10km away on-line • Copy-on-write keeps mirror in sync • Configure local mirror as preferred read device Logical Volume Mgmt 10km reach Works for both JBOD and RAID !
VM Striping Complementing HW RAID • Manageability • Grow/shrink online by spanning multiple LUNs as needed • Ability to migrate data to any location • Snapshot capabilities • Performance • Striping across arrays • Performance monitoring and analysis • More flexible configurations • Online reconfiguration • Eliminates more single points of failure • Mirroring across arrays
VERITAS VM Windows NT Strategy • Build upon Microsoft relationship • VERITAS is Microsoft’s chosen storage management partner for Windows 2000 and beyond • Volume Management • Backup • HSM • Disaster Recovery • Deliver industry-leading solutions on Windows • Windows NT users need the storage management capabilities of VERITAS on Unix • Simplify and automate product administration • Account for typical NT Server configuration differences (many servers; HW RAID widely deployed) • Systems and Storage Partner Relationships
VERITAS Volume Management for Windows NT Products Summary • VERITAS Dynamic Disk Manager for Windows 2000 (DDM) • Embedded in Windows 2000 only (not developed for NT 4) • RAID-0, -1 (up to 2 disks), and -5 (no RAID-5 logging) • No clustering support (MSCS) or HW RAID integration • VERITAS Array Manager for Windows NT (AM) • OEM product, without further RAID or clustering support • HW RAID mgmt. GUI and APIs for full mgmt. integration • Some distributed storage management Cumulative Feature Set • VERITAS Volume Manager for Windows NT (VM) • Key benefits: All of the above, plus I/O performance monitoring and load leveling, better distr. storage management, clustering support, full VM-style SW RAID, preferred plex, multiple disk groups, segmented storage, on-line RAID growth, > 32 disk and column support, n-way mirror, etc.
VM for NT Product Directions • More and better HW RAID management • Performance, fault, allocation management • Disk/RAID Mgmt. Automation Products • Automated I/O performance optimizer • Capacity monitoring/just-in-time disk ordering • Application-specific disk configuration & management tools • Exchange, Oracle, SQL Server, SAP, Web Server, … • VERITAS Product Integration • NetBackup/BackupExec & mirror snapshots • Storage Replicator / Remote Mirroring for disaster recovery • SRM/SAN management • Clustering • VxFS for Windows NT
VERITAS File System • Availability • Journaling file system • Fast recovery • Performance • Extent based allocation • Automatic alignment when using VxVM • Dynamic tuning • Manageability - Online • Online backup • Includes an online defragmentor • Application Integration • Block level incremental backup
Inode Blocks Data Blocks Extent Based Allocation VxFS’s Extent based allocation reduces head seek as well as block locating times Fewer file operations Less fragmentation
Consistent On-Disk Formats Same disk formats between Unix and NT Benefits • Off-host backup • Application migration • Data sharing Solaris/ HP-UX Windows NT
NTFS Compatibility • VxFS compatibility with NTFS... • API level compatibility • Recognizes NTFS commands • Programs and scripts need not change
Storage Checkpoint & Rollback • Similar to file system snapshot, but persistent • Fast, stable, consistent point-in-time file system images • Multiple checkpoints/Aware of other checkpoints • Enables storage rollback (quick restore from on-disk backup image) • Use copy-on-write semantics to maintain changed blocks
E:\ Storage Checkpoint A B C D E F G H Storage Checkpoint:When it is first taken • No data is copied to the Storage Checkpoint • Takes a couple of seconds • Presents the point-in-time image of E:\ by finding data from the live file system, E:\
E:\ Storage Checkpoint A B C D E F G H Storage Checkpoint:As the E:\ changes A’ A • Copy-on-write mechanism first copies the before-image to the Storage Checkpoint before updating the data block G’ G
VERITAS Editions The Problems: • Users think of optimizing a solution rather than a server • e.g., “my Oracle database needs better availability and performance” • Servers typically run a single major application • File Server or Database Server • Environments are rarely mixed • Users must piece together a Storage Management Solution from a multiple vendors VERITAS Editions: Solution-oriented packages for server applications • Exchange, Oracle, SQL Server, SAP, Web ServerEditions planned
Foundation Products Summary • Leading OS support - Solaris, HP-UX and Windows NT/2000 • VERITAS brings enterprise storage management solutions the Windows platform • Enhances system manageability, performance and availability • Partnerships with key system and software providers • Foundation for emerging platforms and technologies • Application-focused Editions
Storage Replicator for NT Storage Replicator for NT (SRNT) • NTFS, FAT or VxFS replication • Preserves write order fidelity • “Many to many” replication • Bandwidth usage settings • Flexible scheduling • 100% new UI • Command line API • Scalable to 64+ nodes