310 likes | 602 Views
VMWare on NetApp Infrastructure. NetApp Environment Overview. Capacity over 1PB RAW. NetApp Environment Overview Cont. All FAS Controllers 48 Controllers – most Active/Active 4,000 Disks - FC and SATA 2590 Volumes 4 Data Centers 6 Environments with hardware segregation
E N D
NetApp Environment Overview • Capacity over 1PB RAW
NetApp Environment Overview Cont. • All FAS Controllers • 48 Controllers – most Active/Active • 4,000 Disks - FC and SATA • 2590 Volumes • 4 Data Centers • 6 Environments with hardware segregation • No SAN Fabric – Mostly NFS, some iSCSI • Monitoring – Operations Manager • Performance Advisor
NetApp VMWare Environment Overview • 3 Years Service • 10 FAS Controllers (shared responsibilities) • FAS3040s, FAS3070s and FAS3160s • ONTAP 7.3 and 7.3.1.1 • Active/Active • 84TB RAW • RAID-DP – Default RG Size16
NetApp VMWare Environment Overview Cont. • One or Two Aggregates per Controller • 84TB RAW • 21TB Internal DEV, DEV, QA • 42TB Back Office Production • 21TB COLO Production • FC Disks • 144GB 10K • 300GB 10K • 300GB 15K
NetApp VMWare Environment Overview Cont. • 100 physical ESX Hosts • 32GB or 64GB of RAM • HP Hardware running 3.5 ESX update 4 • VC 2.5 U4 • 928 Guest OS • Primarily Windows and Linux • A few SQL and AD DC Guests • Citrix Provisioning Server Clients • VDI Clients
NFS Benefits for AutoTrader.com • Simple to Manage • Ability to Decrease Datastore Size • Easier to Thin Provision • No Fractional Reserve • No FC Switches, Zones or HBAs. • No VMFS single I/O queue • Larger volumes
Default Volume Layout • FlexVols • Guarantee = none • SnapReserve 30% (OS/DATA) • Naming convention • Department_clustername_volumetype_##
Volumes for Traditional ESX Guests • OS (VMX) 8GB • Delta/Page 320GB • Swap 250GB • OS/Data 500GB • Page/Temp 110GB • Swap 250GB • ISO 200GB Volumes for Citrix Provisioning Sever Guests
Alignment • Templates • No LUNs – NO VMFS alignment is required • VM guest file system alignment tools • MBRAlign and DiskPart • MBRScan
De-Duplication • Yes we do……who doesn’t? • ASIS only on OS and DATA volumes • Average savings around 75% • FREE
Backup and Recovery • Snapshots – Currently without quiescing VM • SMVI – Testing currently in internal Development testing phase • NetBackup Agents Data Domain • Tape if required
Business Continuity and Disaster Recovery • DEV and QA – No BC or DR • Back Office Prod – • BC • Live Communicator • Citrix • DR – All OS/Data volumes SnapMirrored to site 2 • COLO Prod • BC – Dual COLO • Same Service VMs in both sites (web services, etc)
Network Configuration • Storage Traffic Segregation • Physical Stacked Switches • Storage IP Subnets • Dot.1q • VLAN IDs XX.XX.VLAN.0 /24 • Dynamic (LACP) Multi-mode VIFs • VLAN Interfaces
ESX Servers to Stacked Switches • IP Switch Infrastructure • Link status only • One VMkernel – One Subnet • No IP Hash or static Etherchannel • Service Console HA Redundancy
NetApp Controllers to Stacked Switches • Multi-mode LACP (dynamic) VIF • Cisco Stack with cross-stack LACP Port-Channel • Detects both link and data loss • Cross-stack redundancy • One Subnet – No IP Aliases
Maintenance • Non-Disruptive Upgrades • NFS Timeouts – about 125 Seconds of Hang • NFS.HeartbeatFrequency = 12 • NFS.HeartbeatMaxFailure = 10 • Shelf and Disk firmware as needed • Reallocations • 7.3 Aggregates (-p option)
We Don’t Do… • Metro-Clustering • NDMP Backups • SnapVaults • PAM Cards
We are planning to use… • 10GbE • Jumbo Frames….vSphere 4.0 • SRM….yet • Storage Vmotion….vSphere 4.0 • AutoGrow • Rapid Cloning Utility • SMVI • GX