250 likes | 465 Views
Virtualization & Information Infrastructure. Par Botes Chief Technology Officer EMC Asia Pacific & Japan. Agenda. About the Speaker Server Virtualization & Storage Architecture The journey to server virtualization & infrastructure storage considerations Virtualized Environments & Data
E N D
Virtualization & Information Infrastructure Par Botes Chief Technology Officer EMC Asia Pacific & Japan
Agenda • About the Speaker • Server Virtualization & Storage Architecture • The journey to server virtualization & infrastructure storage considerations • Virtualized Environments & Data • Shared resources • Duplication • 3D and Green IT • EMC & Virtualized Environments • EMC Storage products enhanced to specifically for server virtualization
VMware Information Infrastructure Advanced Storage Enables VMware functionality VMotion, DRS, VM HA, DPM, Storage VMotion Consolidated servers = consolidated I/O loads Storage designed for demanding and dynamic loads Storage QoS to adjust resources to meet SLA’s Confidence to add new virtualized servers without impacting existing applications Advanced functionality requires advanced storage • Highly Available storage to maintain uptime • 5-9’s, non-disruptive upgrades – more important than in physical environments – as more is affected by less • Flexible storage options • All Protocols VMware can leverage - FC / iSCSI / NFS • Scale from entry/branch to hyper-scale enterprise • Data Center Virtualization • Datacenter Virtualization = VMware (server virtualization) + EMC (storage virtualization) + Cisco (network virtualization) iSCSIFC SANNAS
The Server Virtualization Journey NUMBER OF VMs TIME The Path to Success • Process and Tech Standard Phase • Extended Mobility • “VM 1st” Policy • Heavy-Use Phase • Disaster Recovery • Tier 1 apps • Backup Built for VM • Performance/QoS • VM Mobility • VDI • Light-Use Phase • Utility Servers • High Availability • Pilot Phase • POC Servers • Test/Dev Time
System & Storage Virtualization Roadmap • Integrate replication with Lab Manager • Archive old builds, stale VMs OPTIMIZATION INFRASTRUCTURE Light VM ESX Cluster Lab Manager ESX Cluster CYCLE SOFTWARE • Snapshots for VDI • Go from one VM image to 1,000 in minutes, using little to no storage MANAGEMENT DESKTOP IP Storage B2D Tier 2/3 Block Tier 1 Block IP Storage B2D Tier 2 & 3 Consolidated Storage Storage/ Network Fabric Storage/ Network Fabric • Storage VMotion integration • DRS and array QoS integration • Application consistency • VMware optimizedbackup CONTINUITY CONTINUITY BUSINESS BUSINESS • Site recovery manager • Best fit replication technology • WAN topologies • Async/sync/continous • Deltas only • WAN compression Heavy VM ESX Cluster VDI ESX Cluster • Integrated VMware/infrastructure management • Complete storage virtualization and mobility
Empirical evidence from field deployments • Virtual Machines proliferates easily… • Previously we could leverage procurement processes as a gatekeeper in a change management system, with virtual machines this is often harder • ITIL & CoBIT offers strong process & change management, which I believe will increase in importance as virtualization prolifierates • Virtual machines will increase CPU utilization through consolidation • But monitor taxation of infrastructure resources such as network adapters • RPO/RTO objectives may be missed for key backup processes if not properly modeled ahead of time • Consider this: Data is growing at a rapid pace • Fair amount of duplicate system and user data (empirical data suggests 30-40% of data is duplicate excluding operating environments) • Less of an issue for highly structured data types (databases) • Significant issue for unstructured data (home directories/e-mail etc) • Virtual machines benefits greatly from data de-duplication
988 billiongigabytes ≈60% CAGR Information Continues to Expand Rapidly Amount of Digital Information Created and Replicated Each Year 1,000 Needed: Data Reduction Billions ofGigabytes 2006 500 Information Growth≈60% CAGR 161 billiongigabytes Digital Information 1996 0 ‘96 ‘97 ‘98 ‘99 ‘00 ‘01 ‘02 ‘03 ‘04 ‘05 ‘06 ‘07 ‘08 ‘09 ‘10
Three forms of Data Reduction • Compression • Data encoding to find common or repeating patterns • Typically localized encoding (file, Directory tree, Volume, Object) • Single Instance Store • Is technically a form of compression • Sometimes called “redundant file elimination” • Multiple references to a common file references a single stored file • Typically applied to a collection of files or objects (whole file is a single block) • Data De-Duplication (3D) • Is technically a form of compression • Differs from SIS in that it performs de-duplication function at subfile level (commonly referred to as chunks, blocks or extents) • Common blocks are stored only once • Files or objects are re-assembled from stored blocks
Storage consumption CPU consumption Algorithms, Data & {Storage | CPU} Efficiency Less CPU • Whole file is a block • Each file is treated as an individual block • No detection of duplicates at the sub-file level • Fixed size blocks • Block boundaries occurs at fixed intervals, irrespective of data content • Cannot detect issues with offset (i.e. data inserted at beginning of a block creates a sequence of new blocks) • Variable size blocks • Rolling hash algorithm detects duplicate blocks, even with changing offsets • Blocks sizes are averaged across the dataset • Format-aware blocks • Algorithm determines optimal block boundaries based on data format (different offsets based on data type) • Some types of data can not be de-duplicated • Encrypted data • Highly compressed data (audio, video) Less Storage
De-duplication Ratios “There are three kinds of lies: lies, damned lies, and statistics” - Mark Twain
De-duplication Ratios NAS & SAN File serving VTL & Target based Databases Global Source Unstructured data 1 1.2 2 20 50 300 500 One Hundred Billion “There are three kinds of lies: lies, damned lies, and statistics” - Mark Twain 0.33 0.5 Backup sources Backup targets local & remote clone clone primary • Bigger is better • 300:1 means that for every 300GB protected/stored only 1GB of disk space is required • 1.2:1 ratio means that for every 120GB disk space protected 100GB is required • 0.5:1 means that for every 1GB protected we need 2GB storage Introduces duplication to improve availability
A B Backup A B Create D C C D B C D Admin A A B Duplicate C D Network Modify A B E E C Backup Store Access Source Network • Immediate data availability • Direct user access • Full image access • Consistency • Synthetic • Removing redundant data • Within a single file • Within one server • Across servers • Storing unique data • Incremental forever • Reduced backup window • Transferring only unique data • Client side metadata caching E Global Source Data De-Duplication Avamar
Innovation in VTL & SAN based backup • EMC Disk Library Spin-downOnline Access with improved energy efficiency • EMC DL based Data De-duplicationReduces capacity requirements via post backup process De-dupe. Q22008 Spin-down can reduce power and cooling requirements by up to 30%
Symmetrix CLARiiON DMX-4 950 CX3 UltraScale Series NS80 NSX DL6000 DLm4080 DL4106 DL4406 DL4206 Celerra Mozy Remote Backup NS40 DL210 NEW NEW NEW NEW Powered by EMC Fortress NS40G Flashdrives NS20 NS80G DMX-4 NAS, FC, & iSCSI EMC Disk Library Software-as-a-Service (SaaS) LifeLine ConsumerStorage Connectrix SAN Connectivity RecoverPoint CDP and CRR Invista 2.0 SAN Virtualization Centera Rainfinity EMC Centera Gen 4 LP Node Rainfinity GlobalFile Virtualization EMC’s Continually-expanding Storage Portfolio Fibre Channel and iSCSI AX150 AX4 EMC ControlCenter SMC Navisphere Celerra Manager Smarts PowerPath MPFSiRecoverPoint SRDF TimeFinder MirrorView SnapView Replication Manager Replistor XtenderFamily NetWorker Avamar
NetApp Hitachi 3% Sun 4% 4% Other 8% EMC/Dell 42% IBM 17% HP 22% Why EMC is the Leader for VMware Environments Shared Storage • All EMC Platforms (FC, iSCSI, NAS) • Virtual Provisioning, QoS, Virtual LUNs, Security, and Ease of Use Backup & Recovery • NetWorker integration with VCB • Avamar with VCB & Virtual Edition Business Continuity • Physical and virtual server recovery Resource Management • ECC 6.0 virtual machine discovery • Smarts integration & ADM support Source: IDC EMC leads all vendors as the storage platform of choice for VMware EMC Qualified Reference Architectures, Best Practices and supporting Technical Validation documents
ECC V6.0 VMware Support • StorageScope reports provide storage details including: • Properties of a VMware ESX Server • What array it is connected to • Virtual machine properties and utilization metrics • Mapped raw devices • VMFS (Virtual Machine File System) volumes V 6.0 Rapid Adoption 1,000+ customers Back-end array for VMware ESX Server Detailed views for VMFS, raw devices, and individual virtual machines
APP APP APP APP APP APP OS OS OS OS OS OS High Priority Medium Priority Low Priority CLARiiON Integration with VMware Simplified Tuning and Tiering • VMware DRSLoad balance Virtual Machines • Navisphere QoS ManagerLoad balance Storage resources Simplified Provisioning • Meta LUNsIncrease capacity to create new VM’s on the fly - No reboot! • Virtual LUNReconfigure storage non-disruptively for tiering of VM’s VMware ESX Server withNQM Available Performance Applications
Application Integration Support for VMware Minimize the risk of disrupting service levels when adding virtualization • Reference architectures • Details about proven configuration • Accelerates end-to-end deployment • Best practices and supporting technical validation documents • Helps optimize the performance • How to install, configure, and integrate the entire solutions stack • EMC eLab tested
VM 4 VM 3 RAM CPU NIC VM 2 VM 1 EMC Avamar Backup & Recovery with the De-duplication Difference Target Use Cases: • Remote OfficeMove less data, manage backup centrally • VMware EnvironmentsSpeed VM backup, cut resource contention • Data CenterEliminate network bottlenecks for LAN servers • NetWorker EnvironmentsAvamar integration centralizes management of traditional and De-dupe backup VMware Backup with EMC Avamar EMCAvamar • Up to 95 percent reduction in data moved • Up to 90 percent reduction in backup time
≈5,000 technical R&D employees Industry’s broadest product portfolio Play in more storage markets than anyone else Ship more storage systems than anyone else All designed top to bottom by us Ability to create total solutions vs. point products Sustained technology and market leadership EMC’s Advantage Comes From Our Scale Sustained R&D investment: outspend everyone else
Thank You! Par Botes