1 / 24

Virtualization & Information Infrastructure

Virtualization & Information Infrastructure. Par Botes Chief Technology Officer EMC Asia Pacific & Japan. Agenda. About the Speaker Server Virtualization & Storage Architecture The journey to server virtualization & infrastructure storage considerations Virtualized Environments & Data

mostyn
Download Presentation

Virtualization & Information Infrastructure

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Virtualization & Information Infrastructure Par Botes Chief Technology Officer EMC Asia Pacific & Japan

  2. Agenda • About the Speaker • Server Virtualization & Storage Architecture • The journey to server virtualization & infrastructure storage considerations • Virtualized Environments & Data • Shared resources • Duplication • 3D and Green IT • EMC & Virtualized Environments • EMC Storage products enhanced to specifically for server virtualization

  3. Server Virtualization & Storage Architecture

  4. VMware Information Infrastructure Advanced Storage Enables VMware functionality VMotion, DRS, VM HA, DPM, Storage VMotion Consolidated servers = consolidated I/O loads Storage designed for demanding and dynamic loads Storage QoS to adjust resources to meet SLA’s Confidence to add new virtualized servers without impacting existing applications Advanced functionality requires advanced storage • Highly Available storage to maintain uptime • 5-9’s, non-disruptive upgrades – more important than in physical environments – as more is affected by less • Flexible storage options • All Protocols VMware can leverage - FC / iSCSI / NFS • Scale from entry/branch to hyper-scale enterprise • Data Center Virtualization • Datacenter Virtualization = VMware (server virtualization) + EMC (storage virtualization) + Cisco (network virtualization) iSCSIFC SANNAS

  5. The Server Virtualization Journey NUMBER OF VMs TIME The Path to Success • Process and Tech Standard Phase • Extended Mobility • “VM 1st” Policy • Heavy-Use Phase • Disaster Recovery • Tier 1 apps • Backup Built for VM • Performance/QoS • VM Mobility • VDI • Light-Use Phase • Utility Servers • High Availability • Pilot Phase • POC Servers • Test/Dev Time

  6. System & Storage Virtualization Roadmap • Integrate replication with Lab Manager • Archive old builds, stale VMs OPTIMIZATION INFRASTRUCTURE Light VM ESX Cluster Lab Manager ESX Cluster CYCLE SOFTWARE • Snapshots for VDI • Go from one VM image to 1,000 in minutes, using little to no storage MANAGEMENT DESKTOP IP Storage B2D Tier 2/3 Block Tier 1 Block IP Storage B2D Tier 2 & 3 Consolidated Storage Storage/ Network Fabric Storage/ Network Fabric • Storage VMotion integration • DRS and array QoS integration • Application consistency • VMware optimizedbackup CONTINUITY CONTINUITY BUSINESS BUSINESS • Site recovery manager • Best fit replication technology • WAN topologies • Async/sync/continous • Deltas only • WAN compression Heavy VM ESX Cluster VDI ESX Cluster • Integrated VMware/infrastructure management • Complete storage virtualization and mobility

  7. Virtualized Environments & Data

  8. Empirical evidence from field deployments • Virtual Machines proliferates easily…  • Previously we could leverage procurement processes as a gatekeeper in a change management system, with virtual machines this is often harder • ITIL & CoBIT offers strong process & change management, which I believe will increase in importance as virtualization prolifierates • Virtual machines will increase CPU utilization through consolidation • But monitor taxation of infrastructure resources such as network adapters • RPO/RTO objectives may be missed for key backup processes if not properly modeled ahead of time • Consider this: Data is growing at a rapid pace • Fair amount of duplicate system and user data (empirical data suggests 30-40% of data is duplicate excluding operating environments) • Less of an issue for highly structured data types (databases) • Significant issue for unstructured data (home directories/e-mail etc) • Virtual machines benefits greatly from data de-duplication

  9. 988 billiongigabytes ≈60% CAGR Information Continues to Expand Rapidly Amount of Digital Information Created and Replicated Each Year 1,000 Needed: Data Reduction Billions ofGigabytes 2006 500 Information Growth≈60% CAGR 161 billiongigabytes Digital Information 1996 0 ‘96 ‘97 ‘98 ‘99 ‘00 ‘01 ‘02 ‘03 ‘04 ‘05 ‘06 ‘07 ‘08 ‘09 ‘10

  10. Three forms of Data Reduction • Compression • Data encoding to find common or repeating patterns • Typically localized encoding (file, Directory tree, Volume, Object) • Single Instance Store • Is technically a form of compression • Sometimes called “redundant file elimination” • Multiple references to a common file references a single stored file • Typically applied to a collection of files or objects (whole file is a single block) • Data De-Duplication (3D) • Is technically a form of compression • Differs from SIS in that it performs de-duplication function at subfile level (commonly referred to as chunks, blocks or extents) • Common blocks are stored only once • Files or objects are re-assembled from stored blocks

  11. Storage consumption CPU consumption Algorithms, Data & {Storage | CPU} Efficiency Less CPU • Whole file is a block • Each file is treated as an individual block • No detection of duplicates at the sub-file level • Fixed size blocks • Block boundaries occurs at fixed intervals, irrespective of data content • Cannot detect issues with offset (i.e. data inserted at beginning of a block creates a sequence of new blocks) • Variable size blocks • Rolling hash algorithm detects duplicate blocks, even with changing offsets • Blocks sizes are averaged across the dataset • Format-aware blocks • Algorithm determines optimal block boundaries based on data format (different offsets based on data type) • Some types of data can not be de-duplicated • Encrypted data • Highly compressed data (audio, video) Less Storage

  12. De-duplication Ratios “There are three kinds of lies: lies, damned lies, and statistics” - Mark Twain

  13. De-duplication Ratios NAS & SAN File serving VTL & Target based Databases Global Source Unstructured data 1 1.2 2 20 50 300 500 One Hundred Billion “There are three kinds of lies: lies, damned lies, and statistics” - Mark Twain 0.33 0.5 Backup sources Backup targets local & remote clone clone primary • Bigger is better • 300:1 means that for every 300GB protected/stored only 1GB of disk space is required • 1.2:1 ratio means that for every 120GB disk space protected 100GB is required • 0.5:1 means that for every 1GB protected we need 2GB storage Introduces duplication to improve availability

  14. A B Backup A B Create D C C D B C D Admin A A B Duplicate C D Network Modify A B E E C Backup Store Access Source Network • Immediate data availability • Direct user access • Full image access • Consistency • Synthetic • Removing redundant data • Within a single file • Within one server • Across servers • Storing unique data • Incremental forever • Reduced backup window • Transferring only unique data • Client side metadata caching E Global Source Data De-Duplication Avamar

  15. Innovation in VTL & SAN based backup • EMC Disk Library Spin-downOnline Access with improved energy efficiency • EMC DL based Data De-duplicationReduces capacity requirements via post backup process De-dupe. Q22008 Spin-down can reduce power and cooling requirements by up to 30%

  16. EMC & Virtualized Environments

  17. Symmetrix CLARiiON DMX-4 950 CX3 UltraScale Series NS80 NSX DL6000 DLm4080 DL4106 DL4406 DL4206 Celerra Mozy Remote Backup NS40 DL210 NEW NEW NEW NEW Powered by EMC Fortress NS40G Flashdrives NS20 NS80G DMX-4 NAS, FC, & iSCSI EMC Disk Library Software-as-a-Service (SaaS) LifeLine ConsumerStorage Connectrix SAN Connectivity RecoverPoint CDP and CRR Invista 2.0 SAN Virtualization Centera Rainfinity EMC Centera Gen 4 LP Node Rainfinity GlobalFile Virtualization EMC’s Continually-expanding Storage Portfolio Fibre Channel and iSCSI AX150 AX4 EMC ControlCenter SMC  Navisphere Celerra Manager Smarts PowerPath MPFSiRecoverPoint SRDF TimeFinder  MirrorView  SnapView Replication Manager  Replistor  XtenderFamily NetWorker Avamar

  18. NetApp Hitachi 3% Sun 4% 4% Other 8% EMC/Dell 42% IBM 17% HP 22% Why EMC is the Leader for VMware Environments Shared Storage • All EMC Platforms (FC, iSCSI, NAS) • Virtual Provisioning, QoS, Virtual LUNs, Security, and Ease of Use Backup & Recovery • NetWorker integration with VCB • Avamar with VCB & Virtual Edition Business Continuity • Physical and virtual server recovery Resource Management • ECC 6.0 virtual machine discovery • Smarts integration & ADM support Source: IDC EMC leads all vendors as the storage platform of choice for VMware EMC Qualified Reference Architectures, Best Practices and supporting Technical Validation documents

  19. ECC V6.0 VMware Support • StorageScope reports provide storage details including: • Properties of a VMware ESX Server • What array it is connected to • Virtual machine properties and utilization metrics • Mapped raw devices • VMFS (Virtual Machine File System) volumes V 6.0 Rapid Adoption 1,000+ customers Back-end array for VMware ESX Server Detailed views for VMFS, raw devices, and individual virtual machines

  20. APP APP APP APP APP APP OS OS OS OS OS OS High Priority Medium Priority Low Priority CLARiiON Integration with VMware Simplified Tuning and Tiering • VMware DRSLoad balance Virtual Machines • Navisphere QoS ManagerLoad balance Storage resources Simplified Provisioning • Meta LUNsIncrease capacity to create new VM’s on the fly - No reboot! • Virtual LUNReconfigure storage non-disruptively for tiering of VM’s VMware ESX Server withNQM Available Performance Applications

  21. Application Integration Support for VMware Minimize the risk of disrupting service levels when adding virtualization • Reference architectures • Details about proven configuration • Accelerates end-to-end deployment • Best practices and supporting technical validation documents • Helps optimize the performance • How to install, configure, and integrate the entire solutions stack • EMC eLab tested

  22. VM 4 VM 3 RAM CPU NIC VM 2 VM 1 EMC Avamar Backup & Recovery with the De-duplication Difference Target Use Cases: • Remote OfficeMove less data, manage backup centrally • VMware EnvironmentsSpeed VM backup, cut resource contention • Data CenterEliminate network bottlenecks for LAN servers • NetWorker EnvironmentsAvamar integration centralizes management of traditional and De-dupe backup VMware Backup with EMC Avamar EMCAvamar • Up to 95 percent reduction in data moved • Up to 90 percent reduction in backup time

  23. ≈5,000 technical R&D employees Industry’s broadest product portfolio Play in more storage markets than anyone else Ship more storage systems than anyone else All designed top to bottom by us Ability to create total solutions vs. point products Sustained technology and market leadership EMC’s Advantage Comes From Our Scale Sustained R&D investment: outspend everyone else

  24. Thank You! Par Botes

More Related