1 / 116

A Survey of Virtualization Technologies

A Survey of Virtualization Technologies. Ken Moreau Hewlett-Packard. What is virtualization?.

cheyenne-hicks
Download Presentation

A Survey of Virtualization Technologies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Survey of Virtualization Technologies Ken Moreau Hewlett-Packard

  2. What is virtualization? • Virtualization is the process of presenting a logical grouping or (sub)set of computing resources so that they can be used and managed in ways that give benefits over the original configuration. This is not restricted by the geographic location or the physical configuration of the underlying resources. • Resources may consist of processors, memory, I/O channels, whole server systems, application instances, storage, networking, even whole sites. • You are already using virtualization technologies • It has been working for decades… A Survey Of Virtualization Technologies

  3. Why do I care? • Decouple servers, storage, networking, applications, monitoring, etc from the business • Deliver applications as a service, to • Enhance agility • Reduce costs • Reduce risks • Turn IT into a utility • Virtualization is growing fast: $800M in 2007 to $1.8B in 2010 (IDC) A Survey Of Virtualization Technologies

  4. Agenda • Server Virtualization Technologies • Hard Partitioning, Soft Partitioning, Micro Partitioning, Resource Partitioning, Clustering, Software Emulation, Variable Capacity • Networking Virtualization Technologies • VLANs, Sub-nets, Multi-Pathing and Aggregation, NAT • Storage Virtualization Technologies • Virtualization Layers, Raw Volumes and File Systems, RAID, I/O Multi-Pathing, NAS • Client Virtualization Technologies • Software Virtualization Technologies (TBD) • Virtualization Management and Automation • Selling Virtualization To Your Company • Q&A A Survey Of Virtualization Technologies

  5. Tremendous amount of unutilized capacity Yet some systems are still unable to handle peak loads Many standalone servers = high mgmt costs & reactive strategies The IT Issues – Drivers and Challenges • Business Drivers – Reduce costs, improve TCO/ROI + increase service levels + improve agility to more quickly respond to changing business requirements. • Challenge - Too many distributed servers (“One App-One Server”) that are grossly under utilized while some are over utilized. Average server CPU utilization during peak periods is 10-25% (Windows) and 15-30% (UNIX). A Survey Of Virtualization Technologies

  6. An Additional Problem A Survey Of Virtualization Technologies

  7. A Survey Of Virtualization Technologies

  8. The Server Virtualization Continuum Single physical node Single system image per node within a cluster Hard partitions within a server Soft partitions and/ormicro-partitions within a hard partition of a server Resource partitions and/orsecure partitions within a system image Hard Partition 1 • Hard Partition 1 • OS image with HW fault isolation • Dedicated CPURAM & I/O • Application 1 • Guaranteed compute resources (shares or percentages) • Soft Partition 1 • OS + SW fault isolation • Dedicated CPU, RAM • Soft Partition 2 • OS + SW fault isolation • Dedicated CPU, RAM • Hard Partition 2 • OS image with HW fault isolation • Dedicated CPURAM & I/O • Application 2 • Guaranteed compute resources (shares or percentages) Hard Partition 2 Hard Partition 3 Application 3 • Virtual Machine 1 • OS + SW fault isolation • Virtual + Shared CPU, I/O • Virtualized Memory Node • Application n • Guaranteed compute resources (shares or percentages) • Hard Partition n • OS image with HW fault isolation • Dedicated CPURAM & I/O • Virtual Machine 2 • OS + SW fault isolation • Virtual + Shared CPU, I/O • Virtualized Memory Isolation Flexibility A Survey Of Virtualization Technologies

  9. Physical Server Virtualization: Hard Partitioning A Survey Of Virtualization Technologies

  10. Hard Partitioning And Flexibility 2 partitions of a large server: 4 processors in one partition, and 12 processors in the other 8 processors in each partition Requires rebooting both O/S instances A Survey Of Virtualization Technologies

  11. System Architecture • Bus Based • Network repeater • Predictable latency • Increasing bus clock speed is easy • Can bottleneck on the system bus • Switch Based • Network switch • Parallel transfers • Highly scalable • Variable latency • Mesh Based • Large network • Massively parallel transfers • Extremely scalable • Overall very low latency • Can be difficult to upgrade A Survey Of Virtualization Technologies

  12. Server Architecture And Hard Partitions A Survey Of Virtualization Technologies

  13. Bus-based (Planar) Servers: All Vendors • All x86 and all low-end servers from all vendors are bus-based • All Opteron servers are mesh-based but do not take advantage of the switching for partitioning • The scalability and economics of these servers do not require partitioning A Survey Of Virtualization Technologies

  14. Switch-based Servers: HP • AlphaServers (Wildfire) GS80, GS160 and GS320 • HP 9000 PA-RISC rp7xxx, rp8xxx and Superdome • Integrity rx7xxx, rx8xxx and Superdome • Hard partitions are done by the switches, so granularity is at the “system building block” (SBB) or “cell” level • True electrical isolation, excellent flexibility A Survey Of Virtualization Technologies

  15. Switch-based Servers: IBM • X-Architecture: System x 365, 366, 440, 445, 455, 3950 • Full 4 processor system with memory and I/O slots • Communication via an SMP port: point to point communication • System i5 and p5 560, 570 • Full 4 processor system with memory and I/O slots • Communication with “flex cable”: ring topology • Can enable/disable communication by changing the cables: true electrical isolation, inflexible A Survey Of Virtualization Technologies

  16. Switch-based Servers: NEC • Express5800 series: • 1080Rf (2 cells) • 1160Xf (4 cells) • 1320Xf (8 cells) • A3 chipset offers Dynamic Partitioning with Windows 2008 • True electrical isolation • Cache coherency is over a full mesh A Survey Of Virtualization Technologies

  17. Switch-based Servers: Sun • SunFire E2900, E4900, E6900, E12K, E15K, E20K, E25K • Fireplane interconnect of the “system board” (E2900) or the “Uniboard” (E4900 and up) to the processor/memory/I/O slot • Switch to connect 2 processors • Switch to connect those switches • Expander switch to make a Uniboard • Fireplane switch to connect the Uniboards • OLAR: not electrically isolated, good flexibility A Survey Of Virtualization Technologies

  18. Switch-based Servers: Unisys • ES7000/400 (Itanium) uses a cross-bar switch to connect modules • ES7000/one (Pentium or Itanium) uses “FleXbar” cables to connect “cells” into 32 processor systems • Each module/cell is a complete system with 4/8 processor slots, up to 64 GBytes of memory and 8 PCI-X slots • True electrical isolation, inflexible A Survey Of Virtualization Technologies

  19. Mesh-based Servers: HP • Alpha ES47, ES80 and GS1280 • Each processor connects directly to private memory and I/O, and up to 4 other processors • Partitioning of dual processors • True electrical isolation, excellent flexibility A Survey Of Virtualization Technologies

  20. Mesh-based Servers: IBM • System i5 and p5 (590 and 595) • Each processor connects directly to private memory and I/O, and up to 4 other processors • Soft partitioning at the processor level • No electrical isolation, excellent flexibility A Survey Of Virtualization Technologies

  21. Logical Server Virtualization: Soft Partitioning A Survey Of Virtualization Technologies

  22. Soft Partitioning And Flexibility 2 partitions of a large server: 7 processors in one partition, and 9 processors in the other 8 processors in each partition Live movement: no rebooting A Survey Of Virtualization Technologies

  23. Soft or Dynamic Partitions A Survey Of Virtualization Technologies

  24. Logical Server Virtualization: Micro Partitioning A Survey Of Virtualization Technologies

  25. Micro-Partitioning And Flexibility Stack many O/S instances on a single server,reducing the number of servers in your environment A Survey Of Virtualization Technologies

  26. Micro-Partitioning Terminology • System Image (SI) - A software component, such as a general or special purpose Operating System, to which specific virtual and physical devices can be assigned. • Virtualization Intermediary (VI) - A component that manages the allocation of resources to an SI and isolates resources assigned to a System Image from access by other System Images. • Virtual System (VS) - The physical or virtualized resources necessary to run a single SI instance. • Virtual resources typically consist of: processors, memory, I/O, and storage. Applications System Image 1 Expand or Contract Virtual System 1 Virtual Processors Virtual Memory Virtual I/O Storage VirtualizationIntermediary Resource Mapping Physical System Expand or Contract Processors Memory Physical I/O Storage A Survey Of Virtualization Technologies

  27. Micro-partitioning: Hosting Models A Survey Of Virtualization Technologies

  28. Micro-partitioning: I/O Models A Survey Of Virtualization Technologies

  29. System Instance 3 System Instance 1 System Instance 2 app2 app1 app1 app1 app2 OS OS OS Virtual Switch NIC 2 Virtual Switch Virtual Switch NIC 1 Physical System Micro-partitioning: I/O paths • Shared or dedicated ports • Can have private networking A Survey Of Virtualization Technologies

  30. Fooling The O/S: Para-Virtualization • Operating Systems do their privileged operations in “inner mode” or “privileged mode”: ring 0 • But guest instances doing these operations will interfere with other guest instances and the host instance itself • This requires either de-privileging the guest operating system, or source code changes to the guest operating system • Para-virtualization replaces all calls to ring 0 in the guest instances with calls to the host instance A Survey Of Virtualization Technologies

  31. Fooling the O/S: Para-virtualization • Most work was being done in the Linux world • Xen (prior to V3.0) • Trango (real-time hypervisor for embedded systems) • All vendors have moved to para-virtualization, but at different rates • Check to see whether full virtualization (ie, completely fooling the un-modified O/S) or para-virtualization (ie, the modified guest O/S cooperates with the hypervisor) is supported • Then check to see if it requires hardware assists A Survey Of Virtualization Technologies

  32. Fooling The O/S: x86, Power5/6 and T1 Virtualization Technology A Survey Of Virtualization Technologies

  33. Fooling The O/S: Itanium Virtualization Technology PSR.vm = 0 PSR.vm = 1 • All O/S instances run un-modified in all ring levels • Guest O/S instances executing some inner mode operations will trap to the host O/S instance A Survey Of Virtualization Technologies

  34. Micro-partitioning (1 of 2) A Survey Of Virtualization Technologies

  35. Micro-partitioning (2 of 2) A Survey Of Virtualization Technologies

  36. Data Mirror Geo-clusters Via Storage Replication Recovery Site Primary Site • Site-level replication • Fully automated setup and configuration • Supports virtually any distance • Fast recovery from planned and unplanned failure Guest Guest Guest Guest Cluster Guest Guest Guest Guest Hypervisor Hypervisor Storage Based Replication A Survey Of Virtualization Technologies

  37. Embedded Virtualization • Dell, HP and IBM embed VMware ESX 3i on a flash card • Much thinner footprint, no installation, more security • Powers up directly into VMware ESX 3i – no boot disk • Supported by VMware Infrastructure 3 • No more console access: use Common Information Model (CIM) instead • Dell and HP embed XenServer on a flash card • Citrix XenServer OEM Edition • OpenKernel Labs, VirtualLogix and Trango are working on virtualization for cell phones A Survey Of Virtualization Technologies

  38. Does Anybody Really Know What Time It Is? Does Anybody Really Care? • Sun xVM provides the system time to each vCPU when it is scheduled to run • VMware Tools includes a time synchronization feature to reset the guest O/S’s clock when needed • Xen syncs all guest instances to dom0 • /proc/sys/xen/independent_wallclock = 0 • HPVM, IBM hypervisor, Sun Logical Domains, and Windows Virtual Server do not do anything special to assist: use NTP A Survey Of Virtualization Technologies

  39. Some considerations of micro-partitioning • Physical isolation required for security • Dongles, regulatory, network, storage • Compute intensive applications • Processor, memory and I/O • Highly variable workloads that peak simultaneously • Latency sensitive workloads • Vendors who don’t support micro-partitioned apps • Support or licensing • Too few servers to justify the effort to get there A Survey Of Virtualization Technologies

  40. Other Micro-Partitioning Tools • There are many other tools which offer micro-partitioning functionality • They vary from emulators to para-virtualization to hypervisors • Most of them are focused on workstations http://en.wikipedia.org/wiki/Comparison_of_virtual_machines A Survey Of Virtualization Technologies

  41. Micro-partitioning and Clustering • Some vendors support clustering of host instances to provide failover of guest instances • VMware ESX 3.0 HA (aka Distributed Availability Services) • HP-UX Virtual Machine supports Serviceguard • IBM Hypervisor does not support clustering of host instances • Xen (all vendors) does not support clustering of host instances • Windows Virtual Server 2005 runs as a service with MSCS • Some vendors support clustering of guest instances • AIX supports HACMP in guest instances with V5.2+ (not with Live Partition Mobility) • HP-UX and Linux Serviceguard are supported with HPVM V2.0 • Oracle RAC is supported in an SPLpar and VMware ESX, but no other guest instance • Windows 2003 supports MSCS of guest instances A Survey Of Virtualization Technologies

  42. Server Software Virtualization: Operating System Partitioning A Survey Of Virtualization Technologies

  43. Partitioning Inside An O/S Instance • A single O/S instance is the most efficient and least costly to license and maintain • It requires all of the application instances to share an O/S and application patch level, and SLA’s • Resource partitioning can group users, processes or application programs for easy management • The process scheduler and memory manager bias their allocations according to policies -or- • A virtual O/S environment is setup for each application • Can be done by the O/S or by the application A Survey Of Virtualization Technologies

  44. Server Resource Partitions A Survey Of Virtualization Technologies

  45. Server Application Partitioning • BEA WebLogics • Databases • DB2, Oracle, Oracle Rdb, SQL Server A Survey Of Virtualization Technologies

  46. Server Partitioning and Security • Hard partitions • Maximum availability and maximum security isolation in a single box (e.g. firewall-separated architecture, or multi-department consolidation) – firmware settings can increase or decrease security • Micro-partitions • Security isolation of separate (virtual) OS instances, sub CPU granularity • Resource Partitions • Maximum flexibility of security isolation in a single OS instance (greater initial setup cost, but reduced maintenance cost due to single OS instance), sub CPU granularity • Soft partitions • High performance consolidation where administrators and processes with admin privileges are trusted across partitions • Clustering • Maximum availability and failover capabilities, single trust domain Increasing security isolation A Survey Of Virtualization Technologies

  47. Server Virtualization Through Emulation • Aries • HP-UX PA-RISC on HP-UX Integrity • Charon-VAX • OpenVMS VAX on Windows x86 and OpenVMS Alpha • Intel • IA-32 Execution Layer on Itanium • Platform Solutions, Inc with T3 Technologies • zOS, OS/390 on HP Integrity (Liberty Server) • zOS, OS/390 on IBM xServer (tServer) • Transitive Software (QuickTransit) • Solaris SPARC on Solaris x86, Linux x86 and Linux Itanium • Linux x86 on IBM pServer (PowerVM Lx86) A Survey Of Virtualization Technologies

  48. All Server Virtualization: Licensing A Survey Of Virtualization Technologies

  49. Server Variable Capacity Virtualization • Sometimes you don’t need a full system, but when you need it, you need it now! • Variable capacity allows you to enable and disable server components dynamically • Permanent activation • Temporary activation • Variable lease payments • Can be bound to a specific server, or be shared between servers or even between sites 8 + 8 = 12 A Survey Of Virtualization Technologies

  50. A I I A Sharing Processors Via License Migration 1. Partition 1 activity increases 2. You determine additional processors are required. A A I I 3. You deactivate 2 processors from Partition 2 A A A A 4. You activate 2 processors on Partition 1 A I A I 5. Total number of active processors remains constant A A A A 8 + 8 = 12 Partition 2 Partition 1 A Survey Of Virtualization Technologies

More Related