COMP 2923 Virtualization

1. COMP 2923Virtualization Danny Silver JSOCS, Acadia University

2. The Server Invasion • The Invasion - IBM Virtualization Engine -http://www.youtube.com/watch_popup?v=Kbn_MUfTG0E#t=15 • Cool 60's-like overview - http://www.youtube.com/watch_popup?v=57XDSrwEdRg

3. Size of the Web (Darcy Benoit) • Web servers are approximately 0.56% of the total number of IP addresses (4.3 billion), or 0.64% of the "valid" usable IP addresses (3.8 billion) • If we could put one server every foot, the web servers would span from St. John's, NFLD to Victoria, BC • If each server used only 100 Watts of power: • The equivalent of 3.275 Advanced CANDU 6 nuclear reactors (each CANDU 6 = 740 MegaWatts) • If each server used 500 Watts of power: • That is 16.375 Advanced CANDU 6 nuclear reactors • Or more than half of the electricity produced by the Three Gorges Dam in China, the world's largest hydroelectric dam (gross output = 22,500MW, $39 Billion and 17 years to build)

4. What is Virtualization? • Perhaps the most important step for modern data centers in terms going Green • Reduces energy and costs • Provides tremendous flexibility and increase availability and reliability

5. What is Virtualization? • Virtualization, in computing, refers to: • the act of creating a virtual (rather than actual) version of something • including but not limited to: • a virtual computer hardware platform • operating system (OS) • disk storage device • computer network resource • Began in 1960s on mainframes as a method of logically dividing the resources across applications • http://en.wikipedia.org/wiki/Virtualization

6. What is Virtualization? • Great intro -http://www.youtube.com/watch_popup?v=MnNX13yBzAU2007 • https://www.youtube.com/watch?v=N4buO79A22w 2010 • https://www.youtube.com/watch?v=nbOK8qv8p2k 2014 • Slightly more complex intro  - http://www.youtube.com/watch_popup?v=p11lJOnALS4&pop_ads=null

7. Client/Server History: 1980Centralized DP, DS, DC IBM Mainframe 3174 Controller SNA Frontend Dumb 3270 Display Screen

8. Client/Server History: 1990Decentralized DP, DS, DC Mainframe or Mini-Computer LAN Controller TCP/IP File I/O and Terminal Emulation Frontend Hardware PC Local DP, DS, Low speed DC Terminal Emulation LAN Controller

9. Client/Server History: 2000Distributed DP, DS, DC Mainframe, Mini-Computer or Servers LAN Server Internet Thick Client Web / Internet Distributed DP, DS, Mod speed DC Peer-to-Peer Firewall LAN Server

10. Client/Server History: 2007Mixed Centralized / Distributed Rows and Racks of Internet Servers Virtualized Servers LAN Internet Early Thin Client Web / Internet Distributed Applications DP, DS, High speed DC LAN

11. Client/Server History: 2014Cloud Services Rack-mounted Multi-core Virtual Servers Virtual Clients LAN Cloud Thin Client Web Inter-operative Presentation DP, Higher Speed DC + Wireless LAN

12. Internet / Processor Speeds are Key Factors • Most significant factors in centralized/ distributed computing: • Dial-up (9600 bps - 1 Mbps) • Processing must be done at mainframe • LAN (10 Mbps) • Decentralized processing and display with file /IO • High-speed LAN (100 Mbps) • Distributed computing and local display • High-speed, parallel (multi-core) processing • Virtualization

13. Consolidation A P P 1 A P P 2 A P P 3 A P P 4 A P P 5 A P P 6 Each server 10% busy 2 kW power each OS 1 OS 1 OS 1 H/W H/W H/W A P P 1 A P P 2 A P P 3 A P P 4 A P P 5 A P P 6 Consolidated Server 60% busy 4 kW power OS 1 must be active for all apps. OS 1 H/W

14. Full Virtualization A P P 1 A P P 2 A P P 3 A P P 4 A P P 5 A P P 6 Each server 10% busy 2 kW power Win Linux Unix H/W H/W H/W A P P 1 A P P 2 A P P 3 A P P 4 A P P 5 A P P 6 Virtualization Server 60% busy 4 kW power Hypervisor creates and maintains a virtual machine Win Linux Unix Hypervisor H/W

15. Hosted vs Hypervisor

16. Impact in the Data Center is Huge • Separate servers require: • Network infrastructure: NICS, cables, switches • Separate disk drives • Limited by disk I/O and cable speeds (Mbps) • Virtualized servers require: • None of the above • Share disk drives • In-memory data transfer speeds (Tbps)

17. Virtualization System Vendors and Products • IBM – System z/VM, System p/Hypervisor • VMWare – VMware Server, Vmware ESXi • MicroSoft – MS Hyper-V Server • Xen – Open source hypervisor • Also see this Wikipedia list of hypervisors • Not a new concept – see IBM CP/CMS (1962)

18. Advantages of Server Virtualization and Centralization • Disaster recovery • Server state is always in a file, just recover to check-point • Flexibility • Server creation, mods and movement on the fly • Reduced energy use lower carbon footprint • One server versus 10 • Less cooling needed

19. Advantages of Server Virtualization and Centralization • Reduced operational costs • Care for 1 larger server versus 10 smaller servers • Better support for users • One stop help desk for all server users • Greater availability • Hot standby made easy • Improved reliability • High quality server components can be purchased and shared

20. Partitioning • A tool used to support virtualization • Ability to pool resources (CPU, memory, I/O) into a single logical computer, or logical partition (LPAR) LPAR 1 (Windows) CPU CPU CPU I/O I/O I/O RAM RAM RAM LPAR 2 (Linux) Disk Disk Disk

21. A Virtual Machine is a File • An LPAR can be completely defined in a file • This means that the state of a virtual machine can be saved and moved easily, even on the fly • Vmware offers Vmotion • Decrease downtime and improve reliability • Decrease energy use by dynamically powering down unused servers • Reduce IT costs and improve flexibility File CPU I/O RAM Disk

22. Network Virtualization • VMware ESX and IBM System p (Live Partition Mobility) • Network is virtualized = virtual machine retains network identity (IP address) and connections • Ensures seamless migration of LPARs from one physical server to another over high-speed physical network

23. Para-virtualization • Xen (open source) full or “para-virtualization” • Full virtualization approach: • OS is not aware that its is running on a virtual machine • H/W and hypervisor handle all virtualization • Partial “para” approach: • OS must be aware that its is running on a virtual machine • OS works with hypervisor to handle virtualization • Some restrictions of OS function

24. Operating System Level Virtualization • One operating system per physical machine • Example: SUN Solaris containers • OS is capable of making virtual instances of itself • Great for consolidation of e-mail and web servers • Limitation: can only be used by apps that run on that generation of OS

25. SAN – Storage Area Network • A dedicated network of data storage hardware and software • Integrates various storage devices: disks, arrays, CD towers, magnetic tape drives, I/O connect services • Software manages all physical storage resources into one logical storage resource • Shared access across various servers • High inter-connection rates between storage devices and servers • Tape backup / recovery can also be virtualized

26. Client Virtualization • Estimated savings if desktops replaced by thin clients: 60% energy, 50% costs • Installed PCs show very low average use rate • Try monitoring your laptop • Search disk for “supercalifragilisticexpialidocoius” • Download a large file from the web • View a YouTube video • Run a complex calculation or CPU stress tester

27. Client Virtualization

28. Client Virtualization • Benefits: • Low cost of ownership (purchase, energy) • Low cost of maintenance (centralized) • Security (logins are never local, always monitored) • Reliability (boot image control) • Common knowledge pool • Consequents: • Loss of flexibility • Loss of multi-media performance on some tasks

29. Blade Servers Why use blade system servers?

30. Blade Servers • Standard server-rack configuration: • 1RU (one rack unit, 19" [48 cm] wide and 1.75" [4.45 cm] tall) • Typically a rack can hold 42 RUs, or 42U high • Blade server: • Stripped down server computer with a modular design optimized to minimize the use of physical space and energy. • Blade enclosure: • holds multiple blade servers • provides services such as power, cooling, networking • Densities of up to 128 discrete blade servers per rack (2009)

31. Blade Servers • Reduces complexity of IT components • Modular and flexible platform • Hardware counter-part to virtualization • Economizes on space, power, cooling, management • Comes with strong management tools • Suppliers: HP, IBM, SUN/Oracle

32. Combining Blades and Virtualization • Increased utilization, reliability, flexibility and serviceability • IT Admins spend less time managing and reorganizing physical data centre • Moves a step closer to dynamic IT or utility computing • Backbone of cloud computing

33. References • http://www.vmware.com/pdf/virtualization.pdf ** • http://www.intel.com/content/dam/www/public/us/en/documents/guides/cloud-computing-virtualization-building-private-iaas-guide.pdf • http://www.vmware.com/virtualization/virtualization-basics/what-is-virtualization.html • https://www.youtube.com/watch?v=zLJbP6vBk2M • https://cloudacademy.com/cloud-computing/courses/introduction-to-virtualization-technologies/ • http://www.slideshare.net/sasisatyam/introduction-to-virtualization-14723491