Emerging Technologies: Virtualization in Libraries

1. Emerging Technologies: Virtualization in Libraries Dave Pcolar, Systems Specialist - University Libraries, UNC Chapel Hill  Stu Baker, Associate University Librarian for Library Technology, Northwestern University  Matthew Hamilton, Library Innovation and Technology Manager , Boulder Public Library LITA-ALA June 2010

2. Virtualization Definitions Application Virtualization -  Allows users to run an application without having to actually install the program on their computer. Special software provides the operating environment for the program, isolating it from the desktop. Hardware Virtualization -  Execution of software in an environment separated from the underlying hardware resources. Hypervisor -  Software, also called virtual machine monitor (VMM), that allows multiple operating systems to run concurrently on a host computer. Operating System Virtualization - The use of software (hypervisor) to allow a piece of hardware to run multiple operating system images at the same time. The technology got its start on mainframes, allowing more effiecient use expensive processing power. Storage Virtualization - The process of abstracting logical storage from physical storage. Virtual Machine (VM) - A software implementation of a machine (computer) that executes programs equivalent to a physical machine. Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

3. Virtualization Concepts Hardware Virtualization: This is the most common used in IT departments.  The server’s hardware is virtualized, allowing different OS and applications simultaneously on the same hardware (server consolidation.)   a) Less number of servers required for the same number of applications.b) Less power consumption.c) Less maintenance overhead for the IT staff.d) Higher resource utilization.e) Easier and faster capacity management.f)  Patch management and upgrades become easier.g) DRP (Disaster Recovery Planning) becomes easier.  Backup and even migrate entire virtual environments without service outages. Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

4. Virtualization Concepts Desktop Virtualization: Your computer’s data – the OS, its applications, preferences, etc. are all stored in a Virtual Machine(VM) in a hosted environment.  The VMs are managed for all the users and the computing environment is delivered remotely to the end users.   1) Consolidated upgrades and patch management. 2) IT Desktop support is simplified. 3) You can replicate the desktops as your organization grows. 4) Provisioning new applications and VMs takes minutes and not days/weeks. 4) Better resource utilization and less power consumption. 5) Easier recovery and security management. Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

5. Library IT Environment • Increasing Demands • Web services - outside the catalog • Remote access • Digitization Services • Special Collections • Manuscripts/Maps • Photographs • Audio recordings • Archives • Born Digital Collections • ETDs • Scholarly Communication • Digital Repository Services •  Long Term Digital Preservation Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

6. Library IT Environment • Decreasing Resources • Reduction in continuation budgets • Difficulty sustaining maintenance contracts •  Little to no staffing increase • One-off Purchasing • Grant/Special funded projects • Increased Complexity • Support of Open Source Development • LAMP decreasing • JAVA, Tomcat, Drupal, Joomla increasing • Heterogeneous Hardware • Server and Storage  Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

7. Library IT Environment • Facilities • Aging Machine Rooms and Physical Infrastructure • Increased Costs for Cooling/Power • Campus Green Initiatives • Space Considerations • Management • Increased Expectations for Service Delivery • Push to extend Life-cycle Replacement • Culture of Innovation • Market Demographic • 18-24 YO - Expectation of Online Access • Increase in Collaborative Projects/Assignments • 'Internet Time' Pressures Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

8. Why Virtualization? • Underutilized Equipment • Hot/Cold server pools for critical applications • Doubles Hardware Costs • Isolates Resources to Specific Apps • Dedicated Servers • Proprietary - Separate OS Required by Vendor • 'Does not play well with others' • Low Demand Services • Mission critical service with low transaction rates  • Storage Allocations • Locked to specific machines • Fully Provisioned at service inception Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

9. Statistics • Energy costs may increase from 10 percent of the typical IT budget today to more than 50 percent in the next few years. -  • IDC, “Worldwide Server Power and Cooling Expense 2006–2010 Forecast”  • Current IT infrastructures are very inefficient due to underutilization, especially with x86/x64 servers. Gartner states that during a 24-hour period, less than 10 percent of the available computing power is utilized. Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

10. Virtualization  Goals • Increase Operational Flexibility • Rapidly Provision Resources for New Applications • Minimize Risk and Enhance Service Levels  • Provide Rapid Recovery Times for High Availability Applications • Reduce Hardware Lock-in • Extend Equipment Life Cycles Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

11. Infrastructure Choices • VMware Chosen as Enterprise Platform • Proven Track Record in Industry • Comprehensive Product Suite • Supports a Wide Range of Hardware • Mixed Storage Environment • Tier 1 for Critical Application • Currently NetApp • Tier 2 for Large Data Applications • Sun Fiber Arrays • Nexsan SATAbeast • Tier 3 for Disaster Recovery/Replication • Central Campus IT services • Tape (SAM-FS based) • Iron Mountain Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

12. 2007 60+ standalone Hosts 35 Server Instances Manual Failover 20TB Mounted Data 2 Machine Rooms 2010 18 Standalone Hosts  7 Physical VMware hosts 68 Server Instances  Fully Automated Failover 150TB Mounted Data  Single Machine Room Central IT Outsourcing Cost Avoidance $175,000 Implementation Details Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

13. Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

14. Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

15. Pro Overall Cost Reduction Reduced Downtime Patch Management Disaster Recovery Rapid Deployment Con Licensing/Maint Costs Increased Complexity Increased Coordination Pros/Cons Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010

16. Storage Virtualization Goals • Avoid Vendor Lock-in • Deploy Multiple Protocols • Fiber Channel • iSCSI • FCoE (soon?) • Transparent  • Storage Migration • Backup/Cloning • Provisioning • Storage Tiering • High Value/Access Emerging Technologies: Virtualization in Libraries                      LITA-ALA June 2010