Cloud Computing : Virtual Computing Lab (VCL), Open Stack & SmartCloud Provisioning (SCP)

1. Andy Rindos Head, IBM RTP Center for Advanced Studies (CAS) Cloud Computing: Virtual Computing Lab (VCL), Open Stack & SmartCloud Provisioning (SCP)

2. What is Cloud Computing? NIST Definition: “Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (such as networks, servers, storage, applications and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction.” More simply, for our purposes here… A cloud can be considered to be a collection of hardware, software and other resources that can be accessed over the Internet, and used to assemble a solution on demand (that is, at the time of the request) to provide a set of services back to the requester.

3. Services Hardware as a Service (HaaS)– On demand access to a explicit (specific) computational, storage and networking product and/or equipment configuration possibly at a particular site Infrastructure as a service (IaaS)– On demand access to user specified hardware, interconnects, and storage capabilities, performance and services which may run on a variety of hardware products Platform as a Service (PaaS)- On-demand access to user specified combination hypervisors, operating system, and middleware that enables user required applications and services that are running on either Haas and/or IaaS Application as a Service (AaaS) - On-demand access to user specified application(s) Software as a Service (SaaS)- may encompass anything from PaaS through AaaS Business Processes as a Service (BPaaS) Cloud as a Service, Security as a Service

4. VCL: One of the first state education clouds built on IBM technologies A partnership with IBM & others to develop a cloud computing solution specifically targeted for education & research Substantial support from IBM for VCL development through SURs, CAS Faculty Awards, & BladeCenter / SWG development WebSphere Technology Institute assisted in the creation of the VCL Apache project IBM Smart Cloud for Education: VCL solutions include GBS VCL Quickstart Services, etc. One of the first true clouds ever developed, specifically designed for education and research • VCL project planning started in 2002-2003 • NCSU production use started in 2004 • Support for both HPC & non-HPC workloads • Awards incl. Computerworld Honors Prog. Laureate • Currently NCSU VCL • - Open to 40,000+ NCSU student & faculty, as well • as 250,000+ in NC • - 2,000+ Blades in production • - Delivers over 500,000CPU hours to general • reservations (desktops, sub-clouds, classroom, etc.) • annually & over 13,000,000 HPC CPU hours • VCL sites in US include NC Community College • System, many UNC System universities, VA VCL • (GMU, ODU, VA Tech, NSU, etc.), GSU, UMBC, • MSU, GSU, TSU, Southern, Cal State System, etc. • User sites outside US include Canada, Japan, China, India, Middle East, Eastern Europe, etc. Dr. Mladen Vouk, “the father of VCL” Professor and Head of Computer Science Department, and Associate Vice-Provost for Information Technology, North Carolina State University, Raleigh, NC

5. Smarter Classroom through Cloud Computing: The Virtual Computing Lab (VCL) in North Carolina + NC Community College System + NC K-12 school districts WFU NCA&T OC12 (622 Mbps Circuit) OC48 (2.4 Gbps Circuit) DWDM (10 Gbps Enet) vcl.ncsu.edu VCL is a true education cloud computing solution developed by NC State & in production for nearly a decade.

6. NC STATE UNIVERSITY IBM Leadership Data Center MCNC North Carolina Education Cloud Powered by VCL Representing the opportunity for a seamless integration of resources from the state of NC and the IBM Leadership Data Center facilities through cloud computing Public Schools of North Carolina K-12 The University of North Carolina System North Carolina Community College System Cost-effective, secure and “green” state-wide on-demand delivery and sharing of educational content and state-of-the-art information technology resources and support. Infrastructure that enables “Race to the Top”

7. Various MD-based Education Clouds: Morgan State, UMBC, Hood, etc. Various Texas –based Education Clouds: UTEP, Paririe View, etc. Various Ontario-based Education Clouds: Led by U Ottawa, Carleton, etc. Various TN-based Education Clouds: TSU & TBR, Columbia State CC, etc. Alberta Education Cloud: Led by Cybera, for U Alberta, etc. Cal State System TitanCloud: Cal State Fullerton, East Bay, etc. Various GA-based Education Clouds: GSU, AASU, etc. Various Mexico-based Education Clouds: Tec Monterrey, etc. Southern U Education Cloud (Louisiana) Howard U Education Cloud (Wash DC) Alabama A&M Education Cloud Various SC-based Education Clouds: Clemson, U of SC, Citadel, etc. Chicago IIT Education Cloud FIU Education Cloud (Florida) Virginia VCL: GMU, VT, ODU, NSU, etc. PSB Education Cloud (Pennsylvania) Various NY-based Education Cloud:s: SUNY, Marist, etc. MST Education Cloud (Missouri) VCL-based Education & Research Clouds in North America HBCU Cloud: NCA&T, NCCU, WSSU, Howard, Southern, TSU, MSU, AA&MU, NSU NC State Education Cloud: NC State, & UNC System, NC CCs, K-12 Other clouds starting in Poland, Croatia, Portugal, Middle East, etc.

8. Reservation Times: From 30 min to open-ended Load Times: From 30 sec to 20 min (service dependent, 80+% in less than 2 min) VCL Services Non-Persistent and Persistent Augmentation Actual sole-use bare-metal, or virtual images HaaS, IaaS, PaaS, AaaS, [SaaS, CaaS] VDI Undifferentiated Resources Single Seat (VCL-Desktop) Multiple Synced Seats (VCL-Class) Servers (VCL-Server) Aggregates (VCL-Cloudlets) HPC Clusters (VCL-HPC) Hadoop VCL Agent Differentiated Resources Supercomputers Labs, Other clouds, … e.g., System Z (mainframes) IBM EC2 Storage GP & HPC

9. Apache VCL cloud management stack (code: GUI, db, management daemon, image library) NC State Education Cloud: Built with IBM technologies Smart Cloud Enterprise Public-private hybrid cloud enabled by VCL plug-in Amazon EC2 VCL API-driven plug-ins Administration subcloud With latest release VCL will support ERP, LMS and other business admin apps Self-service portal Provides clusters (incl. Hadoop), bare metal or virtual machines (VMware, KVM, etc.) with any SW image suite; other clouds; HaaS etc. HPC subcloud Using LSF manager at NC State, hardware deployment via xCAT (Exploration around Condor at Clemson) VDI subcloud Vmware View, Citrix XENDesktop,, RHEV, Verde, tc. IaaS subcloud Using Smart Cloud Provisioning (SCP), KVM-based, currently using HSLT, moving to OpenStack) PaaS subcloud In futrure, could be provided by IWD or Pure Systems. Can also deploy Smart Education Platform.

10. Cloud architecture for NC VCL250K users, ~3K servers Apache VCL (cloud management stack) HSLT plug-in, to be replaced by OpenStack plug-in (from Tivoli CTO) xCAT plug-in (bare metal) Native KVM & Vmware plug-ins: using Libvirt, can support all hypervisors SCE, EC2, VDI, other plug-ins Common IBM Cloud Stack Deploys to all xSeries, soon enabled for Power and Z All major hypervisors supported Work with IBM BlueGene IBM Workload Deployer Composite patterns integrated with SCP 1Q2012 Advanced orchestration & cloud management in 1H2012 Smart Cloud Provisioning (IaaS) Image Management High Scale, Low Touch Server technology: Hardware agnostic, but NC cloud is built on IBM HSxx servers iDataPlex at GSU VCL code can be installed on BFC HV Shims Integrated 1Q2012 VMware vCenter VM Control / Director Storage technology: NC cloud uses SONA S and StorWize V700 virtual storage z/VM PowerVM VMware ESXi Xen KVM Hyper-V 1Q2012

11. VCL-IBM Integration Efforts Apache has been successfully replaced by IBM HTTP Server (IHS) Integrated ITUAM (IBM Tivoli Usage & Accounting Manager) SPSS SaasS on VCL IBM TCR (Tivoli Common Reporting) has been running in VCL for several years Create VCL images of all AI SW, starting with Rational. & analytics (incl. healtcare IT & Analytics subclouds) MySQL has been successfully replaced by IBM DB2 &/or Derby CastIron has been deployed as a VCL image, IBM Mirage technology has been running in VCL for several years Integrate future WebSphere.PaaSsolns. ITM agents are already installed on many images in the VCL Image Library, Enable VCL to deploy to Power 7 blades, System z & BlueGene. Showcase IBM StorWize V7000 Unified virtual storage in VCL. IBM SONAS is running in VCL. IBM Director (with VSPs) has been successfully integrated with VCL (POC ) VCL has been installed on the IBM BladeCenter Foundation for Cloud Integrated Tivoli Smart Cloud Provisioning as a provisioning node Integrated IBM Smart Cloud plug-in as a provisioning node An image of the VCL code has been been successfully installed in WCA. Already Integrated Integration to be done 11

12. ESM MM ESM OPM Small VCL Configuration • 1 BladeCenter E chassis • 2 Ethernet Switch Modules (BNT Layer 2/3 copper) • Power supplies 3&4 (for 7 or more blades) • Chassis network module to connect management node to storage • Fiber Channel - Optical pass through • iSCSI - Copper pass through • 2-14 HSxy Blades • At least one blade configured to attach to external storage for Image Library (FC, iSCSI, …) • Server for scheduler, database, and management node • Server(s) to deliver VCL services • Storage for Images • FC or iSCSI storage array (few TB) • Virtual or Bare-metal • Mostly virtual (ESX/ESXi), KVM • xCAT or another loader Three Networks Public, Private, Management Intelligent Images, Security Can support up to 300 concurrent users under VM

13. IBM SmartCloud for Education • Apache VCL-based SmartCloud for Education solutions: • GBS VCL Quickstart Services in US; Silver Lining (business partner) outside the US • Services-integrated blade servers for VCL (including BFC or BladeCenter Foundation for Cloud) • IBM Smart Cloud Provisioning (SCP) & other Tivoli products IaaS) • API interface to the hosted IBM SmartCloud Enterprise • Special SPSS pricing/licensing for VCL users

14. Coming soon • Full support of administrative applications (long-term servers, multi-tenancy, persistent sessions, etc.) • One-click icon-based logon (for iPads or K-12) • Native KVM plug-in supports Libvirt – and therefore all major hypervisors • xCat enablement in support of Power & System z (& BlueGene project) • OpenStack & IWD plug-ins (and PureSystems integration?) • Internet2 community project • Private cloud equivalent to the Academic Skills Cloud – Rational, analytics, Tivoli, IOC – and WebSphere education programs (around WebSphere Liberty, BPM, WS Commerce, DataPower/appliances, System z) • SmarterEducation Platform showcase

15. Opportunities for Partnership • Apache VCL open source development community: • http://incubator.apache.org/projects/vcl.html • Mailing list vcl-dev@incubator.apache.org ; also vcl-user, vcl-commits • Web Site http://cwiki.apache.org/VCL • “VCL bootcamp” at NC State each summer (next will probably be July 2012) • VCL “Virtual Office Hours” every other Tuesday • IBM Cloud Academy and ICA CON

16. Back-up

17. Collaborating on transformative models & approaches IBM Cloud Academy The mission of the IBM Cloud Academy is to provide an organization for K-12 schools and higher education institutions who are actively integrating cloud technologies into their infrastructures to share best practices in the use of clouds and to collaborate with partners to create innovative cloud technologies and models. From IBM Cloud Academy Charter as developed by initial member institutions, 1Q 2010

18. IBM Approach to VCL Quickstart Services IBM Deliver Installed & Configured VCL Environment Via Remote Collaboration and Access to Servers Technical Team Lead and PM • Client Project Team • Works with Technical Lead and PM to define Scope & Schedule • Provides for remote access to hosting servers • Assures required SW Licenses are provided as needed • Accepts VCL Environment • Assists in transition to Support • Installation & Configuration: • Linux, Apache, Database, VCL Code, etc. • Creation of Prototype Virtual Images • Verification of Installation, Configuration, Virtual Images • Instruction & Training: • VCL Administration • Creation & Management of Virtual Images • Level 1 & Level 2 Trouble Shooting Techniques • Additional Support Available: • Creation & Management of Virtual Images • Upgrades to base VCL code IBM Technical Staff Problem Reporting, Tracking, and Resolution Level II

19. OpenStack is comprised of four core projects that form a complete IaaS solution + an Object Storage project IaaS IaaS Compute (Nova)Provision and manage virtual machines Dashboard (Horizon)Self-service portal Image (Glance)Catalog and manage server images Identity (Keystone)Unified authentication, integrates with existing systems Object Storage (Swift)petabytes of secure, reliable object storage Sources:http://ken.pepple.info/openstack/2012/02/21/revisit-openstack-architecture-diablo/

20. Announcing IBM PureSystems • The first members of a new family of expert integrated systems with: • Built-in expertise to address complex business and operational tasks automatically • Integration by design to tune systems for optimal performance and efficiency • Simplified experience from design to purchase to maintenance • IBM PureApplication System • Expert at: optimally • deploying and running • applications for rapid • time-to-value • Expert designed, integrated and optimized application aware platform • Platform patterns of expertise • Simplified management with a single console • IBM PureFlex System • Expert at: sensing and • anticipating resource • needs to optimize your • infrastructure • Factory integrated and optimized system infrastructure • Integrated management • Automation and optimization expertise • Optimized for performance and virtualized for efficiency • No compromise design with system level upgradability • Designed for cloud with flexibility and simplicity

21. Smarter Education Platform Products TeachersPrincipalsAdministrators Parents Students Researchers Smarter Education Platform Desire2Learn WebSphere Portal Extend (TBD) SPSS (DME) Learning & Instruction Analytics Smarter Education Platform Portal Curriculum & Standards Student PerformanceTeacher Performance True North Logic Instructional Design Cognos (Gwinnett, Hillsborough, EPMS) Professional Development & Teacher Assessment Reporting Learning Delivery AT&T Learner Profile Mobility & Billing Learning Object Repository Teacher Profile IBM Case Manager ePortfolio Instructional Intervention ePortfolio Longitudinal Formative Assessment ConnectEDU Data Mart Reporting Repository School-to-Career SLI & ETL (via ESB) (For Reporting Warehouse) SLI & ETL (via ESB) (For Application Data) Single Sign-On IBM Information Server Identity And Access Management (Upcoming Project) WebSphere ESB State Services Statewide SIS Tivoli Identity Manager Tivoli Access Manager (with WebSEAL) Tivoli Directory Server Single Sign-On Identity Access Manager User Directory Other Sources

22. A software solution that: Provides a single, powerful predictive analytics decision engine Includes pre-defined, user-friendly, and web-based applications to solve specific K-12 and Higher-Ed issues Combines institutional rules with predictive analytics to develop “what-if” scenarios to determine the best courses of action Deploys decisions across all areas of a school, district, college or university, leading to better decisions at every level Creates an environment in which administrators and educators become prescriptive in their actions and are confident that they’re making the right decisions, every time Makes it easy to view all available data about your students, faculty, campus, community or donors and perform analyses in real-time Bridges the gap between data analysis, predictive insights and improved outcomes by linking data to the personal interactions that occur every day What is IBM SPSS Decision Management for Education (DME)?