460 likes | 473 Views
Cloud Computing: looking forward to cloudy days in education. Wayne Pauley April 2011. The Big Switch. “We will probably see the spread of ‘computer utilities’ which like present electric and telephone utilities, will service individual homes and offices across the country”. Kleinrock , 1969.
E N D
Cloud Computing: looking forward to cloudy days in education Wayne Pauley April 2011
The Big Switch “We will probably see the spread of ‘computer utilities’ which like present electric and telephone utilities, will service individual homes and offices across the country” Kleinrock, 1969 “Goodbye ‘World Wide Web.’ Hello ‘World Wide Computer’ ” Carr, 2008 Virtualized Data Center and Cloud Introduction
Advancements in Information Technology PC/ Microprocessor Mainframe Next… Networked/ Distributed Computing Cloud Computing Mini Virtualized Data Center and Cloud Introduction
Business Drivers and IT Challenges • “70% of the budget to keep IT running, 30% available to create new value” “…that needs to be inverted” • Weeks of planning, justification, and deployment and then we’re stuck with it for 5 years – even if our needs change in a month…” “…or we could just buy it as a service – right now” • “Most of our legacy applications are stable and predictable” “…we need to incrementally improve efficiency without disruption” • “but, new, more dynamic and fluid approaches to IT must also be leveraged for new applications and changing legacy applications” “…new, revolutionary IT models are essential as well” IT Challenges Globalization Aging data centers Storage growth Application explosion Cost of ownership Security Complexity Acquisitions Time to Market Virtualized Data Center and Cloud Introduction
Data is Growing Exponentially 20090.8 Zettabytes • Shift towards user created, unstructured data changes storage needs • Secondary storage is the new primary storage • File-based storage raises major management issue • Online ingest of and access to large volumes of content Growingby aFactor of 44 202035.2 Zettabytes Source: IDC Digital Universe Study, sponsored by EMC, May 2010 :Virtualized Data Center and Cloud Introduction
Top Threats in the Cloud Loss of governance Lock-in Isolation failure Compliance risks Data protection Insecure or incomplete data deletion Malicious insider • Abuse and nefarious use of Cloud computing • Insecure interface and APIs • Malicious insiders • Share technology issues • Data loss or leakage • Account or service hijacking • Unknown risk profile Governance, Risk and Compliance
Why GRC & Security is Important • Consequences • Risk of fines for failed audits • TJX – total cost > $1b for breach • Heartland – estimated at more than $140m • Compliance concerns stall virtualization and Cloud • Audits time consuming and costly • Concerns of identifying risk and proper valuation • Breach • Regulation • Other? Governance, Risk and Compliance
Virtual Data Center Business Drivers & Benefits • Application level business continuity • Simplify and improve disaster recovery process • Ensure important applications receive resources required to meet business needs • Improved productivity, operational flexibility, and increased availability • Optimize resources - consolidate of servers, storage, and fabrics • Reduce hardware, power, cooling and space requirements • Reallocate resources with no downtime • Quickly and easily provision new servers • Secure desktops • Centralized management • Patch gold copies once, with automated roll-out Virtualized Data Center and Cloud Introduction
Virtualization to Cloud Evolution CAPEX OPEX Availability Responsiveness Compliance Time-to-market CAPEX OPEX Availability Responsiveness CAPEX OPEX Virtualized Data Center and Cloud Introduction
Benefits of Cloud • IT provisioning in minutes instead of weeks • Application development, testing, and QA are flexible and self-service enabled • Relocation from test and development to production is predictable and seamless • Resources scale fluidly to meet growing or reduced need • Service level easily adjusted after the fact • Resources granularly metered to optimize utilization and cost IT has more time to focus on the strategic; the LOB has more time to focus on the business Virtualized Data Center and Cloud Introduction
Service Models Virtualized Data Center and Cloud Introduction
Cloud Computing Definition Cloud Tenets • Deployment Models • Private Cloud • Public Cloud • Hybrid Cloud • Service Models • Software-as-a-Service (SaaS) • Platform-as-a-Service (PaaS) • Infrastructure-as-a-Service (IaaS) http://csrc.nist.gov/publications/drafts/800-145/Draft-SP-800-145_Cloud-definition.pdf Virtualized Data Center and Cloud Introduction
Definition Rapid Elasticity • Capacity can be scaled up, down, in, or out dynamically • Scaling is immediate • Licensing is also built to scale • Underlying hardware can be anywhere geographically Capabilities can be rapidly and elastically provisioned, in some cases automatically, to quickly scale out and rapidly released to quickly scale in. NIST Virtualized Data Center and Cloud Introduction
Measured Service • Definition • Cloud systems automatically control and optimize resource use by leveraging a metering capability at some level of abstraction appropriate to the type of service (e.g., storage, processing, bandwidth, and active user accounts). • Resource usage can be monitored, controlled, and reported providing transparency for both the provider and consumer of the utilized service. • NIST • Infrastructure operational costs incurred on a pay-per-use basis • Contractual obligations tied to price tiering • No obligation has the highest price Virtualized Data Center and Cloud Introduction
Definition Broad Network Access • Network is essential to consume the service • Endpoints can be of any type: • Smartphone, tablet, notebook, laptop, desktop, server, other applications Capabilities are available over the network and accessed through standard mechanisms that promote use by heterogeneous thin or thick client platforms (e.g., mobile phones, laptops, and PDAs). NIST Virtualized Data Center and Cloud Introduction
Resource Pooling • Definition Shared Resources • Infrastructure and services run on shared physical devices (e.g., multi-tenant) The provider’s computing resources are pooled to serve multiple consumers using a multi-tenant model, with different physical and virtual resources dynamically assigned and reassigned according to consumer demand. NIST Virtualized Data Center and Cloud Introduction
Definition On-Demand Self-Service • On-Demand • Customers incur no infrastructure capital costs and are charged an Operational Expense (OPEX) • Workload forecasting unnecessary • Demand trends are predicted managed by the provider • The underlying hardware may be anywhere geographically • Self-service • Resources directly/indirectly reserved by the customer via a web based portal and appropriate APIs A consumer can unilaterally provision computing capabilities, such as server time and network storage, as needed automatically without requiring human interaction with each service’s provider. NIST Virtualized Data Center and Cloud Introduction
Cloud Service Models Cloud Services
Cloud Service Models Sources: IDC 213197, 215504, 217579, 217945, 218252, 218938; Gartner 166525; the451Group Virtualized Data Center and Cloud Introduction
Examples of Cloud Eco-systems • Google Apps • SaaS - Gmail • SaaS - Docs • PaaS - Apps Marketplace • PaaS - Development • IBM Cloud Burst • Enterprise (IaaS) • Terremark • SAVVIS • SunGard • Rackspace • Microsoft • Components - Hyper-V & .NET • SaaS - Office 365 • PaaS - Azure • IaaS - Azure • Amazon Web Services (IaaS) • Elastic Compute Cloud (EC2) • CloudFront • SimpleDB • Simple Queue Service (SQS) • Simple Storage Service (S3) • Elastic Block Storage (EBS) Virtualized Data Center and Cloud Introduction 20
Cloud Deployment Models Cloud Service Provider Enterprise X Enterprise Q Enterprise P Dedicated for Enterprise X Cloud Service Provider Virtualized Data Center and Cloud Introduction
Data Center Evolution • Data Center to VDC (short term) • Compute: Automated VM restart, resource pooling • Network: 10 GbE • Storage: Virtual provisioning and storage tiering • Applications: Migrating/re-working applications • VDC to Cloud (long term) • Network: WAN technologies, rapid elasticity • Storage: Erasure coding, rapid elasticity • Applications: Multi-tenancy, eventual consistency • VDC (mid term) • Compute: Elastic • Network: Unified fabric • Storage: Storage resource pools • Applications: Clustering and scaling Designing for Virtualized and Cloud Environments
Concepts in Practice: Scenario • Disruptive Relocation Across Sites Key Challenges: • Improve resource utilization across sites • Eliminate service outages associated with VM migrations between sites MS Exchange MS Exchange MS Exchange MS Exchange Offline vMotion Synchronous Distance 100 Kms SharePoint 2007 SharePoint 2007 Stretched VLANs VMFS Volumes VMFS Volumes Third-Party Symmetrix VNX Third-Party Symmetrix VNX OTV Virtual Data Center Architecture
Disaster Recovery: Fault Resilience, Multi-Site Virtual Data Center Architecture
Evolution of IT Roles Imperative: Business and financial management IT Service Management Infrastructure-as-a- Service Software-as-a- Service Platform-as-a- Service New focus area: Cloud service Operations management • New roles emerging: • Cloud Architect • Cloud Admin • Cloud Capacity Planner • IT Automation Engineer Virtual Infrastructure Management Virtual Infrastructure Architecture Systems Storage Backup and Recovery Data Center Networks Security Traditional roles still essential Virtualized Data Center and Cloud Introduction 25
Using Hadoop to Handle Big Data • Open source software • Hadoop’s HDFS can store massive amounts of data • Scales up incrementally • Work coordinated among clusters of systems • Data distributed among multiple nodes within the cluster • Data analysis achieved by parallel processing across all the nodes Virtual Data Center Architecture
Analysis Using ‘’s Phased Approach Designing for Virtualized and Cloud Environments
EMC’s IT Phased Approach 2011 2012 2013+ VDI User Interface Cloud BYOC Client Mobile App Access Choice Computing Mobility Next Generation Business Systems (ERP, CRM) Next Generation Online Experience Integration Cloud Apps Unified User Experience Development Cloud Application Mobility Application Cloud eBusiness Enterprise Social Media Role-based Access BIaaS Info Services Predictive Analytics Information Governance Knowledge Management Enterprise Content Mgmt Master Data Management Collaboration as a Service Tiered Shared Virtualized Clusters Intra-Datacenter VM Mobility Inter-Datacenter VM Mobility VM Federation In Partner Datacenters Systems Tiered Shared Virtualized Storage Intra-Datacenter Storage Mobility Inter-Datacenter Storage Availability Storage Federation In Partner Datacenters Storage Data Center Networks Data Center Ethernet Multi-hop FCoE Datacenter Bridging Embedded Data Protection BRS Source and Target De-Dupe Archive De-Dupe Management & Automation Integrated Management Solutions (virtual) IT Automation Framework Automation Orchestration Intelligent Policy Based Resource Automation Auditing/ Compliance Framework Policy based Enforcement eGRC Framework Policy based Decisions Automated Policy Enforcement Point based solutions Security • Designing for Virtualized and Cloud Environments 28
Applications: Migrating to the Cloud Designing for Virtualized and Cloud Environments
Open Stack Cloud Initiative • Open source, open standards based Cloud • Includes compute and storage • Key members include: • Rackspace • NASA • Citrix • Dell • Compute based on XEN and KVM • Storage is software that is also object based Governance, Risk and Compliance
Datacenter Evolution • Dedicated servers • DAS & small SANs • Tape backup • Monolithic apps • Tiered, virtualized app hosting platform • De-duplicated backup • Enterprise services • Virtualized dedicated servers • Tiered SANs • Disk-based backup • Monolithic apps • 100% virtualized • X86 architecture • SAN driven replication architectures Summary 31
Service Management Customer Portal Knowledge Bank Service Catalog Issues & Requests Reporting Approvals Service Desk Service Level Agreements Request Fulfillment Incident Management Problem Management Change & Release Management Federated CMDB Events Discovery Provisioning and Automation API’s Tools Protocol Tools Infrastructure Layer VDC Layer Cloud Services Layer Managing Virtualized Environments
A Before View: Traditional Development Environment • Developer • Writes code on workstation in an individual development environment (IDE , ex .NET, Java, or Python) • Pushes code to Development Server • Code runs through a successful build • EXE is sent to QA/Test • When passes QA/Test, application is moved to production environment • Customer uses production image • All infrastructure is “silo’d” • Infrastructure belongs to the department • Even engineering is silo’d Dev Server QA/Test Production Windows or Linux Customer Cloud Services
Transformation to IaaS to PaaS to SaaS • Developer WS runs IDE • IDE is linked live to PaaS environment • Engineer can self-serve VM’s for test and QA or other IDEs • VM policy pushes code to top tier infrastructure • It is scale tested then turned over to production • Linkages via SOAP/REST are built into the apps • Apps can bind on the fly • Apps cross private & public Cloud boundaries T2 T1 Customer Paying Status .NET PaaS AP/AR VDI Scale Test Java PaaS Test E-Mail VDI Customer Expense Mgmt QA MAPS IaaS, PaaS SaaS SaaS Cloud Services
Extended Cloud Service - XaaS Cloud Services LifecycleBusiness Management ITSMSystem RESTful API vDC ServiceCatalogs ResourceDist System Provisioning Policy Provisioning Policy Access Policy Access Policy vApps vApps Automation Orchestration RESTful API vDC ServiceCatalogs Virtual Infrastructure ResourceCreationSystem vConnectivity vStorage vCompute Physical Infrastructure Storage Server Connectivity Cloud Services
Why the Cloud ‘for’ Education • Economics • Costs to deliver higher education • Funding loses force tough decisions • Competition • Match technology use to demands • Costs tied to usage • Community Cloud • Less need to be in the IT Business • Improves institutional focus on education development & delivery • Improves institutional agility & time to market • Examples: UMASS – Google Apps Course Introduction
Risk & Barriers of Cloud ‘for’ Education • Integration • Legacy to Cloud • Substantial Amount of Services – pro or con? • Security • Track record of providers • Security standards of provider • Governance, Risk, & Compliance • Legality of placement of Institutional data externally • Data Location – transborder issue • Standards • Traditional Standards Bodies - ISO, NIST, DMTF • New Standards Emerging – CSA, ENISA, OpenStack Governance, Risk and Compliance
Why the Cloud ‘in’ Education • Preparing students for a web services world • Virtualization of the full stack: Networks, Storage, & Servers • Platform_as_a_Service Frameworks • Microsoft .NET on Azure • Google Apps, App Engine (Python, Java, Eclipse), & Marketplace • IBM Software & System Access (Java, WebSphere, Lotus, Hadoop) • Modifying existing curriculum • Computer Science & Information Technology • Add virtualization and cloud topics & labs • Security (risk, forensics) & privacy (risk, compliance) • Other Sciences & Disciplines • Ethics in the Cloud • Law in the cloud • Data Scientists Governance, Risk and Compliance
EMC Academic Alliance Developing Tomorrow’s Information Storage Professionals…Today! • Partnering with hundreds of leading institutions of Higher Education worldwide • 30,000+ students educated in 30+ countries* • Offering unique ‘open’ course on Information Storage and Management • Focuses on concepts and principles, not products • Providing EMC, Customers and Partners with source to hire storage educated graduates • Opportunity for EMC to give back as the industry leader * As of Jan 2011 http://education.emc.com/academicalliance
Information Storage & Management (ISM) Modules Section 1: Storage System Intro to ISM Storage System Environment Data Protection: RAID Intelligent Storage System Section 2: Storage Networking Technologies & Virtualization DAS and Intro to SCSI Storage Area Networks Network Attached Storage IP SAN Content Addressed Storage Storage Virtualization Section 3: Business Continuity Introduction to Business Continuity Backup and Recovery Local Replication Remote Replication Section 4: Storage Security & Management Securing the Storage Infrastructure Managing the Storage Infrastructure http://education.EMC.com/ismbook
EMC Certification Define Service Request Service Self-Service Portal IT and Business Service Catalog Customer Configuration Management System Service Request Management Decommission Service Operations and Governance Perform Compliance and Financial Mgt Discovery and Automated Provisioning Virtualized Infrastructure vStorage vCompute Mgt Apps vConnectivity Middleware & APIs Business vApps Physical Infrastructure Course Introduction
Becoming an Academic Partner Steps . . . Institution enrolls via the EAA online application. http://info.emc.com/mk/get/EAA_APPL_form?src=&HBX_Account_Number=emc-emccom Institution identifies faculty to teach course and administer the program. Institution identifies faculty to attend the 5 day ISM Faculty Readiness Seminar (FRS) and clear ISM certification exam. Institution accesses secure Faculty website to download teaching aids such as chapter PowerPoints, quizzes, simulators, etc. Institution promotes ISM course to students. Institution schedules and begins teaching the ISM course.
References EDUCAUSE white paper: Shaping the Higher Education Cloud - http://net.educause.edu/ir/library/pdf/PUB9009.pdf Is Cloud Computing a Credible Solution for Education? http://campustechnology.com/articles/2009/11/12/is-cloud-computing-a-credible-solution-for-education.aspx Google Apps for Education - http://www.google.com/a/help/intl/en/edu/ IBM Academic Cloud - https://www.ibm.com/developerworks/university/academicinitiative/ Microsoft Cloud for Education - http://www.microsoft.com/education/solutions/cloudcomputing.aspx Microsoft white paper: Cloud Computing in Education http://download.microsoft.com/download/4/1/8/4182DF40-7EA3-4C13-91D0-E3B75D639590/Cloud_computing_in_education.docx Sungard Higher Education - http://www.sungardhe.com/ CampusCruiser - http://www.campuscruiser.com/ Course Introduction
Recommended Reading Introduction to VDC and Cloud The Big Switch: Rewiring the World, from Edison to Google - by Nick Carr Management Strategies for the Cloud Revolution: How Cloud Computing Is Transforming Business and Why You Can't Afford to Be Left Behind – by Charles Babcock Private Cloud – www.privatecloud.com VDC & Cloud Architecture Cisco: A Beginner's Guide, Fourth Edition - by Toby and Anthony Velt Mastering VMware vSphere 4 - by Scott Lowe Open Stack - http://www.openstack.org/ VMware vSphere and Virtual Infrastructure Security – by Ed Heletky vSphere 4.1 Security Hardening Guide - http://communities.vmware.com/docs/DOC-14548 VMware vCloud Director Security Hardening Guide - http://www.vmware.com/files/pdf/techpaper/VMW_10Q3_WP_vCloud_Director_Security.pdf Business Continuity Planning IT Survival Guide, Computer Associates, 2008 - http://new.techdata.com/techsolutions/Softwareconnections/files/may2010/CA%20Business%20Continuity%20Planning%20IT%20Survival%20Guide.pdf Course Introduction
Recommended Reading (cont) VDC & Cloud Planning & Design Cloud Application Architecture: Building Applications and Infrastructures in the Cloud - by George Reese Host your web site in the Cloud: Amazon Web Services Made Easy: Amazon EC@ made Easy – by Jeff Barr Governance, Risk, & Compliance Governance, Risk, and Compliance – by Anthony Tarantino Cloud Security Alliance(CSA) Guidance - http://www.cloudsecurityalliance.org/csaguide.pdf European Network and Information Security Agency (ENISA) - http://www.enisa.europa.eu/ Shared Assessments - http://www.sharedassessments.org/ Course Introduction
Recommended Reading (cont) VDC & Cloud Management Virtualization Opportunities, Threats and Challenges, ZISC Colloquium -http://www.zisc.ethz.ch/events/slides_ZISC_colloq_HS2009/consecom_zisc-talk-20091124_presentation.pdf Tackle the Challenges of Virtualization Management, BMC Best Practices White Paper, undated - http://documents.bmc.com/products/documents/00/61/100061/100061.pdf Virtualization Challenges Whitepaper, http://www.technologent.com/Documents/VirtualizationChallenges_Jan2009.pdf Keeping Your Head Above the Cloud: Seven Data Center Challenges to Consider Before Going Virtual, http://www.f5.com/pdf/white-papers/challenges-to-virtualization-wp.pdf Web Operations: Keeping the Data on Time by John Allspaw and Jesse Robbins Cloud Services Cloud Computing and SOA Convergence in Your Enterprise: A Step-by-Step Guide - by David Linthicum Cloud Computing Best Practices for Managing and Measuring Processes for On-demand Computing, Applications and Data Centers in the Cloud with SLAs - by Michael Miller SOA in Practice: The Art of Distributed System Design (theory in practice) – by Nicolai Josuttis Cloud Computing Explained: Implementation Handbook for Enterprises - by John Rhoton Governance, Risk and Compliance