2012 华东架构师大会

1. 2012华东架构师大会 演讲主题：云计算与下一代IDC的架构与运维 • 演讲嘉宾：李志霄

2. Cloud Fundamentals Infrastructure as a Service (IaaS): basic compute and storage resources On-demand servers Amazon EC2, VMWarevCloud Platform as a Service (PaaS): cloud application infrastructure On-demand application-hosting environment E.g. Google AppEngine, Salesforce.com, Windows Azure, Amazon Software as a Service (SaaS): cloud applications On-demand applications E.g. GMail, Microsoft Office Web Companions

3. 今天的IT部署方式与时俱进了吗？ • 今天许多CIO，CFO仍然在—— • 投资昂贵的设备-服务器，路由器。磁盘（CAPEX）; • 等待一两年的项目实施的周期; • 承担项目开发和上线的风险; • 为维护系统，灾备而烦恼; • 缺乏弹性-业务需求变化造成设备，带宽闲置（被投资人骂翻）或不足（被用户骂翻）。 • 基于运算与知识的服务将成为社会化的服务（utility-水电气） • 把大规模、分散的计算资源整合为可以按须提供服务的计算资源，提高了IT设施的利用率，降低了成本和用户使用门槛

4. The Benefits of the Cloud The Cloud is about cheap, on-demand capacity Eg Windows Azure

5. Your options increase with the Cloud Store data in the Cloud Extend application to the Cloud Move application to the Cloud Combine Cloud services to create new sol’n. Create new Cloud service

6. 生态系统鸟瞰图 –认识自己（Ecosystem） • 3G/4G LTE • ADSL/WiFi/Femtocell/FTTX • 高速卫星宽带 • 数据中心/IaaS • SaaS/PaaS • XaaS 信息电厂 信息电网 elecom TIME 云端产业 T edia ntertainment 信息电器 Connected Device

7. 数据中心也在向增值服务与时俱进Migration to Value Added Services Colocation Model Managed Services Model Managed Hosting Model Cloud Model Utility Hosting Server, Storage Server, Storage Customer Server Consulting Consulting 21V Managed Customer Server,Mgmt Ops,Mgmt, Monitor Ops,Mgmt, Monitor Install,test, Monitor,RH IP BW, IP VPN IP BW, IP VPN 21V Managed IP BW IP BW Colo, Power Colo, Power Colo, Power Colo, Power

8. A Paradigm Shift 思维转换 因此我们有必要及早定位云计算产业链、布局关键环节 云计算就是把廉价 硬件（COTS）软件化软件服务化 服务运营化 运营规模化 的一套技术和业务模式 云计算产业正从传统IT产业和互联网产业中脱胎换骨，以全新的形态呈现在人们眼前 今天的IT竞争已经不是企业的竞争，也不是产品的竞争，而是进入了一场产业链竞争 （Wintel-8/2开放/封闭式，苹果-99.9/0.1封闭/开放式）

9. Cloud Services True Cloud IDC Most of Today’sCloud IDC Customer Manages You Manage You Manage • Infrastructure • (as a Service) • On Premises • Platform • (as a Service) • Software • (as a Service) You Manage Vendor Manages Vendor Manages Vendor Manages Applications Applications Applications Applications Data Data Data Data Runtime Runtime Runtime Runtime Middleware Middleware Middleware Middleware O/S O/S O/S O/S Virtualization Virtualization Virtualization Virtualization Servers Servers Servers Servers Storage Storage Storage Storage Networking Networking Networking Networking

10. Example: Windows Azure Components

11. What a “Cloud OS” should be: • Cloud OS= OS for the data center • Model: Treat the data center as a machine • Handles resource management, provisioning, and monitoring • Manages application lifecycle • Allows developers to concentrate on business logic • Provides shared pool of compute, disk and network • Virtualized storage, compute and network • Illusion of boundless resources • Provides common building blocks for distributed applications • Reliable queuing, simple structured storage, RDBS storage • Application services like access control and connectivity

12. The “Heart and Soul” of Cloud OS--Fabric Controller (FC) • The “kernel” of the cloud operating system • Manages datacenter hardware • Manages Windows Azure services • Four main responsibilities: • Datacenter resource allocation • Datacenter resource provisioning • Service lifecycle management • Service health(fault, performance) management • Inputs: • Description of the hardware and network resources it will control • Service model and binaries for cloud applications Server Kernel Process Datacenter Fabric Controller Service Word SQL Server Exchange Online SQL Azure Windows Kernel Fabric Controller Server Datacenter

13. Windows Azure Fabric Controller I Windows App SQL Server Azure App SQL Azure Windows Server Windows Azure Windows Kernel Fabric Controller Server Hardware DataCenter

14. Windows Azure Fabric Controller

15. Modeling Cloud Applications • A cloud application is typically made up of different components • Front end: e.g. load-balanced stateless web servers • Middle worker tier: e.g. order processing, encoding • Backend storage: e.g. SQL tables or files • Multiple instances of each for scalability and availability

16. CDN caching integration HPC business analytics media commerce identity & security compute data management networking VMs websites cloud services connect virtual network blob SQL database noSQLdatabase traffic manager Global Physical Infrastructure servers/network/datacenters automated managed resources elastic usage based

17. There Are Three Ways to Get Started Using Windows Azure Compute: compute data management networking VMs websites cloud services connect virtual network blob SQL database noSQLdatabase traffic manager Cloud Services – Capture the full benefits of the cloud that quickly scale up or down. Infrastructure management is all done by Microsoft, so you can focus your resources on building the best app. Virtual Machines – Instantly run your existing applications and infrastructure in a VHD image. You retain full control to configure and maintain the image. Capture some benefits of the cloud including load balancing and failover. Web Sites – Quickly and easily deploy sites to the cloud with support for multiple frameworks and popular open source applications including WordPress, Drupal, Joomla! and Umbraco.

18. compute data management networking Windows Azure Cloud Services Cloud Services come in two Flavors: A place for your application code to run… Web role is pre-configured with IIS Worker role is for backend, asynccode You package your code/artifacts and Windows Azure deploys and manages it for you automatically VMs websites cloud services connect virtual network blob SQL database noSQLdatabase traffic manager Web Role Worker Role

19. compute data management networking Windows Azure Virtual Machines cloud services Getting Started Select Image and VM Size New Disk Persisted in Storage VMs websites connect virtual network blob SQL database noSQLdatabase traffic manager Boot VM from New Disk Management Portal Blob Storage Scripting (Windows, Linux and Mac) REST API(for service mgmt) Cloud

20. REST API The Windows Azure SDK provides several APIs for programming in the Windows Azure environment The Windows Azure Service Management API is a REST API for managing your storage accounts and service deployments . 服务管理 API是一个REST API, 可以管理Windows Azure存储账户和托管部署服务。It provides programmatic access to much of the functionality available through the Management Portal. All API operations are performed over SSL and mutually authenticated using X.509 v3 certificates. 所有API操作均需要进行基于SSL的身份验证和使用X.509 v3的证书.The management service may be accessed from within a service running in Windows Azure, or directly over the Internet from any application that can send an HTTPS request and receive an HTTPS response. 。 • REST API在Azure两种服务类型的应用 • Storage Accounts: 提供访问Windows Azure Blob, Queue, and Table 的服务. 可以实现管理现有的Storage Account，实现在订阅清单包含存储账户信息；返回存储账户属性；重新生成密钥。 • HostedServices: 提供在Azure环境中部署 Web Role; Work Role ;VM Role。 可以创建、删除部署；返回一个托管服务的属性；更新升级，重启，和管理已经部署的服务。

21. Windows Azure Storage Service: eg Create Storage Account POST https://management.core.windows.net/<subscription-id>/services/storageservices REST API(POST，GET，PUT或DELETE) Blob Queue Load Balance Table REST(Representational State Transfer)

22. compute data management networking Windows Azure Web Sites cloud services VMs Quickly and easily deploy sites to a highly scalable cloud environment with the frameworks and open source apps of your choice using Windows Azure Web Sites websites connect virtual network blob SQL database noSQLdatabase traffic manager Supported Deployment Protocols Supports multiple frameworks (ASP.NET, Classic ASP, PHP, Node.js) Pick from popular Open Source apps Pick your DB (SQL Database, MySQL) Choose your tools (Visual Studio, Git(一个开源的分布式版本控制系统), FTP, WebMatrix) Build on any platform (Windows, Mac, Linux) GIT : FTP 1010111001010101010001010100011 GIT : FTP 1010111001010101010001010100011 GIT : FTP Web Deploy : TFS Deploy 1010111001010101010001010100011

23. Application Deployed filename.cspkg + filename.cscfg Setting Loadbalance & DNS XML VHD GuestOS Agent HostOS Agent Storage(URL) Fabric Controller

24. 在Windows Azure上建一个免费的网站 • 在Windows Azure上建一个免费的网站时间:2012-07-16 19:46来源:风信网 作者:末信 点击:257次 我要评论 - • 如果你想建立一个低成本的网站但是又具有极好的扩展能力能满足业务和流量增长的需求， 或者 你想快速的建一个免费的网站，同时又有保障网站能稳定安全的运行，那么微软的Widnows Azure的websites新功能就能满足要求。如果我是一个刚起步不久的公司，或者我想做一个个人网站，我觉得Websites无疑是一个最佳的选择。 • Window Azure 在今年六月的IaaS预览版本里公布了Websites的新功能，用户可以在Windows Azure上建十个免费12个月的网站（是不是对现在的一些网站托管很有压力？），主要的优点： • 快速便捷- 用户可以容易地轻点几下鼠标，就能建立一个网站，免去网站托管和域名申请等繁琐的步骤 • 多种开发语言和平台的支持 – websites支持ASP.NET, 传统的ASP, PHP, Node.js，支持Windows, Mac, Linux，支持SQL Server ,SQL Azure, MySQL的数据库 • 优秀的可扩展性-在Azure上建网站可以充分利用到Azure的可扩展性的能力，随着网站流量的增加，可以随时增加资源来支持网站 • 原文出自【风信网】，转载请保留原文链接：http://www.ithov.com/server/118212.shtml

25. The Windows Azure Service Model • A Windows Azure application is called a “service” • Definition information • Configuration information • At least one “role” • Roles are like DLLs in the service “process” • Collection of code with an entry point that runs in its own virtual machine • There are currently three role types: • Web Role: IIS7 and ASP.NET in Windows Azure-supplied OS • Worker Role: arbitrary code in Windows Azure-supplied OS • VM Role: uploaded VHD with customer-supplied OS

26. compute data management networking cloud services VMs Windows Azure offers multiple ways to manage your data in the cloud. SQL Database, formerly known as SQL Azure Database, enables you to rapidly create, scale and extend applications in the cloud using familiar tools and skills. SQL Database also includes features that enable easy migration, export and ongoing synchronization through SQL Data Sync of on-premises SQL Server databases with Windows Azure databases. Tablesoffer manual, key-based access to un-schematized data at a low cost for applications with simple data access needs. Blobsprovide inexpensive storage of video, audio and images. websites connect virtual network blob SQL database noSQLdatabase traffic manager Data Management are a set of managed services having a 99.9% monthly SLA

27. compute data management networking SQL Database cloud services VMs websites Cloud relational database based on SQL Server engine Use same tools, data access frameworks, T-SQL based language Global datacenters High Availability & Redundancy Reads are completed at the primary Writes are replicated to a quorum of secondaries Single LogicalDatabase Multiple PhysicalReplicas connect virtual network blob SQL database noSQLdatabase traffic manager Replica 1 Replica 2 Multiple Secondaries Single Primary Replica 3

28. compute data management networking SQL Data Sync (easier to access,security, compliance, DR, etc.) cloud services VMs websites On-Premises Cloud connect virtual network blob SQL database noSQLdatabase traffic manager Application • Geo-located web applications • Use with Windows Azure Traffic Manager • Hybrid applications; one-way publish or two-way sharing SQL Server Application Application Application Application • Multiple locations (e.g. branch office, retail offices); share data between locations and/or aggregate data in cloud Application SQL Database SQL Database SQL Database SQL Database • Scale-out via multiple copies of data • E.g. Separate reporting & OLTP workloads; multiple Web sites SQL Server

29. SQLAzure Data Sync Reporting DBMS Azure Sync SQL Azure DB Data Sync TDS(Tabular Data Stream) protocol Two kinds of data sync

30. compute data management networking cloud services VMs websites SQL database Extend your network into the cloud Treat your Windows Azure services as if they are on your own corporate network. Enables services in Azure (e.g. SQL Database) to use services on-premise (e.g. Active Directory) directly. Increase performance and availability of services Redirect user to best/closest deployment. Redirect traffic to another deployment based on availability. Traffic is distributed equally to all cloud services. connect virtual network blob noSQLdatabase traffic manager

31. compute data management networking Windows Azure Networking cloud services VMs websites SQL database connect virtual network blob noSQLdatabase traffic manager Windows Azure Roles Connect For developers Designed for developers so it is simple to setup, easy to manage and can be rapidly provisioned On premise machines

32. compute data management networking cloud services VMs websites SQL database Windows Azure Networking connect virtual network blob noSQLdatabase traffic manager • Virtual Network • For network administrators • Provides network admins the control to setup subnets in the Cloud and manage them as extensions of on-premise datacenters On-premise subnets Subnets in WindowsAzure

33. compute data management networking Windows Azure Traffic Manager cloud services VMs websites SQL database www.foo.com Load balance user traffic across cloud services running in same or different datacenters to build globally available, high performing apps CNAME connect virtual network blob noSQLdatabase traffic manager foo.trafficmgr.cloudapp.net • Load-balancing • Endpoint monitoring DNS based traffic management based on policies: Performance, Round- robin, Failover Policies Improve app performance by serving user requests with services ‘closest’ to them Cloud Service Improve app availability by automatically failing over when a service goes down Cloud Service Cloud Service

34. CDN caching Windows Azure Active Directory is a modern cloud service providing identity management and access control capabilities to cloud applications, whether those are Windows Azure applications, Microsoft Office 365, Dynamics CRM Online, Windows Intune or other 3rd party cloud services. HPC integration business analytics media commerce identity & security A modern cloud service providing identity management and access control capabilities to cloud applications Easily integrate Live ID, Facebook, Yahoo, Google, & Active Directory for application single sign-on. Support for industry standards and existing .NET APIs.

35. Windows Azure Active Directory (Identity & Security) CDN caching HPC integration business analytics media commerce identity & security A modern cloud service providing identity management and access control capabilities to cloud applications (通过对诸如WRAP和SAML之类的标准协议的支持,ACS will perform sign-in with any OpenID 2.0 identity provider-Google, Facebook, Yahoo) ADFS 2.0 On-Premises Active Directory Windows Azure Active Directory ACS V2 Microsoft Apps Federation Trust Your Apps 3rd Party Apps

36. CDN caching integration HPC business analytics media commerce identity & security Media Services enable Content Companies and Solution Providers to build end-to-end media workflows on Windows Azure. Windows Azure Media Services are easy to use, flexible, and provide cost-effective and fully customized solutions that can create, manage, and distribute content for all the devices and platforms you care about. Media Services provide a scalable and reliable infrastructure allowing you to focus on your core business and the valuable features that differentiate your products.

37. Windows Azure Media Services CDN caching integration HPC business analytics media commerce identity & security Media Services enable Content Companies and Solution Providers to build end-to-end media workflows on Windows Azure. 3rdParty CDN Broadcasters Network Operators Content Owners Enterprises Windows Azure CDN Windows Azure Media Services Encoding FormatConversion Content Protection On-Demand Streaming Live Streaming Analytics Rental | Subscription | Purchase | Free

38. What PaaS IDC is: • Provides Platform as a Service • Application Platform in the Cloud • Provides: • Compute • Web, Worker & VM Role • Storage • Blob, Table, Queue & RDBS Server • Application Fabric • Service Bus, Access Control, Cache, Integration

39. CDN caching HPC integration business analytics media commerce identity & security compute data management networking VMs websites cloud services connect virtual network blob SQL database noSQLdatabase traffic manager Global Physical Infrastructure servers/network/datacenters automated managed resources elastic usage based

40. Datacenter Architecture Datacenter Routers Aggregation Routers and Load Balancers Agg Agg Agg Agg Agg Agg LB LB LB LB LB LB LB LB LB LB LB LB Top of Rack Switches TOR Nodes Nodes TOR TOR Nodes Nodes TOR TOR Nodes TOR Nodes TOR Nodes TOR Nodes Nodes TOR Nodes TOR Nodes TOR Nodes TOR TOR Nodes Nodes TOR Nodes TOR … … … … … … Racks PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU Power Distribution Units Fault Domain

41. Hardware & Network Topology

42. High Availability: Fault Domains • Purpose: Avoid single points of failures • Unit of failure based on data center topology • E.g. top-of-rack switch on a rack of machines • Windows Azure considers fault domains when allocating service roles • E.g. don’t put all roles in same rack

43. OSS(Equipment(network, server, storage) and SW health monitoring and control)-necessary for any kind of cloud

44. BSS(online/offline sales, billing/finance, marketing BI, CC, ICP Compliance, etc.)-necessary for public cloud

45. Challenges-Securityand Interoperability • Security • Confidentiality • Free from attacks • Service Level Agreement • SLA must assure QoS (quality-of-service), e.g., service response time • Interoperability • Ensure a cloud service user can move from one cloud service to another Source:Lin, G., Fu, D., Zhu, J. and Dasmalchi,G.,“Cloud Computing:IT as a Service,” IT Pro March/April 2009

46. IT 部署边界的演变:基础设施虚拟化/服务管理标准化、自动化-四大板块虽会有消长，但都会继续存在，尤其是核心应用-可定制性， 合规要求，业务流程引擎，业务规则引擎（通用云平台面向企业应用的短板） Video Conferencing Email IM 开发测试 存储 增值型云托管 Cloud Hosting-不同客户的不同应用可以共享资源 企业内共享应用-不同应用可以共享资源 ERP SCM CRM Email Search Identity/Security 存储 传统托管/租赁托管，多用户数据中心 Colocation， Managed Hosting-资源为客户拥有或专用 Finance HR 企业机密 政务内网 存储 eMail Search ERP CRM SCM 存储 企业内核心应用-不同应用所需的资源均保持独立

47. 互操作性 共享的面向服务体系结构 （如http, XML, SOAP, WSDL, UDDI） 文档

48. Service Bus

49. What is it ? • Extension to the familiar WCF binding model • SOAP/HTTP • SOAP/TCP • HTTP • Simple HTTP APIs for service Management • Service Registry (Atom Publishing Protocol) • Message Buffer(REST) • Fully integrated with Access Control Service

50. Service Bus Service Bus Send Send Receive Receive App 1 App 2 • Exchange messages between loosely coupled applications • Network send/receive from any internet connected device • Traverse NAT /Firewall • Message buffering for loosely connected applications • Facilitate direct peer-to-peer connection