480 likes | 581 Views
9 th Hellenic Data Management Symposium. An introduction to. Dimitris – Ilias Gkanatsios Academic Developer Evangelist Microsoft Hellas – Microsoft Innovation Center, Greece. Agenda. What is cloud computing Windows Azure platform Fabric Storage “Dallas” SQL Azure Venus – C project
E N D
9th Hellenic Data Management Symposium An introduction to Dimitris – IliasGkanatsios Academic Developer Evangelist Microsoft Hellas – Microsoft Innovation Center, Greece
Agenda • What is cloud computing • Windows Azure platform • Fabric • Storage • “Dallas” • SQL Azure • Venus – C project • Microsoft Academic Programs
Cloud Computing Cloud Services On-Premises • Infrastructure • Store Data • Run Applications • Combined with: • Utility model • Elastic Nature
Workload Patterns Optimal for Cloud “Growing Fast“ “On and Off “ Inactivity Period Compute Compute Average Usage Usage Average Time Time • On and off workloads (e.g. batch job) • Over provisioned capacity is wasted • Time to market can be cumbersome • Successful services needs to grow/scale • Keeping up w/growth is big IT challenge • Complex lead time for deployment “Unpredictable Bursting“ “Predictable Bursting“ Compute Compute Average Usage Average Usage Time Time • Unexpected/unplanned peak in demand • Sudden spike impacts performance • Can’t over provision for extreme cases • Services with micro seasonality trends • Peaks due to periodic increased demand • IT complexity and wasted capacity
The Windows Azure Platform The Windows Azure Platform • Developer Experience • Use existing skills and tools. Relational data Management platform Compute Storage Management AppFabric Flexible APIs Connectivity Access control Information Marketplace Reporting & BI Billing & Payments
Windows Azure Platform: An Illustration platform CLOUD Applications 3rd Party Services Applications Others…
Windows AzureAn illustration Application Compute Storage Fabric Config AppFabric SQL Azure Applications 3rd Party Services Windows Azure Applications Windows Server Windows Vista/XP Windows Mobile Others
Windows Azure Compute Service A closer look HTTP/TCP Web Role Worker Role main() { … } HTTP ASP.NET, WCF, etc. IIS Load Balancer Agent Agent Fabric Application Storage Compute Fabric VM …
Windows Azure Your Service DNS LB Web Portal (API) LB Fabric Controller
Service Deployment Service Service Service Model Your Service DNS LB Web Portal (API) DNS config LB Fabric Controller
Service Scaling Your Service Service Service DNS Service Service Service Service Service LB Service Web Portal (API) LB Model Fabric Controller
Service Monitoring & Recovery Your Service Service DNS Service Service Service LB Web Portal (API) ! LB Model Fabric Controller
Windows Azure Storage ServiceA closer look HTTP Blobs Tables Queues Application Storage Compute Fabric …
Windows Azure StorageA closer look at tables . . . Table Table Table Entity Entity Entity . . . Storage Accounts Property Property Property Name Type Value
Using QueuesThe suggested application model To scale, add more of either main() { … } Worker Role Web Role 1) Receive work 4) Do work ASP.NET, WCF, etc. 2) Put work in queue 3) Get work from queue Queue
SQL Azure • Initial Services • Database – Core SQL Server database capabilities • Future Services • Data Sync – Enables the sync framework • Additional SQL Server capabilities available as a service: Business Intelligence and Reporting Data Sync Reporting Business Intelligence Database
SQL Azure Database Highly scaled out relational database as a service • Relational database service • SQL Server technology foundation • Highly symmetrical • Highly scaled • Database “as a Service” – beyond hosting SQL Azure Database (Windows Azure Compute) Browser SOAP/REST HTTP/S Astoria/REST - EDM HTTP/S • Customer Value Props • Self-provisioning and capacity on demand • Symmetry w/ on-premises database platform • Automatic high-availability and fault-tolerance • Automated DB maintenance (infrastructure) • Simple, flexible pricing – “pay as you grow” App Code (ASP.NET) App Code (ASP.NET) Windows Azure Compute T-SQL (TDS) T-SQL (TDS) SQL Server Reporting Server (on-premises) SQL Azure Database MS Datacenter - AD Federation (LiveId /.NetSvcs ACS)
Application Topologies SQL Azure access from within MS Datacenter (Azure compute) SQL Azure Access from outside MS Datacenter (On-premises) SQL Azure Access from within and outside MS Datacenter (On-premises & Azure Compute) SQL Server App code/ Tools App code/ Tools Application/ Browser SOAP/REST HTTP/S Astoria/REST - EDM HTTP/S Windows Azure SQL Azure Data Sync Windows Azure App Code (ASP.NET) App Code (ASP.NET) T-SQL (TDS) App Code (ASP.NET) App Code (ASP.NET) T-SQL (TDS) T-SQL (TDS) Windows Azure SQL Azure SQL Azure SQL Azure Hybrid Code Near Code Far
SQL AzureDeployment Web Portal (API) DB Script SQL Azure TDS
SQL AzureAccessing databases Web Portal (API) Your App SQL Azure TDS Change Connection String
SQL AzureDatabase Monitoring & Recovery Web Portal (API) ! Your App SQL Azure TDS
Windows® Azure™ Platform AppFabric
AppFabricInfrastructure in the cloud Access Control Service Bus AppFabric SQL Azure Applications ? 3rd Party Services Windows Azure Applications Windows Server Windows Vista/XP Windows Mobile Others
Access Control Access Control Service STS Rules 3) Return new token ? 5) Use new token to determine what this user can do 4) Present new token 2) STS creates new token according to rules 1) Present token Client Application User Access Control Service Bus
Service Bus Service Bus 2) Discover endpoints Registry 1) Register endpoints 3) Access application Endpoints Application Application Organization X Organization Y Access Control Service Bus
What is “Dallas”? Relational Flat file I need data! Differentformats Hierarchical invoice Credit card FTP DVD Differentbilling Differentaccess free Database Web service Discovery Semantics
What is “Dallas”? I need data! Marketplace Office, Dynamics, SQL Server Services forContent Providers Standard Data Access (OData) ISV Apps Billing Custom Apps Analytics
Service Explorer Learn about data format and perform quick queries A quick way to explore “Dallas” datasets View results in various formats Available for every dataset Fill in parameter values using guided help Click “Analyze” to continue exploring in PowerPivot and Excel to create PivotTables, graphs, etc.
Promotional Offers and Programs • Introductory Special • MSDN • Premium • Biz Spark • One Anyone can try the platform at no charge (monthly service allocations) Investing in high potential start-ups; receive full platform services at no charge Subscribers receive monthly allocation of platform services at no additional charge *New* • Development Accelerator • Extended • SQL Azure • Core • Accelerate cloud development projects • Flexible consumption (flex # of instances) • Predictable payments (6 mo. subscription) • Exceptional value (discounted price) Includes SQL Azure Business Edition Includes Windows Azure Core plus SQL Azure Business Edition Includes Windows Azure compute, storage, storage transactions, data transfer, and message operations
Windows Azure Platform Benefits Windows Azure SQL Azure Higher Level of Abstraction Hardware Server OS Network Infrastructure Database Server Availability Automated Database Management & Replication Scalability Databases Partitioning Developer Experience Familiar SQL Environment • High Level of Abstraction • Hardware • Server OS • Network Infrastructure • Web Server • Availability • Automated Service Management • Scalability • Instance & Partitions • Developer Experience • Familiar Developer Tools
Main Goals • Create a platform that enables user applications to leverage cloud computing principles and benefits • Supported 2+1 years, starting June 1st, 2010 • Leverage the state-of-the-art to enable interoperability with existing computing e-Infrastructures • Collaborate with current grid, HPC and middleware e-Infrastructure projects • Create a sustainable infrastructure that enables the cloud computing paradigms for the user communities inside the project, as well as for the future users • An open call for new application users will be run by the project
Initial setofapplications(userscenarios) • Biomedicine: Integrating widely used tools for Bioinformatics (UPV-ES), System Biology (CosBI-IT) and Drug Discovery (NCL-UK) into the VENUS-C infrastructure • Civil Protection and Emergency: Early fire risk detection (AEG-GR), through an application that will run models on the VENUS-C infrastructure, based on multiple data sources • Civil Engineering: Support complex computing tasks on Building Information Management for green constructions (provided by COLB-IT) and dynamic building structure analysis (provided by UPV-ES) • Data Intensive (D4Science): Integrating computing through VENUS-C on data repositories (CNR-IT). In particular focus will be on Marine Biodiversity through Aquamaps
Software + Services to facilitate e-Science Applications in the Cloud e-Science Application Venus-C API Venus-C KTH BSC Azure OpenNebula KTH BSC Microsoft ENG KTH BSC Azure ENG
Open Call for 20 e-Science Applications • 20K€ fundingeach (in additiontoAzureCompute , Storage and Network Resources) • Duringthe Venus-C secondyear • Portingapplicationstothecloud • Education and training • Scalabilitytests
Imagine Cup • Ο μεγαλύτερος φοιτητικός διαγωνισμός καινοτομίας • 250.000 φοιτητές, πάνω από 100 χώρεςκάθε χρόνο • United Nations Millennium Goals • 5 κατηγορίες • Software Design • Embedded Development • Game Design • IT Challenge • Digital Media • Ελληνικές συμμετοχές • Brazil 2004: 3η θέση στους παγκόσμιους τελικούς • Japan 2005: 2η θέση • Korea 2007: μες στην 8άδα
Καθηγητές + PhDs • MSDNAA • Faculty Connection • Academic Resource Center • Curriculum Development • Faculty Events Microsoft Research process www.facultyresourcecenter.com
Questions? • www.azure.com • www.azurepilot.com • Cloud futures 2010: http://research.microsoft.com/en-us/events/cloudfutures2010/default.aspx • www.msdnaa.net / www.dreamspark.com • www.imaginecup.com • www.facultyresourcecenter.com • MSR scholarships: http://research.microsoft.com/en-us/collaboration/global/apply-europe.aspx • E: v-digkan@microsoft.com • T: twitter.com/dgkanatsios