1 / 33

Cloud Data

Cloud Data. Dave Campbell Technical Fellow, Microsoft. Agenda. Starting with the basics Build and deploy Community led data topics. Starting with the b asics. Storage options. Blob Storage. Table Storage. SQL Azure Database. Historical storage o ptions.

dyan
Download Presentation

Cloud Data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Cloud Data Dave Campbell Technical Fellow, Microsoft

  2. Agenda Starting with the basics Build and deploy Community led data topics

  3. Starting with the basics

  4. Storage options Blob Storage Table Storage SQL Azure Database

  5. Historical storage options Available in most operating systems: Files (BLOBs) Indexed Record Storage RDBMS Queues

  6. Azure Storage Options

  7. Everything is Available at the Portal

  8. Storage options Blob Storage Table Storage SQL Azure Database

  9. What is the BLOB service? Contained within Storage Account Namespace RESTful Interface GET/PUT BLOBs Page & Block BLOBs

  10. Storage options Table Storage Blob Storage SQL Azure Database

  11. What is the Table Service? Simple REST accessible Highly scalable Cost effective Non-relational Hierarchical Account Table Storage Account: MovieData Tables store entities Entity schema can vary in the same table Table Name: Movies Table Name: Actors Entity Star Wars Matrix Fan Boys Mike Collier Mr. Anderson Bill Gates

  12. Using Azure Tables demo

  13. Storage options SQL Azure Database Blob Storage Table Storage

  14. What is SQL Azure Database? SQL Azure Database is SQL Server database technology delivered as a service on the Windows Azure Platform Ideal for both simple and complex applications Enterprise-ready with automatic support for HA Designed to scale out elastically with demand

  15. Provision your server Server defined Service head that contains databases Connect via automatically generated FQDN (xxx.database.windows.net) Initially contains only a master database Provision servers interactively Log on to Windows Azure Management Portal Create a SQL Azure server Specify admin login credentials Add firewall rules and enable service access Automate server provisioning Use Windows Azure Platform PowerShell cmdlets (or use REST API directly) wappowershell.codeplex.com

  16. SQL Azure pay as you go pricing Database Standard pay-as-you-go pricing Web Edition (up to 5 GB) $9.99 per 1 GB of database per month Business Edition (up to 150 GB) $99.99 per 10 GB of database per month (Maximum charge of $499.95 per database)*

  17. Build and Deploy your database

  18. Build your database Use familiar technologies Supports Transact-SQL Supports popular languages .NET Framework (C#, Visual Basic, F#) via ADO.NET C / C++ via ODBC Java via Microsoft JDBC provider PHP via Microsoft PHP provider Supports popular frameworks OData (REST data access) Entity Framework WCF Data Services NHibernate Supports popular tools SQL Server Management Studio (2008 R2 and later) SQL Server command-line utilities (SQLCMD, BCP) CA Erwin® Data Modeler Embarcadero Technologies DBArtisan® Differences in comparison to SQL Server Focus on logical vs. physical administration Database and log files automatically placed Three high-availability replicas maintained for every database Databases are fully contained Tables require a clustered index Maximum database size is 150 Gb Unsupported SQL Server features BACKUP / RESTORE USE command, linked servers, distributed transactions, distributed views, distributed queries, four-part names Service Broker Common Language Runtime (CLR) SQL Agent

  19. Build your database Thin client database development Introducing the SQL Azure management portal Web designers for tables, views, stored procs Interactive query editing and execution Rich client database development Introducing SQL Server Data Tools (SSDT) Visual Studio IDE for database development Includes modern designers and projects with declarative, model-driven development Develop and test in both connected and disconnected states Platform targeting for both SQL Server (2005 and above) and SQL Azure Get it free with Web PI, with SQL Server 2012 and with Visual Studio 11

  20. Creating a SQL Azure DB demo

  21. Moving data to your database with DAC Data-tier Application Framework (DAC Fx) Alternative to traditional script based approach Dramatically simplifies deployment, migration and versioning of databases Provides a single unit of deployment for schema (dacpac) or for schema + data (bacpac) Supports automatic versioning of database schemas Supports platform targeting for both SQL Server (2005 and above) and SQL Azure Build from scratch or extract from existing db How to get the latest DAC Fx With SQL Server Data Tools With SQL Server 2012 Management Studio With SQL Azure Import/Export Service Via sqldacexamples.codeplex.com

  22. Deploy your database Interactive approach for dacpac v1 and v2 Manage your server with SQL Azure Management Portal Deploy dacpac Load data (scripts, bulk copy, SSIS) Also supported in SQL Server 2012 Management Studio Interactive approach for bacpac v2 Upload bacpac to blob storage Log into Windows Azure Management Portal Import bacpac, table data automatically loaded Also supports export to blob storage Upgrading a dacpac or bacpac Not supported in portals yet Use SQL Server 2012 Management Studio

  23. Scale out your data SQL Azure Federations provides Integrated database sharding that can scale to hundreds of nodes Multi-tenancy via flexible repartitioning Online split operations to minimize downtime Automatic data discovery regardless of changes in how data is partitioned Special considerations A logical database can contain multiple federations Distribution scheme supports int, bigint, guid, and varbinary types Filtering routes connection to appropriate shard regardless of changes in partitions Merge, fan-out queries and automatic distribution of schema changes not supported in initial release Federation Root Tenant 3 Db Multi-Tenant Db Tenant 4 Tenant 1 Tenant 2 Tenant 4 Db 1 Tenant 4 Db 2

  24. SQL Azure Federations demo

  25. Community led data topics

  26. Dynamic Schema • Flexible Schema What About noSQL? Entity Model • Simple “sharding” • Manage as one noSQL Horizontal Scalability • Trade consistency for availability • HA that “just works” Simple Availability

  27. Signal Data Insight Action Information Knowledge What About “Big Data” “Big” is a misnomer Volume, Variety, Velocity, Complexity Drivers Cost of data acquisition  $0 Cost of data storage dramatically reduced “Save everything” tipping point About turning ambient data into value

  28. Characteristics of Big Data Large Data Volumes New Data Sources New Technologies Non-traditional Data Types New Economics New Questions & New Insights

  29. Hadoop Hadoop for Microsoft Many wanted to get from Hadoop into Microsoft Information Platform Examples: Yahoo – Populating 20+ TB Analysis Services cube from Hadoop Klout – Creating social relevance scoring with Hadoop and SQL Analysis Services [1] Data warehousing market demanded a Hadoop solution Wanted a great port of Hadoop for Windows The goal? Work closely with Apache community and key vendors Create great Hadoop experience on Windows Contribute to Hadoop ecosystem – e.g. JavaScript Map/Reduce [1] http://corp.klout.com/blog/2011/11/big-data-bigger-brains/

  30. Hadoop Architecture Task tracker Task tracker MapReduce Layer Job tracker Name node Reference: http://en.wikipedia.org/wiki/File:Hadoop_1.png HDFS Layer Data node Data node

  31. Hadoop demo

  32. New data and experiences Data Creation/Consumption Blob Storage Table Storage SQL Azure Database PC Phone Tablet Search DataSources

More Related