1 / 22

Microsoft Solutions for Big Data | Oct 17th 2013

Microsoft Solutions for Big Data | Oct 17th 2013. From Numbers And Data T o Insights A nd V alue. The world of data has changed. Data explosion. Consumerization of IT . 10x increase every five years. 4.3 connected devices per adult. 85% from new data types. 27%

sevita
Download Presentation

Microsoft Solutions for Big Data | Oct 17th 2013

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Microsoft Solutions for Big Data | Oct 17th 2013 From Numbers And Data To Insights And Value

  2. The world of data has changed Dataexplosion Consumerization of IT 10x increase every five years 4.3 connected devices per adult 85% from new data types 27% using social media input By 2015, organizations integrating high-value, diverse, new information types and sources into a coherent information management infrastructure will outperform their industry peers financially by more than 20%. – Gartner, Regina Casonato et al., “Information Management in the 21st Century”

  3. The Large Hadron Collider produces 1 PB/sec

  4. But, my customer isn’t CERN and doesn’t have a Large Hadron Collider…

  5. But your customers do have…

  6. A Definition Big Data is Any Data That Can’t Be Managed by Traditional Means or is beyond the current ability of the enterprise to manage Big Data is All This and More: volume, variety, velocity(and volatility & variability) Traditional Data is Highly Structured traditional databases are organized around planned queries

  7. Common Big Data Customer Scenarios IT infrastructure optimization Legal discovery Social network analysis Traffic flow optimization Web app optimization Gain competitive advantage by moving first and fast in Their industry Churn analysis Life sciences research Natural resource exploration Weather forecasting Healthcare outcomes Fraud detection Advertising analysis Equipment monitoring Smart meter monitoring

  8. Twitter Analytics Demo with Microsoft Excel Demo

  9. Is this Big Data?Is this Enterprise Ready?

  10. Big Data is more than just new BI!Big Data is more than just Hadoop!

  11. The Big (Data) Picture, 4 main topics: 3. Streaming:Real-time data processing Alerts, Notifications SQL Server StreamInsight Data & Compute Intensive Application Big Data Sources (Raw, Unstructured) Business Insights SQL Server FTDW Data Marts Sensors 2. Map Reduce: Storing and processing of unstructured data Summarize & Load 4. Business Analytics: Interactionwith data Fast Load Devices 1. Data Warehousing:Storing and analysis of structured data SQL Server Reporting Services Interactive Reports SQL Server Parallel Data Warehouse HDInsight on Windows Azure HDInsight on Windows Server Bots Historical Data (Beyond Active Window) Integrate/Enrich SQL Server Analysis Server Crawlers Performance Scorecards Azure Market Place Enterprise ETL with SSIS, DQS, MDS ERP CRM LOB APPS Source Systems

  12. The Traditional Data Warehouse ETL Data warehouse BI and analytics Dashboards Reporting … data warehousing has reached the most significant tipping point since its inception. The biggest, possibly most elaborate data management system in IT is changing. – Gartner, “The State of Data Warehousing in 2012” Data sources OLTP ERP CRM LOB

  13. The Traditional Data Warehouse ETL Data warehouse BI and analytics Dashboards Reporting Real-time data Increasing data volumes New data sources & types 2 1 3 4 Cloud-born data Non-Relational Data Data sources OLTP ERP CRM LOB Devices Sensors Web Social

  14. The Modern Data Warehouse BI & ANALYTICS Collaboration Self-service Corporate Mobile Predictive DATA ENRICHMENT AND FEDERATED QUERY Single query model Extract, transform, load Master data management Data quality DATA MANAGEMENT & PROCESSING  Internal & External Relational Non-relational Analytical Streaming INFRASTRUCTURE Data sources Non-Relational Data OLTP ERP CRM LOB Devices Sensors Web Social

  15. Combining Structured and Semistructured Data with SQL Server PDW and Polybase Demo

  16. Combining Structured and Semistructured Data with SQL Server PDW and Polybase Demo And remember, it’s not just working with Twitter data 

  17. Socket for Big Data: Hadoop Access Made Simple SQL Server PDW APPLICATIONS Microsoft Applications DATA SYSTEMS CREATETABLECustomers([user_id]INT,nameNVARCHAR(50)… CREATE EXTERNAL TABLE ClickEvent (urlvarchar(50), event_datedate, user_IDvarchar(50) ) WITH LOCATION =‘hdfs://MyHadoop:5000/clickstream/click.txt’; SELECTCOUNT(*)FROMCustomersc JOINClickEventeON c.[user_ID]=e.[user_ID] WHEREc.Name='Jones'; HDInsight Polybase Feature in SQL PDW DATA SOURCES New Sources (web logs, email, sensor data, social media) Traditional Sources (RDBMS, OLTP, OLAP)

  18. Pillars of Microsoft’s Big Data Strategy OPEN & FLEXIBLE CONNECTED TO THE WORLDS DATA ENTERPRISE READY ANALYTICS FOR EVERYONE Combine internal and external data Develop once, deploy on-premises or in the cloud Simplicity & Manageability Broaden accessibility of Big Data Analytics to all users

  19. Whats in it for you as Partner? Data Platform market is estimated to grow 9% YoY Business Intelligence market growing 16.4% YoY Data Warehousing growing 13.5% YoY Big Data market estimated to grow 39.4% YoY Source: IDC

  20. Whats in it for you as Partner? Leverage pre-engineered Data Warehouse and Hadoop Appliance solutions from Microsoft (and it’s hardware partners) De-risk your projects Streamline deployments Modernize your customers Data Warehouse/BI Environments >> Make them Big Data Ready! Leverage and connect the cloud Streamline deployments Decommission fast if smaller hadoop (HDInsight) cluster is sufficient

  21. Thank you

  22. Additional Resources SQL Server Parallel Data Warehouse (PDW) Landing Page: www.microsoft.com/PDW Microsoft Big Data Landing Page: www.microsoft.com/bigdata Introduction to Polybase: http://www.microsoft.com/en-us/sqlserver/solutions-technologies/data-warehousing/polybase.aspx Twitter Analytics for Excel: http://extendedresults.com/products/twitteranalytics/

More Related