570 likes | 591 Views
Webinar Big Data Predictive Analytics 101. Mike Gualtieri, Principal Analyst. September 7, 2012. Please call in at 10:55 a.m. Eastern time. Twitter: @mgualtieri. Outlook. Business intelligence is the top business app. Real-time analytics is rising fast. Data continues to grow.
E N D
WebinarBig Data Predictive Analytics 101 Mike Gualtieri, Principal Analyst September 7, 2012. Please call in at 10:55 a.m. Eastern time Twitter: @mgualtieri
The past three years have shown an increased adoption of predictive analytics
“Knowledge is power.” Francis Bacon (1561–1626) Francis Bacon described a rational procedure to establish causation between phenomena based on induction.
“Big data can lead to an explosion of knowledge . . .” - Big Data Predictive Analytics, Forrester Research
Forrester estimates there will be more than 1 billion people using smartphones and tablets by 2016. 1B
Cisco IBSG predicts there will be 25 billion devices connected to the Internet by 2015. 25B
It all comes down to how well you can handle it. It’s relative.
Big data activities are as important as the three V’s measures
What’s your big data score? Activities Measures 5 = Not required or handled perfectly 3 = Handled but could be improved 1 = Handled poorly but with frequent negative business impact 0 = Current or future needs exist but are not handled. Source: Mike Gualteri, “What’s Your Big Data Score?” Mike Gualtieri’s Blog For Application Development & Delivery Professionals, May 17, 2012
What’s your big data score mean? Source: Mike Gualteri, “What’s Your Big Data Score?” Mike Gualtieri’s Blog For Application Development & Delivery Professionals, May 17, 2012
Do you have the tools and technologies to handle big data? Big data
It is not surprising that transactional data is most popular for big data “What types of data/records are you planning to analyze using big data technologies?” (Multiple responses accepted) Base: 60 IT professionals; Source: June 2011 Global Big Data Online Survey
Why do Forrester clients consider or implement big data? “What are the main business requirements or inadequacies of earlier-generation BI/DW/ET technologies, applications, and architecture that are causing you to consider or implement big data?” Base: 60 IT professionals; Source: September 20, 2011, “How Forrester Clients Are Using Big Data” Forrester report
Most Forrester clients are using commercial technology for big data “What technology do you use for big data applications?” (multiple responses accepted) Base: 60 IT professionals; Source: September 20, 2011, “How Forrester Clients Are Using Big Data” Forrester report
Predictive analytics can find meaning in big data. Predictive analytics
Just a few examples of how organizations use predictive analytics today
Predictive analytics finds a model that acts like a formula to find the answer
Predictive models can be represented in many different ways depending on the technique used Formula Decision trees Code Combination of any of the above
Predictive analysis is powered by statistical and machine learning algorithms K-means clustering Association rules Boosting trees CHAID Cluster analysis Feature selection Independent components analysis Kohonen Networks (SOFM) Neural networks Social network analysis (SNA) Random forests Mars regression splines Linear and logistic regression Naïve Bayesian classifiers Optimal binning Partial least squares Response Optimization Root cause analysis Support vector machines Natural language processing This is just a sample. There are hundreds of algorithms, variations, and combinations.
The predictive analytics process must be continuous to insure effectiveness Business goal
The right data and right talent are the key to predictive analytics success Source: August 8, 2012, “The State Of Customer Analytics 2012” Forrester report
Real-time predictive is the next big differentiation opportunity in customer engagement
Predictive analytics has its limits. Predictive analytics
Predictive analytics has limits There are lots of stock price data, but causative data is elusive. Note: Red line is AAPL Apple stock price; blue line is RIMM Research In Motion stock price.
Predictive analytics has limits Can a butterfly flapping its wings in Asia drastically alter the weather in the Gulf Of Mexico?
Predictive analytics has limits There have only been 56 presidential elections and 44 presidents.
What do great predictive analytics use cases have in common? Evidence-based methods don’t exist or are sub-optimal. Relevant data is available. The environment changes with moderate frequency. The business outcome is significant.
Big data reinvigorates the use of predictive analytics to achieve business outcomes Big data means more potentially causative variables. Big data means more experience data for training algorithms.
Big data predictive analytics solutions range from coding tools to specific business solutions. Tools
General purpose enterprise big data predictive analytics tools must have an extensive feature set Architecture Data Discovery Evaluation and optimization Deployment User tools Integration, solutions, standards, and extensibility Innovation
Data import and pre-processing R is an open source programming language that can be used for predictive analytics. R User-defined functions Internet API interface XML parsing Grant awards to homeless veterans FY09 Data: Data.gov Analysis: Drew Conway Iterative data processing
Can you prevent Melissa from switching to a competitive mobile plan? Churn
Find a predictive model. Churn
How can you provide Melissa with nearly perfect song recommendation? Million Song Dataset
Prepare data from 48 million songs listened to by 1.2 million users. MSD
Create a bipartite graph to find out what bands users like. MSD