300 likes | 451 Views
F rom D ata to Information Principles behind Smart Data. Roberto Rigobon MIT Sloan, NBER, CSAC. Big Distance!. Big Distance!. The world is not lacking of Data. Lacking of Careful Empirics. Lacking of Managerial Data Analysis. Typical mistakes!. “Let the data speak for itself”
E N D
From Data to InformationPrinciples behind Smart Data Roberto Rigobon MIT Sloan, NBER, CSAC
Big Distance! The world is not lacking of Data Lacking of Careful Empirics Lacking of Managerial Data Analysis
Typical mistakes! • “Let the data speak for itself” • This is impossible. • The data speaks through the lenses we use to collect it and interpret it. • Model selection is not equivalent to picking the best model after running 3000 regressions • We need robust strategies to take into account our ignorance
Typical Mistakes • “Great Data is Great Information” • New technologies reduces the cost of collecting data, they do not improve the quality of data analytics. • Word Processors • Reduce the cost of writing words and pages in comparison to 300 years ago • But it has not improved the quality of literature!
What is Big Data? • Collected through non-standard procedures • Computational challenges • Econometric challenges
What is Big Data? • Collected through non-standard procedures • Computational challenges • Econometric challenges • Defining it through its characteristics: • Volume • Velocity • Variety • Problems: • Are the varieties, volume, and velocity representative? • When do these characteristics matter?
New Home Sales Open Houses and Phones
New Home Sales Open Houses and Phones Contract Realtor
New Home Sales Open Houses and Phones Contract Realtor Search for Mortgage
Inflation and Price Indexes • Alberto Cavallo
Online Information and Indexes Our Approach to Daily Inflation Statistics 1 2 3 4 5 Use scraping technology Connect to thousands of online retailers every day Find individual items Store and process key item information in a database Develop daily inflation statistics for ~20 countries • Date • Item • Price • Description