260 likes | 462 Views
What’s New in Data?. Liesl. Overview. Changes in data availability Climate for Federal and state agency data provision Implementation of the American Community Survey (ACS) Other data challenges Confidential data/suppression Synthetic data Survey-based data
E N D
What’s New in Data? Liesl
Overview • Changes in data availability • Climate for Federal and state agency data provision • Implementation of the American Community Survey (ACS) • Other data challenges • Confidential data/suppression • Synthetic data • Survey-based data • Alternative data sources and other options
Overview • Changes in data availability • Climate for Federal and state agency data provision • Procedural changes with ACS • Other data challenges • Confidential data/suppression • Synthetic data • Survey-based data • Alternative data sources and other options
Budgetary/Political Threats • Already targeted • Bureau of Economic Analysis Local Area Personal Income & Employment • Bureau of Labor Statistics special initiatives (e.g. Green Jobs surveys) • Vulnerable Data “arms” of other agencies including Economic Research Service (USDA), Energy Information Administration (Dept. of Energy), etc. • Always under threat • Census Bureau in general • American Community Survey in specific
ACS Implementation http://www.icip.iastate.edu/sites/default/files/uploads/help/census-overview-icip.pdf
Overview • Data availability • Climate for Federal and state agency data provision • Procedural changes with ACS • Other data challenges • Confidential data/suppression • Synthetic data • Survey-based data • Alternative data sources and other options
Synthetic Data • When a small-area data set looks too good to be true, it probably is. • Health status indicators from BRFSS • Commuting data from On the Map (LED/LEHD) • Air quality indicators • Requires a judgment call on when to use and how to document
Survey-Based Data • Many small area data sets from Census Bureau are survey-based and are published with MOE values. • ACS • SAIPE • SAHIE • How much does this matter for our project? (clue: A LOT!!!!) • How do other data providers handle this issue? (clue: DERELICTION OF DUTY)
Overview • Changes in data availability • Climate for Federal and state agency data provision • Procedural changes with ACS • Other data challenges • Confidential data/suppression • Synthetic data • Survey-based data • Alternative data sources and other options
Alternative Data Providers? • Reality check • Most private sector providers are using data from the same Federal sources we are. • If they’re not, assume the worst about data quality (non-representative samples, unknown methods & motives). • State agency data collection fulfills administrative needs, not data analysis needs. • State agencies face budgetary and political constraints, too. • My philosophy • Accept our reality • Don’t apologize, EDUCATE!!!
Poor: No acknowledgement of uncertainty in map or text http://www.povertyusa.org/the-state-of-poverty/poverty-map-county/
Fair: No acknowledgement of uncertainty in map or text, but uses a reference value that allows for significance testing http://usatoday30.usatoday.com/news/graphics/2012/poverty-maps/index2.htm
Good: No acknowledgement of uncertainty in map, but table includes confidence interval values