80 likes | 95 Views
This article explores the history and current use of admin data for official statistics. It discusses the challenges faced, such as data quality issues, and the need for granular-level data.
E N D
Official Statistics Using Admin Data Neil McIvor Deputy Director Statistical Services Division 5th December 2014
DWP History of Using Admin Data for Statistics Data collected for purely statistical purposes - police recorded crime Data collected as a by product of an operational system - benefits data Mid 90’s – DWP used 1% then 5% samples of admin data Early 00’s – stated publishing stats using 100% admin data 2004 – stated using 100% linked OGD admin data (Work and Pensions Longitudinal Study) Currently – around 60 official and National statistics series annually using admin data (plus a few using survey data)
Challanges MI is always incorrect N = all
Challanges MI is always incorrect N = all + Where = erroneous records
Challanges MI is always incorrect N = all + - Where = erroneous records = records you think are covered but aren’t Garbage in = garbage out Need to understand behavioural motivations of data inputters Need to get granular level data to triangulate with other sources
Claim Process Demo-graphic Claim Detail Claim Status Claim Length Office Clear-ance Time Benefit Centre Out-standing Time Elapsed Time Person PIP Person Claim Bridge Claim Fact Person Claim Start Reg-istration Clear-ance On-Flow Off-Flow Cust Primary Postcode Claim End Date Grain: 1 row per Claim