Data Quality – UK activities

1. Data Quality – UK activities Iain Macleay Head of Energy Balances, Prices and Publications 27 September 2013

2. Contents • Aspects of quality • Standard errors • Revisions • Risk based quality reviews • Quality training

3. Aspects of quality DECC follow UK statistical practice: • Relevance • Accuracy • Timeliness & punctuality • Accessibility & clarity • Comparability • Coherence

4. Timeliness & punctuality DECC release data to pre-announced, year in advance, timetable – all releases at 9:30am. Energy Trends – Thursday 26 September; Thursday 19 December Thursday 27 March Thursday 26 June Dates set for coming year, by the DECC Chief Statistician – no political interference If data not released at 9:30 – DECC need to report breech to UK National Statisticians Office Data released as soon as available

5. Accuracy Difficult to measure, but … • Sample sizes of surveys published with information on coverage • Where useful, standard errors published • Weighting to adjust for coverage • Administrative sources used where appropriate • Check accuracy of recording by comparing data sources (volume surveys, price surveys, company reports)

6. Sample sizes and standard errors for Quarterly Fuels Inquiry - published in industrial price methodology note

7. Relevance • As working in policy departments – regular liaison so data meet needs. • Also try to anticipate their future needs. • Regularly survey of wider user community to check meeting their needs, every 2 to 3 years – results published on web • Review content of press notices and channels of communication (tweets etc)

8. Accessibility & clarity • Data presented in consistent format • Helpful commentary drawing users to key points of interest (even if politically difficult), written independently by the statistics team • Clear info on contact details of DECC statistical teams • All info available for free on web • Metadata published – detailed method notes on web • Some info on revisions published

9. Revisions – final consumption annual growth after one quarter

10. Coherence & comparability • Monthly data consistent with quarterly, and annual data – revised in line with better more complete information • Standard geographies used where possible • Energy balance format used so supply and demand consistent

11. Quality reviews • Data collections and publications should be reviewed on a regular basis • Tricky in practice – time consuming activity • Risk based approach being trialled • Methodically go through checklist • Most activities fairly low risk

12. Risk based review template

13. Domestic fuel prices inquiry Actions Meet companies to improve form filling Engage pro-actively with policy to find future needs Ensure good documentation Have sufficient staff trained to use system Check data with that from similar surveys Check data against firms published annual reports

14. Quality training • How do we ensure good quality statistics • Well trained staff • Training sessions held focusing on quality • All staff to attend – take through stages of statistical value chain • In DECC two statisticians trained up to train others