1 / 15

Implementation of Quality Assurance Activities in Eurostat

Implementation of Quality Assurance Activities in Eurostat. Third CCSA Data Quality Conference Rome 7-8 July 2008 A. Baigorri, M. Hahn, H. Linden Eurostat. Structure of the presentation. Quality assessments in Eurostat: methodology and implementation

toddbjones
Download Presentation

Implementation of Quality Assurance Activities in Eurostat

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Implementation of Quality Assurance Activities in Eurostat Third CCSA Data Quality Conference Rome 7-8 July 2008 A. Baigorri, M. Hahn, H. Linden Eurostat

  2. Structure of the presentation • Quality assessments in Eurostat: methodology and implementation • Redesigned Quality Barometer: short term and long term perspectives • Plans to enhance quality assurance in the European Statistical System

  3. Quality assessments methodologyEach process is matched with an assessment category Self- Assessment Prod. unit: fills in Checklist, produces outputs DDG02: provides support on demand • Supported • Self-Assessment • Prod. unit: in control of assessment,participates in all steps • DDG02: pre-fills the Checklist, produces the outputs Peer review Same asSupported Self-Assessment with one or more peers (int/ext)taking part in all steps Rolling review A comprehensive reviewbased on the checklistimplemented by ext.contractor, involving partner & user surveys and cost-benefit analysis Process 1 Process 2 Process 3 Process 4 Process 5 • Characteristics: • Periodicity • Legal Basis • Output • ESTAT intervention • availability of quality report

  4. Quality Assessments Implementation Plan: Principles • Minimize burden for units • Test of the approach in advance. • Support from unit DDG-02 • Flexibility • Build on existing information • Quality reports • Process analysis • Integrate QA with other horizontal activities

  5. Integrating Quality Assessments

  6. Quality Assessments Implementation Plan: Support • Training - in-house courses on data quality reporting - lunchtime presentations on the ESPAC - peer review results - seminars on quality assessments • Communication - intranet site on quality - regular information on Cybernews - Eurostat infos - dissemination of good practices best practices 

  7. Quality Assessments Implementation Plan: Agenda 2008

  8. Quality assessments in Eurostat:next steps • Evaluation of the 2008 program of assessments • Need for adjusting the instruments used • Indentify recurrent weaknesses in statistical processes to feed improvement actions into the AMP • Promote initiatives to be implemented by horizontal units to facilitate quality improvements by production units. • Elaboration of the 2009 plan - focussed on more objective assessments as peer and rolling reviews.

  9. Redefined Quality Barometer: characteristics Purposes: - to measure the quality level at both EU level and country level; - to monitor change; - for comparisons across statistical domains and across countries. Users: - production side: top-management, departments/units, survey managers. - user’s side: international organisations, policy makers, researchers, etc. Scope: - cover all types of statistical processes and their statistical outputs; - the quality of key data (or main time-series); - monitor quality on an annual basis.

  10. Redefined Quality Barometer: short term perspective • Restricted QB based on quality indicators that are: - applicable to most statistical domains; - covering the main quality dimensions; - well defined and easy to provide; and - easy to interpret and understand. • The restricted set of Quality Indicators prioritised for the QB: - Rate of available statistics (R2) - Coefficient of variations (A1) - Unit response rates (A2) - Average size of revisions (A7) - Time lag reference period and date of first results (T2) - Number of accesses to databases (AC2) - Rate of completeness of metadata (AC3) - Length of comparable time series (C1)

  11. Compilation of a restricted Quality Barometer • Including many statistical processes but only covering the restricted set of quality indicators • The Euro- SDMX Metadata Structure should be the main source of information • Continue the MS’s Expert Group and Eurostat network for methodology for indicators and analysis of results • First RQB planed for the end of 2008

  12. I. INTRODUCTION IIa. Social statistics Labour Force Statistics Relevance Accuracy Timeliness Comparability Coherence Summary for Labour Force Statistics IIb. Business statistics III. OVERALL SUMMARY Redefined Quality Barometer: long term perspective

  13. Enhancing quality assurance in the ESS • Regulation on European Statistics and Article 10 “Statistical quality”: - Quality of the MS’s and Eurostat data shall be assessed according to the ESS quality dimensions. - Specific quality requirements, such as target values and minimum standards for the statistical production, in sectoral legislation. • Euro-SDMX Metadata Structure (ESMS) - Harmonizes quality reporting integrating the ESS quality dimensions - improves metadata sharing and information to users on quality of statistics • Development and sharing of “best practices” for statistics production

  14. Enhancing quality assurance in the ESS • Revision of the Eurostat/ESS quality reporting guidelines: - Standard Quality Report - Handbook: How to make a Quality Report • Facilitate the implementation of CoP improvement actions plans by NSIs - Eurostat 2009 grants on the implementation of ESS standards, handbooks, guidelines and application of tools - ESS Quality Coaching focusing on the implementation of quality management and quality assurance

  15. Thank you for your attention! http://ec.europa.eu/eurostat/quality

More Related