CCS Quality Meeting May, 2010

1. CCS Quality Meeting May, 2010 Experiences in the Use of Quality Standards Michael Colledge, Consultant

2. Experiences Assessment of Quality in Statistics (10 central European NSOs) Development of Quality Guidelines (National Institute of Statistics, Romania) Quality Assurance in Business Profiling (Statistics South Africa) Quality Assurance Framework (Statistics Indonesia) Lessons Learned Generic Quality Assurance Framework

3. Assessment of Quality in Statistics in 10 Central European Countries Objectives were to help NSIs to assess quality to provide training in quality Made use of recently developed ESS generic self-assessment checklist (DESAP) Each NSI completed checklist for 6 surveys Consultants reviewed results as basis for identifying probable strengths and weaknesses as starting point for discussions and to target trainingChecklist was cornerstone of assessment its use fast tracked the work

4. Development of Quality Guidelines at National Institute of Statistics (INS) Romania Part of a quality improvement programme Small budget item Started with Statistics Canada’s Quality Guidelines 2003 obtained from Internet used with blessing of Stat Can!! In discussions with staff, produced revised draft adapted to Romanian situation Use of Stat Can Guidelines fast tracked development, helped assure quality and demonstrated possibility of developing generic guidelines

5. Quality Assurance in Business Profiling at Statistics South Africa (Stats SA), 2008-09 ESPQM Program to improve profiling & train new recruits Work of Profiling Unit had become almost irrelevant Needed good training environment for new recruits Expanded Profiling Unit from 5 by recruiting 13 graduates Had to ensure profiles were good quality Set up a profiling quality assurance programme using Stat SA quality model (SASQAF) to define elements of quality business process mapping to analyse profiling processes and standardize and insert quality gatesAdapted off the shelf quality tools

6. Design of Quality Assurance Framework for Statistics Indonesia Implementation of quality assurance framework will be a component of forthcoming STATCAP Project; Strengthening the National Statistical System. Start with Statistics Canada’s National Quality Assessment Framework (NQAF) draft template from UNSC 2010 paper Adapt to Indonesian situation, which includes Few existing quality tools Opportunity for synergistic relationship with concurrent Bureaucratic Reform Program (which requires business process mapping and improved quality operating procedures) Template is useful in fast tracking and authenticating Need to tailor to local situation

7. Lessons Learned (Nothing new, but reaffirmation in case we should forget) Standards and Guidelines are invaluable Speed up development Make best practices readily available Basis for harmonisationWe could use more at both corporate and survey levels generic quality guidelines, statistical terminology generic NQAF template and guidelines

8. NQAF Template and Guidelines Following up Claude’s comments Benefits Terminology Scope and Content Quality management system Relationship to guidelines Structure Match to local situation

9. michael.colledge@gmail.com