1 / 12

Pushing forward with ASPIRE

Pushing forward with ASPIRE. A S ystem for P roduct I mprovement , R eview and E valuation Heather Bergdahl, Paul Biemer, Dennis Trewin Q2014. Background. Quality Reporting to Ministry of Finance

frayne
Download Presentation

Pushing forward with ASPIRE

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Pushing forward with ASPIRE ASystem for Product Improvement, Review and Evaluation Heather Bergdahl, Paul Biemer, Dennis Trewin Q2014

  2. Background • Quality ReportingtoMinistryofFinance • Request for quantitative and objectivemeasuresofqualitychanges in statistical products • Externalevaluatorstoensureobjectivity • Focus on Accuracybutotherqualitycomponentspossible • Ten key statistical products • Inspiration for improvementwork

  3. Sourcesof error by product

  4. Quality criteria • Knowledge (of the producers of statistics) of the risks affecting data quality for each error source, • Communication of these risks to the users and suppliers of data and information, • Available expertise to deal with these risks (in areas such as methodology, measurement or IT), • Compliance with appropriate standards and best practices relevant to the given error source, and, • Plans and achievements for mitigating the risks.

  5. Guidelines/ Checklists

  6. The review process • Self assessment and documentation sent toevaluators • Quality interview • discussion of notable changes, • review of quality declarations, • progress made on recommendations, • assignment of preliminary ratings using the checklists, • review of assigned ratings, discussion of results, and recommendations for improvement • Control, feedback, possiblecorrection and finalisingof ratings • Process repeatedannually

  7. Results – Labour Force Survey

  8. Results: Structural Business Statistics

  9. Strengthsof ASPIRE approach • comprehensive covering error sources and criteria that pose risks to product quality • checklists are effective for assigning reliable ratings • ASPIRE identifies improvement areas ranked in terms of priority

  10. Possibleweaknesses • Does not measure the trueaccuracyof a statistical product • Relies on the skills and experienceof external evaluators, and also on the information provided by the productstaff– certainsubjectivity

  11. Concrete Results • Methods developed to explore measurement error • Improved quality in quality declaration information • Increasing activity in the area of planning for studies and improvement projects • Major redesign for Living Conditions Survey with substantial improvements • Higher scores for those who systematically make use of methodological staff • In summary, no quickfixestoimproveAccuracy.

  12. ASPIRE – pointingustowardsexcellence and beyond… £ ½  ¼ ˜

More Related