1 / 16

Applying Process Indicators to Monitor the Editing Process

Applying Process Indicators to Monitor the Editing Process. Purpose of Process I ndicators. Monitor and improve the editing process Find measurement errors and their causes and prevent them in future survey rounds Communicate quality to the users . International Trade in Services.

tex
Download Presentation

Applying Process Indicators to Monitor the Editing Process

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Applying Process Indicators to Monitor the Editing Process

  2. Purpose of Process Indicators • Monitor and improve the editing process • Find measurement errors and their causes and prevent them in future survey rounds • Communicate quality to the users

  3. International Trade in Services Statistics on international trade in services, wages and transfers are based on a quarterly sample survey involving about 5 000 enterprises and organizations. Report values of income and expenditure for about 100 service types.

  4. Editing in the survey • Selekt is used • Fatal errors are always followed-up • Suspicious errors are used to create a local score for each service type based on potential impact and suspicion • Local scores are aggregated to a global score for each enterprise • A threshold determines whether the enterprise needs to be followed-up or not

  5. Descriptive information

  6. Overall failure rate, 2013Q1-2013Q3

  7. Overall hit rate, 2013Q1-2013Q3

  8. Weighted reject ratio, 2013Q1-2013Q3

  9. Failure rate and hit rate for each edit, 2013Q1-2013Q3

  10. Editing rate for each variable, 2013Q1-2013Q3

  11. Problems • Tedious to calculate • Difficult to interpret • Often small amounts of data • Variable specific indicators depend on random fluctuations

  12. Data availability • Dependent on available data • Some thoughts on which indicators we want should be considered when setting up the system • Structure of data influences difficulty to generate indicators • A system that generates standard reports could be beneficial

  13. Conclusion • Standardized indicators could be beneficial • Needs guidance on how to interpret and use them • Will take time to establish indicators in the organization and within the management teams - What possibilities do we have to spread them to the organization?

  14. Questions • Do you use indicators frequently? • Are they established in your organization? • Have you seen any improvements due to the use of indicators? • Are standardized indicators a good idea?

More Related