180 likes | 367 Views
16. Quality management and quality reporting. DI Milla Neubauer, Qatar 19 June 2013. What does high quality of waste statistics mean ?. The statistics meet current and potential user needs ( relevance ) and the users can easily access statistics
E N D
16 Quality management and quality reporting DI Milla Neubauer, Qatar 19 June 2013
Whatdoes high qualityofwastestatisticsmean? • The statisticsmeet current and potential user needs (relevance) and the users can easily accessstatistics • Users get appropriate supporting information and assistance(clarity) • The statisticaloutputs/estimatesareclosetothetruevalues(accuracy) • The statisticsarecomparable… • over time andacrossregions • internationallywithother countries • The statisticsarecoherentwithother relevant statistics (e.g. economicstatistics) • The statisticsareproducedtimelyandpunctually
Howtoachieve high qualityofwastestatistics? • The datasourcehas a solid andofficialstatus • Administrative reportingobligations • Legal basisforstatisticalsurveys • Establishedterminologyanddefinitions • (International) standardclassifications • Plausible, generallyagreedmethods • Metadata (Quality reports, documentation, explanations, qualitylimitations…)
Validation ofinitialdata(e.g. responsesof individual enterprisesto a survey) • Comparison of the replies of individual enterprises with their replies in previous years • Plausibility check of outliers (high quantities) • Comparisonsacrossenterpriseswithin a specific economic sector • usingreference variables likenumberofemployeesorvalueadded Further inquiries in caseofobviouslyincorrectdata
Validation ofresults • Comparison with previous years (Time series) • Generation vs. treatment vs. treatment capacity • Taking into account import and export of waste • Comparisons with other countries • Usingreference variables likenumberofemployeesorvalueadded • Comparisons with other data sources
Analysis of time series • Visualisationof time series • Identificationofoutliers • Reasons? • Changes in theeconomy? • Changes in thelegislation? • Methodologicalchanges? • Other plausible causes? • Inplausibleinitialdata?
Quality reporting • Quality reports include metadata describing the quality of statistical outputs • Quality reports supply the information necessary for assessing the quality of statistics both at national and at international level • Quality reports should also include recommendations for quality improvements
Structure of a quality report - Part I • Part I: Description ofthedata • Identification, transmissiondataanddescriptionofdatasubmitted • Contact Information • Institutionsinvolvedandsustainabilityofdatacollection • Legal basis • Methodsappliedandsourcesused • Changescomparedtohistoryandcomparabilityover time • Changesplannedorexpected in thenextreferenceyear
Structureof a qualityreport - Part II • Part II: Report on thequalityattributes • Relevance • Primary usersandpoliticalrequirements • Data gapsandexplanationsofmissingvalues • Accuracy • Sampling errors • Non-sampling errors: coverageerrors, measurementerrors, processingerrors, non-response errors, model-assumptionerrors • Timelinessandpunctuality • Key datacollectionandprocessingsteps • Explanationsofprovisionaldata
Structureof a qualityreport - Part II continues • Accessibilityandclarity • Dissemination policy • Confidentialitypolicy • Comparability • Reporting units • Regional comparability • Comparabilityover time • Consisteny/coherence • Withtradestatistics • Environment-economicaccounting, national accounting • Other statistics • Burden on respondents
Structureof a qualityreport - Annexes • Supplementary information (annexes) • Detailedclassifications • Questionnaires • More detaileddescriptions • Graphics anddiagramsrelatedtothevalidationoftheresults • …
Validation atthe international level • Eurostat, OECD and UNSD validatethedatareportedbythe countries • Main objective: Comparabilitybetween countries • Comparisonsacross countries (usingreference variables likenumberofinhabitantsorvalueadded) • Comparisonswithotherdatasources • Requests to countries for clarification and /or revision
Further information • Eurostat Manual on WasteStatistics: http://epp.eurostat.ec.europa.eu/portal/page/portal/product_details/publication?p_product_code=KS-RA-13-015 • ESS Standard for Quality reports 2009: http://epp.eurostat.ec.europa.eu/portal/page/portal/quality/quality_reporting • ESS Handbook for Quality reports 2009: http://epp.eurostat.ec.europa.eu/portal/page/portal/quality/quality_reporting
Contact & Information DI Milla Neubauer milla.neubauer@umweltbundesamt.at Umweltbundesamtwww.umweltbundesamt.at • Waste Statistics Training WorkshopQatar Statistics Authority ■ 18-19 June 2013