1 / 24

Claudio QUINTANO Rosalia CASTELLANO Gennaro PUNZO

European Conference on Quality in Official Statistics 2008 Rome, Italy – July 8-11, 2008. Evaluating the Total Non-Response Errors in the European-Union Survey on Income and Living Conditions (EU-SILC): A Territorial Quality Profile. Claudio QUINTANO Rosalia CASTELLANO Gennaro PUNZO.

hanne
Download Presentation

Claudio QUINTANO Rosalia CASTELLANO Gennaro PUNZO

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. European Conference on Quality in Official Statistics 2008 Rome, Italy – July 8-11, 2008 Evaluating the Total Non-Response Errors in the European-Union Survey on Income and Living Conditions (EU-SILC): A Territorial Quality Profile Claudio QUINTANO Rosalia CASTELLANO Gennaro PUNZO University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  2. AIM OF THE WORK Evaluating the ACCURACY of the Italian Section of EU-SILC data with focus on the NON-SAMPLING ERRORS deriving from the several components of TOTAL NON-RESPONSE STEPS • A SET OF AD HOC BASIC QUALITY INDICATORS (HIERARCHICAL FRAMEWORK) • CLASSES OF SYNTHETIC QUALITY INDICATORS • BROKEN DOWN BY DIFFERENT TERRITORIAL LEVELS • ONE-WAY RANDOM EFFECTS ANOVA MODEL (Singer, 1998) • RANKING ANALYSIS TERRITORIAL QUALITY PROFILE University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  3. EU-SILC: BACKGROUND AND MAIN FEATURES OF THE ITALIAN SEGMENT A two-stages sampling design… MUNICIPALITIES HOUSEHOLDS …STRATIFIED by demographic size, inside each NUTS2 region …drawn from municipality-registers by a systematic sampling Self-Representing 288 STRATA First order Non Self-Representing Second order University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  4. INTEGRATED DESIGN BASED ON FOUR YEARLY ROTATIONAL PANELS WHOLE PANEL A(4) B(3) C(2) D1 E1 B(4) C(3) D2 E2 F1 C(4) D3 G1 D4 E3 F2 G2 E4 F3 H1 F4 G3 H2 I1 CROSS-SECTIONAL University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  5. EU-SILC SAMPLING DESIGN... Table 1 – PSU stratification... Source: Author’s elaborations on Istat data Table 2 – Longitudinal replications in terms of SSU... Source: EU-SILC Quality Reports (2004 and 2005) University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  6. A THEORETICAL FRAMEWORK SAMPLING UNITS IN-SCOPE OUT-OF-SCOPE RESPONDENTS NON RESPONDENTS NON CONTACTED REFUSED UNABLE TO RESPONSE NON ACHIEVEMENT NOT LOCATED ADDRESS UNABLE TO ACCESS INCORRECT ADDRESS TEMPORARILY NOT-AT-HOME University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  7. EU-SILC BASIC QUALITY INDICATORS IN-SCOPE RATE OUT-OF-SCOPE RATE REFUSAL RATE UNABLE-TO- RESPONSE RATE NON-ACHIEVEMENT RATE NOT-LOCATED ADDRESS RATE UNABLE-TO- ACCESS RATE INCORRECT ADDRESS RATE TEMPORARILY NOT-AT-HOME RATE University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  8. A THEORETICAL FRAMEWORK IN-SCOPE RATE OUT-OF-SCOPE RATE REFUSAL RATE UNABLE-TO- RESPONSE RATE NON-ACHIEVEMENT RATE NOT-LOCATED ADDRESS RATE UNABLE-TO- ACCESS RATE INCORRECT ADDRESS RATE TEMPORARILY NOT-AT-HOME RATE University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  9. THE PROCESS OF CONTACTING THE EU-SILC SAMPLE HOUSEHOLDS... cross-sectional sample... Table 3 – Eligibility Rates 0.53% DECEASED 0.32% INSTITUTIONALIZED Source: Author’s elaborations on Istat data 0.30% TRANSFERRED Table 4 – Non-Contact Rates -0.32 -1.76 Source: Author’s elaborations on Istat data Table 5 – Frame Error Rates -1.25 Source: Author’s elaborations on Istat data University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  10. ... AND THEIR ACTUAL INVOLVEMENT EU-SILC cross-sectional sample... Table 6 – Non-Participation Rates -0.88 -4.34 +0.98 Source: Author’s elaborations on Istat data NON-ACHIEVEMENT RATE also includes a residual share of non-participant households, though successfully contacted, whose reasons are not specified University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  11. ... A SYNTHESIS OF THE BASIC QUALITY INDICATORS: A HIERACHICAL APPROACH COOPERATION RATE COOPERATION RATE NON COOPERATION RATE REFUSAL RATE UNABLE TO RESPONSE RATE NON ACHIEVEMENT RATE University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  12. ... A SYNTHESIS OF THE BASIC QUALITY INDICATORS: A HIERACHICAL APPROACH NON CONTACT RATE CONTACT RATE NOT LOCATED ADDRESS RATE UNABLE TO ACCESS RATE INCORRECT ADDRESS RATE CONTACT RATE University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  13. ... A SYNTHESIS OF THE BASIC QUALITY INDICATORS: A HIERACHICAL APPROACH x CONTACT RATE COOPERATION RATE RESPONSE RATE COMPLETION RATE University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  14. SAMPLING UNITS IN-SCOPE OUT-OF-SCOPE RESPONDENTS NON RESPONDENTS NON CONTACTED CONTACTED NOT LOCATED ADDRESS UNABLE TO ACCESS INCORRECT ADDRESS COOPERATING NON COOPERATING REFUSED UNABLE TO RESPONSE NON ACHIEVEMENT University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  15. EVALUATING THE ACTUAL SURVEY PARTICIPATION OVER TIME EU-SILC cross-sectional and longitudinal samples... Table 7 – Synthetic Participation Rates +6.86 Source: Author’s elaborations on Istat data 75.86% wave 2004 COMPLETION RATE wave 2005 82.25% University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  16. DOES TOTAL NON-PARTICIPATION DIFFER ACROSS NATIONAL TERRITORY? wave 2004 wave 2005 Fig. 1 – Non–Cooperation Rates Fig. 2 – Non–Contact Rates Fig. 3 – Non–Response Rates Fig. 4 – Non–Completion Rates University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  17. DOES TOTAL NON-PARTICIPATION DIFFER ACROSS NATIONAL TERRITORY? wave 2004 wave 2005 Fig. 5 – Frame Error Rates Fig. 6 – Refusal Rates In order to investigate in-depth the territorial perspective, its role and significance, as well as the effects on the total non-response process... ONE-WAY RANDOM EFFECTS ANOVA MODEL (NULL MODEL) University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  18. ONE-WAY RANDOM EFFECTS ANOVA MODEL (NULL MODEL) with i = 1, 2, ... ,m and j = 1, 2, ... , 21 municipalities NUTS2 regions measuring the effect fixed effect of belonging to the jth NUTS2 region random effects representing the difference between the ith municipality and the mean within the jth region intraclass correlation degree of homogeneity within NUTS2 regions University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  19. Table 8 – One-way random effects ANOVA model: main results Source: Author’s elaborations on Istat data REGION EFFECT University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  20. Table 9 – One-way random effects ANOVA model: main results Source: Author’s elaborations on Istat data REGION EFFECT University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  21. EXPLORING THE MAIN DIFFERENCES IN EU-SILC PARTICIPATION ACROSS NATIONAL TERRITORY In order to inspect how far is from each Italian NUTS2 region or geographical macro area to the entire national territory in terms of dissimilarities of data production process quality... SPATIAL INDICES SYNTHETIC QUALITY INDICATORS BY NUTS2 REGIONS RANKING ANALYSIS BY MACRO AREAS KENDALL’S RANK CORRELATION COGRADUATION University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  22. RANKING ANALYSIS Table 10 – Ranking of Italian geographical macro areas (Italy=100) - waves 2004 and 2005 Source: Author’s elaborations on Istat data Kendall’s rank correlation University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  23. CONCLUDING REMARKS... • NON-CONTACT, OVERALL NON-RESPONSE AND, OBVIOUSLY, NON-COMPLETION RATES SIGNIFICANTLY DIFFER BY ITALIAN NUTS2 REGIONS ON BOTH THE WAVES (2004 AND 2005) • NON-COOPERATION RATES SEEM TO BE STATISTICALLY DIFFERENT ACROSS NATIONAL TERRITORY ONLY IN 2005 • DIFFERENTIALS ACROSS NUTS2 REGIONS ALSO CONCERN THE FRAME ERRORS AND REFUSALS AS THE TWO CRUCIAL SOURCES OF NON-CONTACTS AND NON-COOPERATION, RESPECTIVELY • A DOWNWARD TREND OVER WAVE IS REVEALED FOR THE OUTCOME QUALITY INDICATORS CONSIDERED ALSO DUE TO THE PANEL FRAMEWORK OF THE EU-SILC SURVEY • STAYING PUT OF THE ITALIAN REGIONS IN THE SAME (OR IN A SIMILAR) RANKING FOR THE NON-CONTACT AND NON-COOPERATION RATES AS WELL AS FOR THE FRAME ERROR AND REFUSAL RATES University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

  24. … AND FURTHER DEVELOPMENTS REALLY... At a sub-national level, a variety of contextual factors may influence survey participation, such as... SOCIO-ECONOMIC ENVIRONMENT INFLUENCES ON SURVEY PARTICIPATION (Groves and Couper, 1998) • URBANICITY • POPULATION DENSITY • CRIME RATES • LACK OF SOCIAL COHESION • AND SO ON... We deliberately neglected these aspects but we intend to examine them closely afterwards University of Naples “Parthenope” – Faculty of Economics Department of Statistics and Mathematics for Economic Research

More Related