1 / 18

Challenges of redesigning household surveys and maintaining output quality

Statistics Netherlands. Challenges of redesigning household surveys and maintaining output quality. May 6, 2010. Menno Cuppen Paul van der Laan Wim van Nunspeet . Statistics Netherlands. Challenges of redesigning household surveys and maintaining output quality. Outline.

yoko-moran
Download Presentation

Challenges of redesigning household surveys and maintaining output quality

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality May 6, 2010 Menno Cuppen Paul van der Laan Wim van Nunspeet Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  2. Outline • Driving forces • Approach • Maintaining quality • Results and perspectives • Conclusions Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  3. Driving forces • Efficiency • Quality • Flexibility • Constraints: • (European) quality / user satisfaction • Solution for discontinuities Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  4. Approach • Means: • More use of registrative data • More use of CAWI and mixed mode designs • Integration of surveys in one survey system • “Re-use” of respondents • Implementation of advanced estimation techniques Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  5. Survey Model • Optimal use of these means in integrated design for household surveys: • Core module and topic modules • Well-balanced use of mixed mode • (CAWI - PAPI - CATI - CAPI) Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  6. Core Questionnaire • Household composition • Labour status • Health • Religion • Voting behaviour • Occupation in employment • Economic sector in employment • Highest level of education completed • Screening, telephone numbers, e-mail adresses Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  7. Standard mixed mode strategy CAWI (+ PAPI) 25 – 35 % ± 5% Refusal No contact 55 - 65% 35 - 45% CATI ± 45% CAPI ± 35% If tel.nr. available If not tel.nr. available Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  8. Mode effects • Selection effects • Context effects • Satisficing • Interviewer effects Design principle: Unimode questionnaire design Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  9. Maintaining output quality • Explain discontinuities for core variables • Quality indicators (framework) • Pilots and experiments • Parallel designs • Time series modelling Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  10. Quality indicators • Relevance • Accuracy • Timeliness • Accessibility • Comparability • Coherence Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  11. Results • 2009: • Core questionnaire in Health Survey • LFS sample size reduction by using data from unemployment offices • Structural time series estimators for monthly unemployment • Small area estimators for sub-regional unemployment statistics Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  12. Results • 2010: • Core questionnaire in LFS • Mixed mode in LFS (CAPI – CATI) • Mixed mode in Health Survey (CAWI – CATI – CAPI) • Topic modules after Health Survey • 2011/2012: • CAWI in LFS • More topic modules after core questionnaire Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  13. Parallel designs Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  14. Parallel designs Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  15. Parallel designs Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  16. Issues • Unpredictibility CAWI results and impact on fieldwork planning in a mixed mode design • Changing geographical distribution CAPI-samples • Mode effects (methodology & best practices) • Survey integration • Creating uni-mode questionnaires • Households/LFS and CAWI • Flexibility in operation (methodology – survey case management system) Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  17. Conclusions • Quality can be maintained • Efficiency targets met • Flexible in meeting new national and European needs Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

  18. Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality Menno Cuppen May 6, 2010 Statistics Netherlands Challenges of redesigning household surveys and maintaining output quality

More Related