1 / 7

Re-interviews – a case study WP2

This workshop discusses the methodology of using re-interviews to detect and correct measurement bias in social surveys. It explores the use of auxiliary data, paradata, and survey data from earlier waves in the re-interview process. The case study focuses on the example of the Labour Force Survey and Crime Victimisation Survey. The workshop also presents results and conclusions on the effectiveness of re-interviews as a viable option for bias correction in social surveys.

georget
Download Presentation

Re-interviews – a case study WP2

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ROME April 11th | 12th 2019 MIMOD Mixed-Mode Designs for Social Surveys FINAL WORKSHOP Re-interviews – a case study WP2 Barry Schouten, Bart Buelens and Jan van den Brakel Statistics Netherlands (CBS)

  2. Re-interviews to detect and correct measurement bias • Methodology to detect/correct mode-specific measurement bias demands for auxiliary data: • Administrative data or frame data that can be linked to the sample; • Paradata about nonresponse; • Paradata about measurement; • Survey data from earlier waves; • Re-interview: • To generate variables for calibration; • To generate repeated measurements; • Re-interviews originate from motivation that standard auxiliary data is too weak to break confounding between selection and measurement. MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

  3. Re-interviews – Example LFS 2011 Estimates for mode effect components for unemployment rate based on field experiment linked to Crime Victimisation Survey 2011. CVS contained LFS module to derive bbint MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

  4. Re-interview case study • Variable features: • Two ESS surveys: LFS and Health Survey/EHIS; • Three sizes of anticipated measurement bias: lower, middle and upper • Two measurement benchmarks: Web and telephone/F2F; • Two optimization criteria: MSE and sampling variance; • Three time horizons: One year, two years and five years; • Two measurement bias settings: time-independent and time-dependent; • Fixed features: • Fixed budget; • Sequential mixed-mode design is selection benchmark; MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

  5. Re-interview – MSE with time-independent bias Results measurement benchmark web and phone/F2F (T = 1, 2, 5 years) : MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

  6. Re-interview – Variance constraint Resultstime-independent and time-dependent measurement bias MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

  7. Conclusions • Summary results: • Under variance criterion, re-interviews are not a viable option; • Under MSE criterion, re-interviews can be a viable option: • Especially for Health Survey/EHIS; • Especially for telephone/F2F benchmark; • Time horizon only mildly influential; • Future research: • Cost-benefit analysis may be repeated for other surveys and other ESS countries; • Re-interview should be piloted for an ESS survey; MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

More Related