1 / 18

The European Statistical Training Programme (ESTP)

Learn about the implementation of mixed-mode data collection in the Dutch re-design project, which aimed to reduce costs while maintaining data quality. Explore different mixed-mode designs, considerations for choosing a design, and the impact on response rates and composition.

trujilloj
Download Presentation

The European Statistical Training Programme (ESTP)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The European Statistical Training Programme(ESTP)

  2. Chapter 14: Mixed-mode datacollection • Introduction • Mixed-mode designs • Mixed-mode in practice: the Dutch re-design

  3. Introduction • Every mode has its weaknesses and its strengths • CAPI: expensive, good quality data • CATI: cheaper, but not every person has a telephone • Mixing modes provides an opportunity to compensate for weaknesses of the individual modes

  4. Mixed-mode designs • A mixed-mode design consists of a combination of two or more data collection modes • Three possibilities: • Concurrent • Sequential • Choice to the respondent

  5. Sample Mode 1 Mode 2 … Modem Concurrent mixed-mode design • The sample is divided in groups that are approached by different modes, but at the same time

  6. Sample Nonresponse Mode 1 Response Mode 2 Response Nonresponse Sequential mixed-mode design • All sample elements are approached by the same mode, but a different mode is used to follow-up the nonrespondents

  7. Examples of mixed-mode designs Sample Web • Safety Monitor 2006 and 2007(n = 30,000, n = 3,600) • LFS 2005 (n=18,000, n=1,000) Phone F-to-F Response Nonresponse Phone F-to-F F-to-F F-to-F Response Nonresponse Phone Web

  8. Examples of mixed-mode designs Web • Informal Economy 2006 (n = 2,000, n = 2,000) Response Nonresponse F-to-F Phone

  9. Examples: Response rates and composition

  10. Choosing a mixed-mode design • Issues • Questionnaire • Trade-off between errors and costs: coverage, unit nonresponse and measurement errors • Subject of the survey • Constraints • Time • Costs • Logistics

  11. Mixed-mode datacollection in practice: Dutch re-design • Project from 2007 - 2012 • Aim: Reduce costs but maintain quality Main ingredients of re-design: • Core questionnaire • Use of register information • Model based estimation • Quality framework • Parallel runs of old and new designs • Mixed-mode datacollection

  12. Mixed-mode datacollection in practice: Dutch re-design • Design: Web response nonresponse CAPI CATI response nonresponse response nonresponse

  13. Mixed-mode datacollection in practice: Dutch re-design Issues: + Web response nonresponse CAPI CATI response nonresponse response nonresponse 14.13

  14. Mixed-mode datacollection in practice: Dutch re-design • Ideally, data collection strategy tailored to different groups based on: • Costs • Quality • Logistics (systems) • Quality is a mixture of nonresponse bias, coverage- and measurement errors in the different modes. • Stability in the mixture of modes is important for planning of fieldwork, adjustment weighting and mode effects.

  15. Mixed-mode datacollection in practice: Dutch re-design • Coverage in different modes: CAPI covers entire population. For Web and CATI there is undercoverage for:

  16. Mixed-mode datacollection in practice: Dutch re-design • Response in different modes (Health Survey 2010)

  17. Mixed-mode datacollection in practice: Dutch re-design • Response in different modes (Health Survey 2010) • Conditional and unconditional partial R-indicators • Old design (CAPI) vs new design (total Mixed-Mode)

  18. Mixed-mode datacollection in practice: Dutch re-design • For the new design: Internet response vs Internet nonresponse • For the new design: Follow-up response vs follow-up nonresponse

More Related