1 / 22

Does mixing F2F and web lead to cost savings?

18 July 2013 ESRA2013. Does mixing F2F and web lead to cost savings?. Mari Toomse-Smith @MariToomseSmith. Contents. Background About the study Response Potential for cost savings Actual cost savings Cost model Conclusions. Background. 1. Context.

byron-gay
Download Presentation

Does mixing F2F and web lead to cost savings?

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 18 July 2013 ESRA2013 Does mixing F2F and web lead to cost savings? Mari Toomse-Smith @MariToomseSmith

  2. Contents Background About the study Response Potential for cost savings Actual cost savings Cost model Conclusions

  3. Background • 1.

  4. Context Increasing attention on mixed modes Potential for cost savings Potential for increasing response Unclear to what extent this potential realised in reality • Especially if face-to-face involved

  5. Survey I NatCen ran for ISER at University of Essex Main survey largest household panel in the world IPs test innovations and carry experiments IP5 – first test of F2F/Web in a large F2F panel survey

  6. Survey II Household survey: • Household questionnaire • Individual questionnaire • Adult self-completion • Youth self-completion Split off households Sample: original W1, W4 refresh, W4 non-respondents 15 experiments Interview length 60 minutes per household Incentives: £5, £10, £20, £30

  7. Design Experimental group Web only phase F2F phase, web open Control group No web F2F only phase

  8. Response 2.

  9. Web take-up 23% Households completed fully online Another 13% completed partially

  10. Household response by sample type, original responding sample Base: All issued households in original sample (responding) Source: Jäckle, Lynn, Burton (2013)

  11. Household response by sample type, refreshment sample Base: All issued households in refreshment sample Source: Jäckle, Lynn, Burton (2013)

  12. Web response by incentive amount Base: All households in mixed mode sample Source: Jäckle, Lynn, Burton (2013)

  13. Cost 3.

  14. Expected effect on cost • Decrease • No interviewing fees for web completes • No trips required to web completes • Increase • More programming: web and F2F questionnaires • Set up and manage emails • Man a helpline for the web group

  15. One-off costs Research time to develop new procedures and support the mixed modes Develop sample management system Update response monitoring tools Field management cost to support interviewers

  16. Effect on costs

  17. Fieldwork costs Main source of savings: • Fees for productive cases Marginal savings on: • Travel time and mileage – 3% Why travel less affected: • Main source of cost – travel to and from PSUs • Smaller points – more travel • Web cases in F2F more difficult – require more calls

  18. Cost of achieved interview by incentive amount Base: All issued households

  19. Simulated costs per achieved sample size

  20. Conclusion 4.

  21. Conclusions Mixed modes take up is higher than expected No evidence that response in mixed modes is higher Risk of more refusals and partial households Costs increase in the first year Fieldwork costs do not decrease as much as might be expected Increase in web response with higher incentives is not enough to offset the incentive value Mixed modes design becomes cost effective at higher achieved sample sizes

  22. Thank you If you want further information or would like to contact the author, Mari Toomse-Smith Senior Research Director T.+44 020 75499580 E.Mari.toomse-smith@natcen.ac.uk Visit us online, natcen.ac.uk

More Related