Covering the general population by Internet interviewing Marcel Das

1. Covering the general population by Internet interviewing Marcel Das

2. MESS Project • core element: LISS panel • other key elements:- core study- experimental modules- new forms of data collection- links with administrative data- special groups

3. Core element: LISS panel • Online panel of 5,000 households • 8,000 individuals (>= 16 years) • Questionnaires each month, 30 min. • Incentive 15 euro an hour (average) • For scientific use, at no cost

4. LISS panel • Online interviews as method, but: • Probability sample drawn from address sampling frame of Statistics Netherlands • Includes households without Internet access (less than 15%): CentERdata provides equipment • Contacted by letter, telephone or visit

5. simPC • Very small and silent • Only the most frequently used functions • Automatic maintenance, safety • Simple operation and readable screens • Installation and support

6. Recruitment letter and brochure panel question short interview confirmation households without Internet households with Internet simPC and adsl Internet interviews

7. Secondary response target: 60% Response letter and brochure panel question short interview Primary response target: 80% confirmation simPC and adsl Tertiary response target: 53% Internet interviews

8. Recruitmentexperiment CATI = Computer Assisted Telephone Interviewing CAPI = Computer Assisted Personal Interviewing

9. Pilot experimental groups • CATI: special letter - no incentive - Panel in letter and brochure • CATI: special letter - promised incentive E. 50 - Panel introduced after interview • CATI: Standard letter - prepaid incentive E. 10 - Panel in letter and brochure • CATI: Standard letter - prepaid incentive E. 20 – Panel introduced after interview • CAPI: special letter - prepaid incentive E. 50 – Panel introduced after interview • CAPI: special letter - no incentive - Panel in letter and brochure • CAPI: Standard letter - promised incentive E. 10 - Panel in letter and brochure • CAPI: Standard letter - promised incentive E. 20 - Panel introduced after interview

10. Pilot natural groups • Unknown or no telephone number: 30% CAPI • Known (landline) telephone number: 70% CATI and CAPI

11. Effect of mode (1)

12. Effect of mode (2)

13. Effect of incentives • incentives increase response rates- effect is large from 0 to 10 euro (increase of 15%)- effect is not significant from 10 to 20, 20 to 50 euro (about 3%) • prepaid works better than promised

14. Effect of information • no effect of letter content • no effect of timing panel introduction • effect of seeing/reading brochure

15. Set up main recruitment • Combination CATI – CAPI, follow up CAPI • Prepaid 10 euro incentive • Promised extra 10 euro incentive for starting • Attention to design letter and brochure

16. Results

17. Non-response patterns • Similar to those of other leading scientific panels Superior to commercial access and volunteer panels:- no coverage problems - no selfselection

18. Attention for difficult groups • Correction by oversampling in refreshment of 2009 (with Statistics Netherlands) • New immigrant panel (with Cross-cultural Psychology, Tilburg University and Statistics Netherlands)

19. Correction of bias by stratified refreshment sample 2009 Persons

20. New forms of data collection

21. Use of graphical or animated presentation

22. Biomarkers • pilot study: blood cholesterol, saliva cortisol, and waist circumference

23. More biomarker experiments... • accelerometers • advanced scales (based on bioelectrical impedance) • link objective data with self-report data • high frequency measurement

24. Use of the LISS panel

25. Questionnaires • The “household box” • Experimental modules open to academic researchers at no cost • Core study

26. Experimental modules • Who can use the LISS panel:every researcher who wants to collect data for scientific, policy or societal relevant research Scientific research: Academic researchers, irrespective of nationality, can use the LISS panel at no cost • Proposals can be submitted throughout the year

27. Examples: subsample • Effects of illness babies in first year on labour participation parents: • Pregnant women, follow 3 years! • Adolescent/teen identity and the Internet: • 12-18 year olds • Random subsample or experimental groups

28. Procedure: (http://www.lissdata.nl/lissdata/Proposals/How_to_Submit_a_Proposal) • Submit to: a.c.scherpenzeel@uvt.nl • Typically be between 2 and 5 pages • Evaluation: Board of Overseers • Decision: 1-3 months • Accept • Revise and resubmit • Reject

29. Criteria: (http://www.lissdata.nl/lissdata/Proposals/How_to_Submit_a_Proposal) • Scientific potential: • predicated on literature; sound analytical framework • Fit in LISS panel: • value of using an Internet survey • Feasibility: • questions doable for respondents? • Burden: • length and target sample

30. Requirements: • Data protection statement • Single user access • Publication list • Data available to other researchers!

31. Proposals: Summary (May 2010)

32. Proposals: Examples

33. Available data • Who can use the LISS data: every researcher who wants to use data for scientific, policy or societal relevant research • Use of data is free of charge (unless data are used for research funded by means of external sources) • Available data: • longitudinal core study • proposed studies

34. Longitudinal core study • Household and family • Economic situation and housing • Work and schooling • Social integration and leisure • Health • Personality • Religion and ethnicity • Politics and values

35. LISS data • Disseminated through website / data archive: http://www.lissdata.nl • Database is based on an internationally used specification for describing social science data (DDI) • One of the first implementations of DDI version 3

36. Why use DDI? A lot more work? • Simple links to datasets and codebooks: fine for single datasets and once-a-year panel studies • LISS data: complex and extensive • Will the data and documentation still be accessible in 10 years?

37. Complex data Q8 Q9 Q7 Proposals Q6 Panel members Q5 Core questionnaire Q1 Q2 Q3 Q4

38. Extensive data • Example: “Do you know which panel members are vegetarian?” • Asked somewhere, but in which study? • Example: “Did you ever measure political efficacy?” • Asked sometime, but when exactly? • Example: “Can I estimate the housing expenditure of impulsive persons?” • Which items measured impulsiveness?

39. DDI 3 & LISS website • Search entry with keyword and on concept, topic, and study (relational) • Can handle longitudinal data (waves) • Exchangeable with other data archives • Flexibility for future applications (Example: iPod version)

48. October 2010 Publisher: Routledge / Taylor & Francis Group