130 likes | 223 Views
Web in mix-mode surveys in Norway. Bengt Oscar Lagerstrøm Symposium on General Population Surveys on the web, London November 2011. Surveys in Norway on ”general” populations. 2001 – Mode effects in a mail plus Internet designed Census. Haraldsen et al (2002)
E N D
Web in mix-mode surveys in Norway Bengt Oscar Lagerstrøm Symposium on General Population Surveys on the web, London November 2011
Surveys in Norway on ”general” populations • 2001 – Mode effects in a mail plus Internet designed Census. Haraldsen et al (2002) • 2007 – Rent Market Survey 2006, Lagerstrøm (2007) • 2008 – Rent Market Survey 2007, Lagerstrøm (2008) • (2011 – Survey on Education 2011, Haraldsen et al (2012)) • 2011 – CPI - Rent prices, Lagerstrøm (2012)
Experiments • Census 2001. Mode effects. Paper versus two types of web questionnaires • The Rent Market Survey (RMS) – From interviewer administrated to self administrated – effect on RR, bias and estimates • RMS – data quality and costs • RMS and CPI – panel issues
Hypothesis • Is it essential that the respondent have the opportunity to choose in which mode they would like to participate? A common assumption appears to be that offering multiple modes of reporting makes the reporting task easier, which will lead to higher response and better data quality. • More motivated respondents and better quality of data are the two main pillars in Statistics Norway’s new data collection strategy, and one way to get more motivated respondents would be to offer them to respond in a preferred mode. But, how should we present the different tools? One by one, all at once?....
Option of P or W vs. paper/web (RMS 2006) H (15,000) - option to respond on paper/web (telephone) P (1,000) – option to respond on paper (telephone) W (1,000) – with option to respond on web (telephone)
Bias by age groups (RMS 2007) P1 P2 P3
Lessons learn from Census and RMS • Paper seems easier to fill in than web questionnaire, but less errors in web questionnaires for less educated and older respondents • Don’t give the respondents the options to choose, but change mode to ensure a satisfactory RR. • Young respondents have a higher propensity to respond on web, especially men • Estimates could be mode sensitive? • Probably nothing two win in terms of money if you want same RR and bias structure
Our puzzle Motivation Availability Opportunity
New experiments • Change the wording in the advance letter – from ”please use the URL and password” to ”A interviewer will contact you, but you can still use the URL/password” • Sending SMS with direct access to the web questionnaire