120 likes | 255 Views
Assessing Survey Research, a principled approach. Benoît Gauthier Circum Network Inc. CES Annual Conference Banff, May 20-23, 2001. gauthier@circum.com http://circum.com 819.770.2423. The problem. Need a way to assess survey quality No structured framework exists
E N D
Assessing Survey Research,a principled approach Benoît Gauthier Circum Network Inc. CES Annual Conference Banff, May 20-23, 2001 gauthier@circum.com http://circum.com 819.770.2423
The problem • Need a way to assess survey quality • No structured framework exists • Attempts by WAPOR members • Same problem in various contexts, in particular in the judicial process
Criteria for quality research • Rigour • recognized best practices of survey research • Neutrality • absence of bias • Balance • sufficient yet parsimonious resources • Transparency • all the relevant background for an assessment
Survey research building blocks • Questionnaire • Sampling • Data collection • Data management • Data analysis • Reporting
The case of Internet surveys • Internet survey-specific issues • Mick P. Couper (POQ, 2000) • sampling frame coverage • non-response, for probability samples • browser variations in rendering • panel conditioning (longitudinal studies)
The case of Internet surveys • Sampling frame coverage = sN • Non-response = sN • Browser variations = qN • Panel conditioning = cN • Only neutrality is at issue
Internet surveys: conclusion • Internet-based surveying does not affect the basics of good research • Only 3 of 24 assessment areas show specifics • Good research is good research, on or off the Internet
Conclusion • Principles and criteria for an exhaustive, fair and constructive review of survey research projects • Guide to the experienced researcher • Discovery tool for the beginner This document is available at http://circum.com under "Recent documents"