120 likes | 132 Views
Mode-Mixers of the North, Unite? Trends in Nordic and European data collection for social surveys. MIMOD: A 2017-2019 grants project. MI xed MO de D ata collection
E N D
Mode-Mixers of the North, Unite? Trends in Nordic and European data collection for social surveys Dag F. Gravem, StatisticsNorway, dfg@ssb.no
MIMOD: A 2017-2019 grants project • MIxedMOdeData collection • Support national statistical institutes (NSIs) in the European statistical system (ESS) with regard to multi-mode and -device data collection challenges • Using different tools can impact net sample composition and/or measurements – positively and/or negatively • (And possibly save time and money)
MIMOD: A 2017-2019 grants project • Consortium: Italy, Netherlands, Austria, Germany and Norway • Support group: Finland, Sweden, Poland, Czech republic, France • Work packages: • Mode organization • Assessment and adjustment of mode effects • Case management systems • Designing mixed-mode questionnaires • Phone and tablet challenges https://www.istat.it/en/archivio/226140
Key takeaway point #1 “If there is even a small chance of mixing modes in the project, design the questionnaire for the possibility of mixed-mode data collection.” Guideline 11.7 in Internet, Phone, Mail and Mixed-Mode Surveys – The Tailored Design Method by Don A. Dillman (pictured), Jolene D. Smyth and Leah Melani Christian (2009)
The chance of mixed mode is BIG! LFS: Labour force survey EU-SILC: European Standards of Income and Living Conditions EHIS: European Health Interview Survey AES: Adult Education Survey ICT: Information and Communication Technology survey CAPI: Computer-assisted personal interview CATI: Computer-assisted telephone interview PAPI: Paper and pencil interview CAWI: Computer-assisted web interview
MIMOD: WP4 in a nutshell • Review of ESS model questionnaires, variable descriptions and relevant documentation • Poorly adapted to mixed mode • In conflict with literature and practice (haven’t read Dillman?!?) • Analysis of key and typical questions vulnerable to mode effects • Classification system developed by Campanelli et al. (2013) • (Re)design and pretesting of selected questions • Unimode: making it as similar as possible across modes • Mode-specific: designing for each mode • Cognitive and usability test-retest design
An example: Hours worked in reference week from Labour Force Survey • Using the strengths of visual presentation and automatic calculation to enhance data quality • Positive results by Statistics Finland in 2013 pilot • Negative findings by ONS (UK) in 2018 prestesting • What about Norway..?
An example: Hours worked in reference week from Labour Force Survey • Subjected to cognitive and usability lab testing • Regrettably, in line with ONS findings • Test persons annoyed by response burden • Satisficing by rounding to nearest hour
Key Takeaway Point #2: • We (The Nordic countries ++?) could use a platform for exchanging … • question and questionnaire documentation, • good and bad ideas, • test and pilot results, • screenshots, • discussions • … and other stuff related to our common mixed mode challenges • Something in the form of a moderated wiki for invitees