110 likes | 128 Views
Development and Implementation of a Mixed-Mode Multipurpose Survey-Tool for Official Statistics. Marc Plate Social Statistics Rome 15 May 2014. Development of a new Survey-Tool. Status Quo:. CATI and CAPI using BLAISE, Mixed-Mode: Mainly alternating modes for Panels
E N D
Development and Implementation of a Mixed-Mode Multipurpose Survey-Tool for Official Statistics Marc Plate Social Statistics Rome 15 May 2014
Development of a new Survey-Tool Status Quo: CATI and CAPI using BLAISE, Mixed-Mode: Mainly alternating modes for Panels 160 CAPI Interviewer 60 CATI Interviewer Up to 200.000 Interviews, in up to 20 Surveys per year • New IT-System to reach these goals: • Enable Multipurpose Surveys • Enable different kinds of Mixed-Mode Designs • Enable new mode “CAWI” Planned first use: Household Budget Survey 2014/15 then LFS 2016
Enable Multipurpose Design Official Statistics have the need to design surveys more flexibel Vision: Modularize the statistical production. Questionnaires are composed by combining modules Q1 Q2 Q4 Q5 Q6 Q7 Module 1 CAWI Module 2 CATI eQuestionnaire CAPI Module 3 PAPI … Module-Repository
The Module Repository - an Example Module: Expendituresfor Education and Training Module: Formal Education Submodule: Highestlevelofeducationattained Submodule: Expendituresfor formal education Submodule: Place ofeducation Submodule : HousingExpendituresconnectedto formal education Module-Owner Module: Occupational Education Module-Owner Submodule: Type ofoccupationaleducation Submodule : Expendituresforoccupationaltraining Submodule : Expendituresforother (non formal oroccupational) education
Enable Mixed-Mode Design • We need the best balance between standardized ,automated and respondent oriented case-management • We need a combination of modes to achieve highest data quality Vision: Make use of “classic” and “new” ways of data collection (CATI, PAPI, CAPI, CAWI) and supply the possibility of combining modes in a concurrent, sequential or longitudinal mixed-mode design Centralized System forplanning, conductingandmonitoringfield-phase
Monitoring the Field Phase – an example Lozar-Manfreda & Belek 2013
Websurvey – The Vision More and more Respondents raise the wish to answer a survey online Vision: Offer a web-questionnaire so well designed, that it works for the general population without the need of any personal contact. Paradata On- and Offline Functionality Websurvey Innovative Explanatory notes Highest data security Innovative Plausibility Checks Webportal List of Questiontypes Integration of Lookuplists
Multipurpose Design / ModularisationThe Challenges • Substantial Challenges • Reasonablegroupingofquestions • Howtomake links betweenmodules • … • Organisational Challenges • Reorganisation ofresponsibilitiesinto modul-responsible, topic-responsible, • questionnaire-responsiblePersons. • Strong communicationsbetweendepartments • Module-responsible Person hasto design „perfect“ questions • Project Team ofonesurveyis not reasponsiblefor all questionsanymore How can modularity be accomplished without loosing sight of the overall context? What methodological implication arise, when questionnaires are designed part by part?
Mixed-Mode Design / CAWIThe Challenges Need for constant Evaluation of questionnaire for all modes • Knownmethodologicalissuesof Mixed-Mode desing, particularly • Compareabilitybetweenmodes • Break in time series • Howtoget R touse web whenwe „only“ knowadressandname • CAWI: Doesloosingtheinterviewermeanloosingqualityassurance? (Losingcontroloverwhoisanswering, Losingmeansofcollectingfeedback on questions) • „New“ Issue: Paradata .
Please address queries to: Marc Plate Contact information: Guglgasse 13, 1110 Vienna phone: +43 (1) 71128-7972 Marc.Plate@statistik.gv.at Thank you very much for your attention