ESSnet on Data Collection for Social Surveys Using Multi Modes (DCSS)

1. ESSnet on Data Collection for Social Surveys Using Multi Modes (DCSS) UN-ECE Conference of European Statisticians Seminar on Statistical Data Collection Geneva, Switzerland , 25 -27 September 2013 karen.blanke@destatis.de

2. Outline • Background and aims • Work in progress • Query on Data Collection in Social Surveys • Web data Collection • Mixed-Mode Data Collection

3. Some background • Initiated by Eurostat to support NSIs in: • Developing web data collection tools • Implementing and assessing the impacts of mixed mode data • Labor Force Survey (LFS) chosen as a concrete example • Duration of the project: autumn 2012 – 2014 • Consortium: • Partners (5): FI, NO, NL, UK, DE (coordinator) • Support-group-members (3): SE, DK, IT • External consultants

4. Query on Data Collection in Social Surveys • (Preliminary results) • Data collection: spring 2013 • 37 NSIs (ESS & overseas) • 85 % response rate

5. Diversity in mixedmodedatacollection in the NSIs • Planningforimplemenationof CAWI morethan a third

6. WP II: Web data collection • CAWI questionnaires are … • self-administered instruments • computerised • distributed via the net • rich on functionalities and layout • However, ... • “A product by itself has no value, it has value only insofar as (functionalities) are used” (Dumas/Redish 1999) http://www.thiossane.org/images/usability2.jpg

7. Explanations (UK)

8. Placement & design of explanations (DE) Directly visible text Text behind link Combination of visible text and link Keyword and text behind link

9. Long lists & functionalities (DE)

10. DE: Error checks: soft/hard checks

11. Don‘t know options (NL)

12. Don‘t know options (NL)

13. Functionalities & sensitive wording (FI)

14. Smartphones (NO)

15. WP III: Multimode data collection • Mode effects: • Review of current knowledge on mode effects • How to analyse mode effects, in experiments and in regular LFS production • Impact of mode effects for the main variables of the LFS • Fieldwork and case –management systems & It-environment • Impacts on weighting and estimation ►Recommend methodological activities to further harmonisation of MM data collection in the European Statistical System

16. Conclusion • Mixed-mode is very divers in the different countries • Tailored recommendations are requested due to different conditions and data collections strategies: • Different mm designs are less or more sensitive against mode-effects • Different applied modes are crucial to survey organisation • Weighting & estimation is sophisticated • Implementation of Web questionnaires is very sensitive: • Switch from interviewer administered to self-completion • Change from oral to visual communication design

17. Further contact: Coordinator/WP II: Karen Blanke (karen.blanke@destatis.de) Federal Statistical Office of Germany WP III: Annemieke Luiten (a.luiten@cbs.nl) CBS Statistics Netherlands Eurostat: (http://www.cros-portal.eu)

18. Error messages (I): soft checks (DE)

19. Error messages (II): hard checks (DE)

20. Placement & design of explanations (DE) Directly visible text Text behind link Combination of visible text and link Keyword and text behind link