1 / 8

Keystroke analysis and implications for fieldwork

Keystroke analysis and implications for fieldwork. WP3.3 – task 2 Johanna Bristle (SHARE, MEA) Verena Halbherr (ESS, GESIS) DASISH Final Conference – Gothenburg, 28 th Nov 2014. Introduction.

jerryk
Download Presentation

Keystroke analysis and implications for fieldwork

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Keystroke analysis and implications for fieldwork WP3.3 – task 2 Johanna Bristle (SHARE, MEA) Verena Halbherr (ESS, GESIS) DASISH Final Conference – Gothenburg, 28th Nov 2014

  2. Introduction • Tools produce paradata, e.g. Fieldwork Monitoring Application produces contact data (task 1 of WP3.3) • Goal of 3.3 - task 2: • Analysing one type of paradata, namely SHARE keystroke data and ESS time stamp data • Inform cross-national fieldwork & derive lessons learned • Definition: • Paradata = data about the process of data collection • Keystroke data = actions on a keyboard and time stamps for each action taken are recorded and extracted

  3. Deliverable D3.7 • Structure of deliverable • Description of data and preparation • Diagnostic of keystrokes • Outliers and distribution • Measuring interview length • Using keystrokes in a survey`s life-cycle • Questionnaire development • Fieldwork monitoring • Post-survey quality assessment • Available on the website of DASISH beginning of 2015 • Today: comparing the two surveys Focus of this presentation Focus of poster

  4. Interview length • Concept of interview length • Perspective of questionnaire development vs. interviewer and respondent

  5. Measurement error in time stamps • Paradata is far from error-free • Technical errors or breaks produce outliers or missing data • Reporting error if interviewer is involved (rounding)

  6. Cross-national interview length Notes: SHARE: own analysis on panel single households in wave 5 ESS: Analysis by Loosveldt & Beullen 2013. round 5, all respondents.

  7. Conclusions • Computerizeddatacollectionavoidsinterviewer-inducedmeasurementerror • Data qualityofparadata dataqualityofsurveydata • Cross-national & cross-survey comparison • Beyondsurvey-specificreasons (topic) • „Localsurveyculture“ (language) Potential ofparadata • Pretest: check qualityofnewitems • Duringfieldwork: real-time monitoringandinterventions • Post-survey analysis: surveymethodology& enhancingsurveyitems Harmonization in termsofdocumentation, disseminationandtooldevelopmentproducesuseful para- andmetadata

  8. Further reading and references • DASISH Deliverable 3.7 (forthcoming). Keystroke analysis and implications for field work. It will be available on www.dasish.eu/deliverables • Loosveldt, G. and K. Beullens (2013). "'How long will it take?' An analysis of interview length in the fifth round of the European Social Survey." Survey Research Methods 7(2): 69-78. • Kreuter, F. (2013). Improving Surveys with Paradata: Analytic Uses of Process Information. Hoboken, New Jersey, John Wiley & Sons.

More Related