280 likes | 313 Views
Qualtrics for data collection. Nathan R. Jones, PhD Senior Project Director University of Wisconsin Survey Center nrjones@ssc.wisc.edu. Goals of the Course. Day 1 Overview of survey research concepts , principles, and terminology
E N D
Qualtrics for data collection Nathan R. Jones, PhD Senior Project Director University of Wisconsin Survey Center nrjones@ssc.wisc.edu
Goals of the Course Day 1 • Overview of survey research concepts, principles, and terminology • Qualtrics orientation to introduce workflow from questionnaire design to final data
Goals of the Course Day 2 – Apr 14, 2-4p • General tips for questionnaire design • Orientation to Qualtrics tools for writing and formatting survey questions
Goals of the Course Day 3 – Apr 19, 10a-12p • Advice on fielding and managing surveys • Qualtrics tools for launching surveys and keeping track of sample members
So, we’re doing surveys… • Principal parts of a survey Mode Instrument Respondents
Examples • Typical Qualtrics links look like this: https://uwmadison.co1.qualtrics.com/SE/?SID=SV_6MuZXppPN92uci9 https://uwmadison.qualtrics.com/SE/?Q_SS=26a4uQdaiUswgjr_9ZvZae9DCmf8ost&_=1 • Follow along! http://bit.ly/1ZSwk6J
What is a GOOD questionnaire? • Achieve your study goals • Collect the data you need to answer your question(s) • Allow sufficiently complex analysis • Do not reinvent the wheel • Great questions, indices, tools already exist • Plan for external comparison unless you have a great reason to innovate • Low burden • Ask questions that are easy to answer • Do not waste time
Why do a survey? • To describe a population • Census • Probability sample • Standardized interview schedule • To test for changes or effects • Case-control studies • Clinical trials • May use multiple modes
Probability sample Why can’t we just talk to people?
Probability sample • Identify the population of interest. • Obtain a list of members of the population. (This list is called the sample frame) • Select units so that all units have a knownprobability of selection that is greater than 0.
Principal parts of a survey • Study Design • Sample Design • Mode of administration • Instrument development • Pretesting, testing, IRB • Data collection • Data preparation - weighting, processing, delivery • Documentation • Analysis • Budget
A Survey From a Process Perspective (Groves et al. 2004)
Other than surveys….? With some creativity, Qualtrics can be used for other purposes. • data entry • training • quality control • evaluation • market research • pre/post-event feedback • and other uses with some creativity
Other than surveys….? With some creativity, Qualtrics can be used for other purposes. • data entry
Other than surveys….? With some creativity, Qualtrics can be used for other purposes. • data entry Never / Sometimes / Often / Always
Respondent interaction • How many times will you collect data? • Once • Cross-sectional • Sample population at single point in time • Many times • Trend – Repeated cross-sections • Cohort – Follow a group over time • Panel – Follow several groups over time
Develop standardized questions Pre-test candidate questions Test entire instrument Obtain permission to conduct survey Keep records and documentation! Pre-Testing, Testing, IRB
Initial contact and obtaining cooperation Incentives Training interviewers Follow-up procedures after survey Supervision and reporting Re-contacting methods for longitudinal studies Procedures for protecting respondents Field Procedures
You can use your data! But do not forget final documentation Sampling procedures, special cases Instrument bugs Field procedures, decisions, and materials Coding, decisions, and special cases Data cleaning Weighting And finally…
Create survey Draft and revise instrument Activate survey Upload contact information Draft survey invitations Send initial email Check progress Draft reminder emails Send reminder emails Download data and summary reports Qualtrics workflow
A Survey From a Process Perspective (Groves et al. 2004)
Thank you! Nathan R. Jones Senior Project Director University of Wisconsin Survey Center nrjones@ssc.wisc.edu