1 / 23

Launching Surveys and Sample Management using Qualtrics

Learn the essentials of survey design, data collection, and sample management using Qualtrics. Discover best practices, tools, and techniques for maximizing response rates and ensuring high-quality data. Suitable for researchers, project managers, and survey administrators.

dzeller
Download Presentation

Launching Surveys and Sample Management using Qualtrics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Launching Surveys and Sample Management using Qualtrics Day 3 Nathan R. Jones, PhD Senior Project Director University of Wisconsin Survey Center nrjones@ssc.wisc.edu

  2. Schedule • Day 1 - Overview • Day 2 - Questionnaire development • Day 3 - Data collection

  3. Principal parts of a survey • Study Design • Sample Design • Mode of administration • Instrument development • Pretesting, testing, IRB • Data collection • Data preparation - weighting, processing, delivery • Documentation • Analysis • Budget

  4. Planning related to data collection Draft project proposal and budget should include • Study goals • Timeline • Modes for collecting data • Instrument design • Sample & sample management • Methods to maximize response rate • Progress reporting • IRB and other permission

  5. Review - Study goals Two common goals that may call for very different study designs are… • To describe a population • To make comparisons among groups, such as comparisons among men and women or people of different age groups.

  6. Timeline Determine: • When does the survey ideally need to be started and completed? • What else is going on that could interfere? • How much uncertainty is there about when you can start? • How much flexibility do you have in when you can start?

  7. Modes for collecting data Ways of interacting with respondents • Mail • Phone (CATI) • Web • Face-to-face (CAPI) • Focus groups • Mixed or multi-mode

  8. Factors that influence mode choices Survey population • Characteristics, abilities, resources, and interests Sample frame • Information available (area, name, address, telephone number, email address) Study topic • Sensitivity, task difficulty, need to use visual aids Analytic goals • Comparisons needed with studies using other modes

  9. Factors that influence mode choices Administrative infrastructure • Availability of technology and experience with technology Interviewers • Ability and experience Cost • Budget; existing resources Time • Desired length of field period; timely access to data Response rate • Need for high response rate

  10. Sample and sample management Some important questions: • What is the desired sample size? • Who will complete the survey? • Do you have a list of the individuals to be surveyed? • What contact information is on the list? • How current? • How accurate? • Will someone need to purchase or otherwise acquire the sample?

  11. Sample More questions: • Will you need to track/trace sample members? • Will this be done before the project is put into the field, while the project is in the field, or both? • Will certain groups need to be oversampled? • Will households need to be screened to determine if there is anyone eligible to participate in the study?

  12. Sample Do you need a sampling statistician or other specialist for this project? • Hard to reach populations • Low incidence populations • Complex sampling • Complex weighting

  13. Increasing response rates Incentives “Can I just pay people to answer?”

  14. Incentives Why do people participate? • Theories • Social exchange (Dillman) • Economic exchange (Biner and Kidd 1994) • Leverage-salience theory (Groves et al. 2000) • Dimensions • Prepaid vs. promised incentives • Monetary vs. nonmonetary • Amount of incentive • Mode

  15. Incentives meta-analysis (Church 1993) • Meta-analysis of 38 mail surveys • Prepaid incentives increased response rates more than promised incentives • Prepaid monetary incentives yield higher response rates than gifts • Response rates increase with increasing amounts of money, although not all studies find a linear relationship

  16. Protection of human subjects Permission to do research Issues frequently raised by survey work • Where are you getting your participants?  • How will they be recruited? • What is consent process? • Written consent or waiver of written consent • How will confidentiality be protected? • Incentives

  17. Protection of human subjects Potential complicating factors: • Will you be linking data from medical records? • Sensitive medical conditions or issues • Children • Illegal activities • Prisoners • Anything else?

  18. Data collection • Begin field period • Discover quality of sample • Progress reporting • Sample management • Close field period

  19. Field procedures to maximize response • Train interviewers • Method for initial contact and obtaining cooperation • Follow-up procedures • Converting refusals • Quality control • Supervision and reporting • Recontact methods for panels

  20. Data management Data delivery • Preliminary data • Additional data deliveries as needed • Recodes/post-processing • Weights Final reports and documentation • Response rate report • Codebook • Methods

  21. Post-survey processing Coding and cleaning • Standardized coding systems • Training coders • Measure coding reliability • Coding schemes for open questions • Procedures for protecting respondents

  22. Questions?

  23. Thank you! Nathan R. Jones Senior Project Director University of Wisconsin Survey Center 4418 Sterling Hall (608) 890-4724 nrjones@ssc.wisc.edu

More Related