170 likes | 334 Views
The Use of Online Surveys for Data Collection. Jason N. Adsit, P h .d . Teaching & Learning Center University at Buffalo. Overview. The basics of online survey tools The benefits of online survey tools Factors you should consider when selecting an online survey tool
E N D
The Use of Online Surveys for Data Collection Jason N. Adsit, Ph.d. Teaching & Learning Center University at Buffalo
Overview The basics of online survey tools The benefits of online survey tools Factors you should consider when selecting an online survey tool Some really cool e-research sites and resources
Online Survey Tools: The Basics • Online survey tools: • Allow you to create and publish surveys in an online/Web-based setting • Allow end-users to submit responses through a Web site (Web-based forms, portals, etc.) • Allow you to house the “raw data” on a Web-based server/database • Allow you to export data to outside analytical programs (Excel, SPSS, etc.)** • Allow you to run queries, generate reports, and create visual representations of data**
Online Survey Tools: The Basics • Free (or Trial Version) Online Survey Tools: • Basic surveys • Limited question types • Limits on size of survey (# of questions) • Limits on size of response sample (# of responses) • Little or no “skip logic” • Limited ‘export’ ability (to SPSS, Excel) • Limited data-analysis • Limited capacity for graphics, visual displays, etc.
Online Survey Tools: The Basics • Fee-for-Service Online Survey Tools: • Monthly fee versions • Annual fee versions • Response sample fee scales (0-100, 101-1000, 1001-10,000, etc.) • Greater variety of question types • Multiple modes of “skip logic” • Access to “question banks” and “survey banks” • Easy export to statistical packages • Sophisticated analytical tools • Graphics and visual displays of data
The Benefits of Online Survey Tools • Simplicity • Scalability • Low cost (relative to other methods) – especially when you have a large n • Reduced administrative burden • Little or no (manual) data-entry • Reductions in error rates/cloudy data/messy data that accompany manual entry • Access to question banks, analytical tools, and graphics engines*** Source: Yun & Trumbo (2000); Greatbrook Online: http://www.greatbrook.com/online_survey_tools.htm
The Benefits of Online Survey Tools • A reminder: • Although these tools make it easy to design and deliver a survey, they don’t have the tools to help you design a good (sound, valid, reliable) survey • That’s on you • Response rates • A tricky issue Source: Yun & Trumbo (2000); Greatbrook Online: http://www.greatbrook.com/online_survey_tools.htm
Factors to Consider • Determine your research needs • Audience • Sample size • Question types (quantitative vs. qualitative; scales; free text; etc.) • Statistical/Analytical needs • Report types/models • Compare Costs • Is “free” really the best option? • Test out multiple platforms – front-end and back-end • Test out the support models for each platform – reliability, flexibility, accuracy, responsiveness, etc.
Factors to Consider The Big (Big) Point: Let your research and reporting needs drive the decision-making process
Factors to Consider • Some additional items to consider: • Question flexibility • Skip logic – yes or no • Visual displays and survey interface – and display flexibility (e.g., adding your own banner or graphic) • “User-friendliness” – amount of training involved • Technical aspects – browser specifications, bandwidth, etc. • Levels of anonymity for sample group
Some Cool Resources • Centre for Learning and Performance Technologies • http://www.c4lpt.co.uk/Directory/Tools/forms.html • Web Survey Methodology (WebSM) • http://www.websm.org/ • UT Austin Online Survey Tool Summary (partial list) • http://www.utexas.edu/academic/diia/assessment/iar/teaching/plan/method/survey/compareElectronic.pdf • OSU “Survey of Survey Tools” • http://wac.osu.edu/workshops/survey_of_surveys/
Some Cool Resources Some online survey tools (finally!) SurveyMonkey (http://www.surveymonkey.com/) PollDaddy (http://polldaddy.com/) Zoomerang (http://www.zoomerang.com/) Limesurvey (http://www.limesurvey.org/) SurveyGizmo (http://www.surveygizmo.com/) Vovici (http://www.vovici.com/)