130 likes | 312 Views
Survey Design Student Affairs Assessment Workshop. Joe Filkins, Associate Director, Institutional Studies. January 2013. Agenda. Introductions Surveys: When and Why Survey Design and Development Types of Surveys Question Design Sampling Deliverables. Surveys: When and Why.
E N D
Survey Design Student Affairs Assessment Workshop Joe Filkins, Associate Director, Institutional Studies January 2013
Agenda • Introductions • Surveys: When and Why • Survey Design and Development • Types of Surveys • Question Design • Sampling • Deliverables
Why Assess? • Learn about your audience • Data-based decision making • Tracking trends over time
Assessment Types • Focus Groups • Archival Data • IRMA Data: http://oipr.depaul.edu/ • Survey Reports: https://surveys.depaul.edu/Reports/index.asp • Observation • Polls: https://surveys.depaul.edu/Projects/Pulse/index.asp • Questionnaires and Surveys • Personal Interviews • Telephone Surveys • Paper and Pencil Surveys • Clipboard • Mail • Online Surveys
What Needs to be Considered • Relevance • Content and Design • Population and Sampling Methodology • Timing and Distribution (https://surveys.depaul.edu/Projects/index.asp) • Dissemination and Use of Information Collected • Protection of the Data and Information • Overall Impact
Writing Questions • Open-ended versus close-ended questions • Forced verses multiple choice questions • Four, five, or seven point scales • Question wording
Writing Questions • Open-ended versus close-ended questions • Forced verses multiple choice questions • Four, five, or seven point scales • Question wording
Questions to Ask Yourself • Do I know how to answer, given the question? • Is there one, and only one, answer choice that best represents my opinion? • Is the structure or presentation of the item confusing? • Is the item only asking one question? • Do any items require explanation or additional context for my answer/opinion to be best understood?
Things to look out for • Double-Barreled Questions • Leading/Loaded Questions • Overly Complex Questions • Avoid using lingo, acronyms, etc. • Mutually Exclusive and Exhaustive Response Options • Vague Terms Other things not covered • Response Sets • Asking for what respondents don’t know • Overly Personal or Threatening Questions • Off-topic Questions
Resources • Survey Site • surveys.depaul.edu • IRMA Site • oipr.depaul.edu