1 / 16

Survey Design

Survey Design. Teri Peterson Peteteri@isu.edu. Acknowledgements. The Survey Kit By Arlene Fink Survey Design and Sampling Procedures By Tony Babinec Statistics.com. What is a survey?. A system for collecting information: From or about people Describe, compare or explain/predict

bernad
Download Presentation

Survey Design

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Survey Design Teri Peterson Peteteri@isu.edu

  2. Acknowledgements • The Survey Kit • By Arlene Fink • Survey Design and Sampling Procedures • By Tony Babinec • Statistics.com

  3. What is a survey? • A system for collecting information: • From or about people • Describe, compare or explain/predict • Knowledge, attitudes, behaviors or characteristics

  4. Seven Steps of Surveys • Setting objectives • Designing the study • Composing a reliable and valid instrument • Administering the survey • Preparing the data • Data analysis • Reporting the results

  5. Setting Objectives • Be specific • Questions determined by objectives • Define all imprecise or ambiguous terms • Which questions address each objective? • May be stated as: • Research questions • Null hypotheses • Research (alternative) hypotheses

  6. Where do objectives come from? • Defined needs • Literature review • Focus groups • Consensus panels

  7. Sound Choice of Population and Sampling Scheme • Define the reference population • Define the sampling scheme • Probability sample vs. nonprobability sample • Random assignment to groups • Consider likely response rate • Unsolicited surveys may be as low as 20% after 1 mailing • There are techniques to improve response rates

  8. Power and Sample Size • An underpowered trial is unlikely to demonstrate a difference and may ultimately be considered of little or no value. • Sample Size: an educated wild guess vs. a wild guess. • Generally the sample size estimate I give you will be larger than you are able to obtain.

  9. Types of Survey Instruments • Self-administered questionnaires • Mailed, emailed, or completed in person • Paper or electronic format • Interviews • Telephone, face-to-face, video-conferencing • Structured record reviews • Specially created form • Gathers data from written records (e.g. medical records, court records) • Structured observations

  10. Validity and Reliability • Validity: Does the instrument measure what you think it measures? • Reliability: If I used the instrument again would I get the same score?

  11. Some Ideas for Increasing Response Rate • Use a population that is fairly interested in the topic. • Assure anonymity • Follow up nonrespondents (Dillman’s total design or tailored design method) • Keep the survey as short and straight-forward as possible. • Provide gift or cash incentives.

  12. Survey Design • Experimental • Comparison of two or more groups (at least a treatment and a control) • Concurrent, randomly assigned • Concurrent, not randomly assigned • Self-controls • One group surveyed twice • Historical controls • Combinations (e.g. concurrent controls with pre and post measures)

  13. Survey Design • Descriptive or observational designs • Information on groups that already exist • No new groups created • Cross-sectional vs. longitudinal or time-series • Cohorts • Prospective • Provide changes in specific populations across time. • Case Controls • Retrospective • At least two groups

  14. Allocation of Units to Groups By Randomization Not by Randomization A random sample is selected from one population; units are then randomly assigned to different treatment groups. Random samples are selected from existing distinct populations. Inferences to populations can be drawn At Random Selection of Units Collections of available units from distinct groups are examined. A group of study units is found; units are then randomly assigned to treatment groups Not at Random Causal inferences can be drawn From The Statistical Sleuth

  15. Survey Plan • Objective: What is the purpose of the survey? • What is the reference population? • Sample: • How will you draw the sample? (Probability sampling vs. nonprobability sampling) • What is the appropriate sample size? • Consider the expected response rate • How will the survey be administered? • How long do you expect the survey to take? • Resources required/ privacy concerns.

  16. Contact me at any stage! • Teri Peterson • 282-4861 • Peteteri@isu.edu • Make an appointment and we can talk through any of these issues. • Office of Research: a resource for you. • http://www.isu.edu/research/

More Related