1 / 16

Surveys CSSA 506

Surveys CSSA 506. Erin Biddlecombe Amanda Rodino Miranda Smith Brian Stroup. Description of Survey Methods. Surveys are useful when: Searching for a percentage of a particular population that carries a particular attribute or opinion and this info is not available by extant data.

amelie
Download Presentation

Surveys CSSA 506

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SurveysCSSA 506 Erin Biddlecombe Amanda Rodino Miranda Smith Brian Stroup

  2. Description of Survey Methods • Surveys are useful when: • Searching for a percentage of a particular population that carries a particular attribute or opinion and this info is not available by extant data. • Collecting data on phenomena that cannot be directly observed: attitudes, values, beliefs, and past behaviours.

  3. Description of Survey Methods (cont) • Step One: Decide on a survey type • Needs-assessment survey: seek public attitudes on community problems & feasible solutions. • Marketing survey: understand the demand for particular products or services • Evaluation survey: study the impact of public/private programs/policies.

  4. Description of Survey Methods (cont) • Step two: choose a survey delivery method: • Telephone • In-person • Online • Snail Mail • …and survey “duration”: • Cross-sectional: gather info on a population @ a particular time • Longitudinal: gather info on a population over a period of time

  5. Description of Survey Methods (cont) • Step Three: Create your sample population • Does it need to be random? Or not? • Random/probability sampling • Non-random/non-probability sampling • Sample size (size does matter!) • Statistical recommendations of sample size • Increased confidence rate

  6. Description of Survey Methods (cont) • Step Four: design questions CAREFULLY! • Make items clear • Questions should not influence response to subsequent questions • Consider respondent’s frame of reference • Questions should be relevant • Short items are best • Avoid biased items and terms • Avoid negative items

  7. Description of Survey Methods (cont) • Step Five: Administer the survey and hope to have high response rates! • May want to do a pre-test • What factors can contribute to response rates? (Other than luck!)

  8. Analysis of Survey Data • Compilation • Hand-tabulation vs. computer software • Editing • Cleaning questionnaires • Coding • Assigning numbers to all responses • Statistical Analysis

  9. Descriptive Statistics Measures of Central Tendency Measures of Spread or Dispersion Measures of Relative Position Measures of Relationships *See Table 4.2 (p. 99) in Upcraft and Schuh Inferential Statistics Statistical Significance Bivariate Analysis Multivariate Analysis *See Table 4.3 (p. 102) and Table 4.4 (p.104) in Upcraft and Schuh Analysis of Survey Data (continued)

  10. Evaluation of Survey Rigor “At their very best, surveys can produce close estimates of what people think or do.” (Salant & Dillman, 1994, p. 13)

  11. Coverage Error Sampling frame doesn’t include all elements of population we seek to study Minimize by… Carefully choosing how you compile or choose sampling frames! Finding allies to help you access comprehensive & current sampling frames Sampling Error Only a subset of population surveyed, therefore results will not be completely accurate Inevitable unless you’re doing a survey Minimize by… Increasing sample size Evaluation of Survey RigorTypes of Survey Error

  12. Measurement Error Inaccurate/imprecise responses given Caused by survey method, questions, interviewer, or respondent Minimize by… Carefully choosing structure/scaling of questionnaire Withhold bias in interviews Make questions clear & straightforward Nonresponse Errors More than a small number of sample did not complete survey, AND Nonrespondents differ from respondents in a way that pertains to study focus Minimize by… Aiming for highest response rate possible Reminder mailings/calls Monetary incentive? Convey professionalism Evaluation of Survey RigorTypes of Survey Error (continued)

  13. Limitations Time intensive Results difficult to interpret Hard to pursue areas not predetermined when conducting survey Information is self-reported Evidence about learning is indirect Benefits Scientific way to interview sample instead of whole population Good way to gather data on attitudes and opinions of students Flexibility in reaching many target groups Information can be collected fairly easily Limitations and Benefits of Surveying

  14. Typical Uses of Surveys • Questionnaires or structured interviews • Survey of students and alumni common • Survey for: • Experiences • Values, Attitudes and Expectations • Satisfaction with Experiences and Services

  15. Bibliography and Supplemental Resources

  16. Questions?

More Related