Download
1 / 61
610 likes | 849 Views
Conducting Rigorous Local Level Surveys. Oregon Prevention Summit Sunriver, Oregon November 6 & 7, 2013. Winnie Rose. Truly Evangeline. Introduction. Divide into Groups. Why are you here?.
E N D
Conducting Rigorous Local Level Surveys Oregon Prevention Summit Sunriver, Oregon November 6 & 7, 2013
Winnie Rose Truly Evangeline
Introduction Divide into Groups Why are you here?
Workshop GoalsTo learn the necessary concepts and skills to conduct quality local surveysTo create useful products that can be used to conduct a local survey
Agenda: Wednesday Afternoon Developing Your Survey • Introductions, Questions & Answers • Presentation: Writing Quality Survey Questions • Exercise: Practice Writing Questions • Break • Presentation: Creating Your Survey • Product: Developing Your Survey • Wrap up, Questions & Answers
Why Avoid These Questions? • Which political party in Burundi do you believe should control the government? • Do you never not smoke cigarettes? • Do you enjoy shooting rifles and handguns? • How often is it okay to kick puppies? • Would you vote for Rodney Wambeam if you knew he ate baby seals for breakfast every morning?
Two Types of Questions Ordered Response Categories Unordered Response Categories 1. Do you approve or disapprove of the way the president is handling his job? _____ approve _____ disapprove 2. How safe is the community where you live? _____ very safe _____ somewhat safe _____ somewhat unsafe _____ very unsafe 3. Do you own or rent your home? _____ own _____ rent 4. Of the six subject areas listed below, which was your favorite when you were in high school? _____ math _____ science _____ art _____ English _____ physical education _____ history
Do not! Offer an Other Option Mark All that Apply 5. What is your favorite fruit _____ strawberry _____ banana _____ apple _____ peach _____ grapes Other ______________________ 6. Which of the following fruit do you like to eat? Mark all that apply. _____ strawberry _____ banana _____ apple _____ peach _____ grapes _____ blackberry _____ plum _____ pineapple _____ pear _____ watermelon
Include Appropriate Demographics Like What?
Example Rating Scale Question 7. To what extent do you favor or oppose the local food cooperative expanding its services to non-members? _____ strongly favor _____ favor _____ neither favor nor oppose _____ oppose _____ strongly oppose
Example Yes or No Question 8. If the local food cooperative no longer required a membership to buy food, would you shop there for groceries? _____ yes _____ no
Example Preference Question 9. Which one type of alternative foodstuff would you most prefer to buy at the local food cooperative? _____ fruits and vegetables _____ dairy _____ bakery _____ meat and seafood _____ frozen _____ packaged
Creating an Index Drink beer, wine, or hard liquor? _____ very wrong _____ wrong _____ a little bit wrong _____ not wrong at all Smoke cigarettes? _____ very wrong _____ wrong _____ a little bit wrong _____ not wrong at all 10. How wrong do you think it is for someone your age to … Use LSD, cocaine, amphetamines, or another illegal drug? _____ very wrong _____ wrong _____ a little bit wrong _____ not wrong at all Use chewing tobacco? _____ very wrong _____ wrong _____ a little bit wrong _____ not wrong at all Smoke marijuana? _____ very wrong _____ wrong _____ a little bit wrong _____ not wrong at all
Question Order • Introduction and directions • Most interesting questions • Most threatening questions • Demographics • Consider “skip” patterns and questions
Agenda: Thursday Morning Selecting Your Survey Sample and Methodology • Welcome Back, Questions & Answers • Presentation: Selecting a Sample • Exercise: Creating a Random Sample in Microsoft Excel • Product: Choosing Your Survey Sample • Break • Presentation: Selecting a Methodology • Product: Creating a Survey Plan • Wrap up, Questions & Answers
Two Important Concepts Sample Population Sampling Frame The group of people to whom you want to generalize your results For example: All undergraduate students at Portland State University The list of your Sample Population from which you will draw your sample For example: the email addresses of all undergraduate students at Portland State University
Three Sample Types Convenience Census Random
Census Sample Sample Population Sampling Frame Sample (all PSU undergrads) (all PSU undergrad emails) (all PSU undergrads) Survey everyone you want to draw conclusions about
Random Sample Random Selection of individuals from the Sampling Frame Sample (500 PSU undergrads) (Randomly selected from all PSU undergrad emails) Everyone in the Sampling Frame has an equal probability of being chosen
Margin of Error It is the absolute size of the sample rather than the ratio of sample size to population size that most affects the sampling error
Convenience Sample Whomever you can get to take the survey Sample (PSU undergrads walking through the student union) (PSU undergrads in the student union who stopped at your table to take a survey) You can only generalize to the specific individuals who Completed the survey
Completion Rate Sample Size x Completion Rate = Number of Completed Surveys • At best expect a 25% to 50% completion rate
Four Ways to Reach People In Person Phone Mail Internet
Lower the Burden • Choose a method with a sampling frame • Self addressed stamped envelopes • Reminders and second surveys • Email • Online survey systems like “survey monkey” • Paper and pencil vs. tablets
Agenda: Thursday Afternoon Entering and Analyzing Your Survey Data • Nearly Done, Questions & Answers • Presentation: Building a Data Set • Product: Creating a Coding Scheme • Break • Presentation: Analyzing Survey Data • Exercise: Creating Frequency Distributions, Percentages, and Measures of Central Tendency • Wrap up, Questions & Answers
Entering Data Survey Data Set
Preparing the Data Set Cleaning Data Transforming Data
