Types of Methodologies

1. Types of Methodologies Surveys Part 2

2. Process • Determine the objectives • Delimit the sample • Construct the questionnaire • Conduct the pilot study • Establish the distribution process • Analyze the data

3. 4. Conduct the Pilot Study • 1st pilot – colleagues, peers • 2nd pilot – participants who are part of the intended population • What are we looking for?

4. 4. Conduct the Pilot Study • Look for: • Questions that lack discrimination (answered the same by all) • Unexpected responses • May be poorly worded • Questions people don’t respond to • Instructions • Length of the survey • How easy/difficult it is to analyze

5. Self-administered surveys Mail Group administration Internet E-mail Interviews Telephone Interview Personal Interview Group Interview Types of Surveys

6. Response Rate by Method • 1. Web & mail • 2. Web • 3. E-mail • 4. Mail

7. Mailed/Internet Survey Process • 1. Advanced letter/e-mail • 2. Survey • 3. Reminder card/message • 4. Final reminder card/message or end survey

9. Survey Structure & Analysis • Each question structure implies a “scale of measurement” • Likert, semantic differential, etc. • Scales guide statistical analysis

10. Scales of Measurement • Nominal Scales • Ordinal Scales • Interval Scales • Ratio Scales

11. SOM- Nominal • Lowest level of measurement • Words & not # values….not a rating • Each value defines a distinct category • Needs to be coded for Excel/SPSS • Example….. • _____ (1) Male _____ (2) Female

12. SOM - Nominal Data • Other examples 2. What was your favorite activity? (pick one) ___ Golf ___ Soccer ___Baseball ___ Golf (1) ___ Soccer(2) ___Baseball (3) 3. Have you attended this program previously? ___Yes ___No • Unordered close-ended

13. SOM- Ordinal • Implied rank or order • Each category has a position higher than the previous • Distance between categories isn’t equal • Ie. 1st, 2nd and 3rd place • Example • AP Basketball poll

14. SOM - Ordinal

15. SOM - Interval • Ordered categories have meaningful size differences or distance between values • Distance between intervals is equal • Does not have a determined zero point • Distance makes sense, ratios don’t

16. SOM - Interval • Calendar year • 2011 ---365 days ---2012 ----365 days ---2013 • Outdoor temperature • Thermometer – degree increments are equal • Is 0° as cold as it gets? • 100 degrees isn’t twice as hot as 50 • Meaningful size differences and equal distances (unlike ordinal) • Likert scales…

17. SOM - Interval • Likert scales • Some believe ordinal • Categorical with order • Others believe interval • Ordered categories have meaningful size differences • What is the difference between strongly agree, and agree….and is that difference the same as the difference between agree and neutral?

18. SOM - Interval • Likert scales • Argument for interval • If there is symmetry in the responses • SA/A/N/D/SD • E/G/F/P – not symmetrical, uneven distances between categories

19. SOM - Ratio • Has a true zero point • Makes ratios possible • Has ordering & distancing properties of interval • Weight • 100 lbs. Is twice as heavy as 50 lbs. • Reaction time • Distance traveled: _____

20. What is your current age? • Under 18 • 19-22 • 23-26 • 27 or older Scale of measurement? Why? Would you rephrase the question? Why? How we ask the question may limit us

21. To summarize • Scales of measurement have range from the least precise to the most precise • Nominal Ordinal Interval Ratio

22. Why do we care? • Determines what statistics are possible • Nominal is most limiting ; yes/no questions • 56% enjoyed the show, 44% did not • Why change YES/NO questions to Likert? • Degree of interest/opinions/attitudes • With ordinal, interval, and ratio we can compute averages and measure variability

23. Developing a Codebook • Before entering data into computer • Instructions on converting data • Details how to define & label each variable • Assign #’s (codes) to responses • List every variable…including the ID #

24. 2. What is your current grad school sequence? ______ Athletic Training ______ Biomechanics ______ Exercise Physiology ______ Physical Education Teacher Education ______ Psychology of Sport & Physical Activity ______ Recreation Administration ______ Sport management

25. Developing a Codebook

26. Developing a Codebook • Variable Name • Use something you recognize & link to the question • Sales staff • Gender • Level of satisfaction or level of agreement is likely not appropriate. SPECIFIC ENOUGH to identify.

27. Developing a Codebook

28. Developing a Codebook • Values • 1=strongly agree • 2=agree • 3=disagree • 4=strongly disagree • Values • 1=yes • 2=no • 1=male • 2=female

29. Developing a Codebook

30. Other info….more challenging • “All that apply” question • Rank questions • Open ended questions

31. If this were the question?1. How did you hear about this program? (check all that apply) ___Flyer ___Pantagraph ___ Word of mouth ___Brochure ___Radio ___Other (specify):______

32. Treat each option as a yes or no question (either checked/unchecked)?

33. If this were the question?3. Rank each of the activities in order of preference (1=favorite, 3=least favorite) _____Bingo _____Yahtzee _____Twister

35. Not to be confused with…. • What is the difference?

36. If this were the question?3. Indicate your overall level of enjoyment at this event by circle the number….. No Enjoyment Enjoyed Whatsoever 1 2 3 4 5 6 A Great deal

37. Semantic differentials example No Enjoyment Enjoyed Whatsoever 1 2 3 4 5 6 A Great deal