Research Methods for the Social Sciences: Research Design Part II

1. Research Methods for the Social Sciences:Research Design Part II Tuesday, February 02, 2010 Data Collection & Procedures Division on Addictions, Cambridge Health Alliance Harvard Medical School

2. Class Objectives • Review: • Sampling • Qualitative vs. Quantitative • Data collection procedures • Your research ideas

3. Sampling • Selecting a group of people from a larger population. • Why? • Size • Time • $$$ • Sampling error • Sampling bias

4. Types of samples • Nonprobability • Convenience • Quota • Purposive or judgmental • Snowball

5. Types of samples • Probability • Simple random • Select at random using random number generator • Same chance • Systematic • 1,000/100 = 10th

6. Types of samples • Stratified • Divide population into strata • Sample = population on a specific characteristic • E.g., AGE

7. Cluster

8. Examples of sampling • Special populations • College students -> Other populations • Treatment Seekers -> Everyone with a specific problem

10. Who’s collecting the data? • Secondary • Data collected by others • E.g., Researchers, government • Strengths: • Save time & money • Weaknesses: • No control over study design or data collection

11. Who’s collecting the data? • Primary • Data you collect on your own • Collaborations • Strengths • You control study design, sampling, data collection • Weakness • Time &”Money

12. Sample size • Power analysis • Sample size n = ??? • Ability to measure effects

13. Qualitative Quantitative Case Study Interactive Interview Experimental Naturalistic Observation Correlation Survey What kind of data are you collection Written Description

14. What type of data are you collecting? • Qualitative • Systematic but nonuniform • Field work or participant observation • Natural observation • Case study • Interactive interviews • Written descriptions by participants • Open-ended • Record everything

15. Natural Observation • Narrative record • Video/audio recordings • Sampling • Time • Event • Situation • After you will categorize and code data for analysis

16. Case Study • Review: Biographical data; Medical records; Family history; Observations; Interviews; Psychological tests • Look for variables that might help explain behavior your are studying.

17. Interactive Interview/focus group • Similar to natural observation • Interact • Ask specific questions and lead discussion • Data collection methods similar to natural observation

18. Written description • Journal • Long narrative • Open-ended survey responses

19. Coding • Simple coding: Counting the number of behaviors in a recording • More complex coding: Categorization

20. Qualitative • Content Analysis of open ended responses • Missouri Self-excluders • Question: Why did you self-exclude? • “Because my wife made me.” • “I was sick of worrying about finances.” • New computer programs can categorize for you.

21. Qualitative Quantitative Case Study Interactive Interview Experimental Naturalistic Observation Correlation Survey What kind of data are you collection Written Description

22. What type of data are you collecting? • Quantitative • You are attempting to measure how large an effect is. • Experimental • Correlations • Survey • Two types of data collection • Self-report of behavior • Actual behavior

23. Modes of Data Collection:Self-report • Questionnaires/ Surveys • Pen and paper • in person • mailed • Internet-based survey • Random digit dialing

24. Modes of Data Collection:Self-report • Interviews • Computer Assisted Personal Interviewing (CAPI) • Telephone interviews • Face to face or personal interviews • Focus groups

25. Computer Assisted Telephone Interview

26. Surveying Behavior • Strengths • Specific and quantifiable • Replicable • Larger sample size compared to qual. • Generalizable • Limitations • Self-report • Allows biases

27. Modes of Data Collection: Observing Behavior • Implicit Association Test • Computer program • Categorize objects • Faster = stronger association • Computers and Internet • Allow us to observe actual Internet gambling behavior • Could also be used for online shopping behavior • What else?

28. Example of IAT

29. When will you collect your data • Longitudinal • Multiple data points • Cross-sectional • One data point

30. When is it too much? • Only collect data you will use • Time = Compensation • Time = Work • Every 10 minutes = 7% drop in RR (McCarty et al. 2006)

31. Response Rates • As the response rate • Greater likelihood results will represent the total population (i.e., generalizability) • The higher the response rate, the more accurate the survey.

32. Response Rates • Striving to achieve the highest rate you can • Low rates, might affect your ability to generalize to the population as a whole • At least 70%

33. Recap • Each methodology and data collection method has strengths and weaknesses • Consider using a combination • Focus group to test survey questions • Journal to help recall and periodic surveys • Close ended and open ended questions

34. Recap cont • Research design, Sampling, and Data collection • trade off b/w your hypotheses, variables, and reality. • Balance: time; money; and effort

35. Primary Sources • Thames Valley University Disseration Guide: http://brent.tvu.ac.uk/dissguide/hm1u3/hm1u3fra.htm • Research Methods in Social Relations