Effects of mode and mood on self-report by college students

1. Effects of mode and mood on self-report by college students Rebecca L. Rosen, New School for Social Research Michael F. Schober, New School for Social Research Frederick G. Conrad, University of Michigan 2009 ITSEW, Tällberg, Sweden

2. Mode differences in answering sensitive questions • Rs answer sensitive questions differently when they are interviewer administered vs. self-administered • General finding: in more anonymous and confidential modes • more reports of “undesirable” and sensitive behaviors • fewer reports of “desirable” behaviors

3. Mechanisms are not yet fully understood • What is embarrassing or interpersonally challenging may vary in predictable ways across • different subpopulations • cultural styles/norms of interaction • individual style of interacting What we are examining: • mood states of respondents

4. A potentially relevant mood state: Depression • Depressed people: • experience interpersonal dysfunction (Brim, et al.,1982) • feel discomfort in interactions (Brugha et al., 1982) • are socially unskilled with strangers (Gotlib & Robinson, 1982) • withdraw from others (Rippere, 1980) • feel shame (Hobletzelle, 1987) • have low self esteem (DSM-IV-TR, 1996) • This affects all interpersonal interaction

5. Possible effects • Being with an interviewer may be particularly embarrassing for depressed people • OR Presence of interviewer could temper extreme negative self-appraisal (reality check) Both predict greater mode differences for depressed Rs than for non-depressed Rs for Qs they might find embarrassing

6. Reliable mode differences: more reporting when more anonymous/confidential • Drug use (e.g., Aquilino, 1994) • Sex partners (e.g., Tourangeau & Smith, 1996) • Alcohol use (e.g., Aquilino, 1994) • Smoking (e.g., Brittingham, Tourangeau & Kay, 1998) • Personal distress (e.g., Epstein, Barker & Kroutil, 2001; Moum, 1998

7. Study • Compare answers to neutral, sensitive and personal distress Qs FTF and in CASI • In a population that is • likely to experience notable rates of depression • likely to engage in measurable amounts of stigmatized behavior

8. Strategy • Relatively small lab sample • But believed large enough to replicate reliable large-sample mode differences • Full control over mode of administration • All interviews conducted in same room • Same female FTF interviewer wearing same clothes • Anonymity and confidentiality of data made evident • College student-age population • Known to have highest rates of personal distress • Highest rates of stigmatized behaviors likely to be relevant

9. Design: two arbitrarily assigned groups • 87 FTF (CAI) interviews • Same female I for all • I asks Qs aloud • enters Rs spoken responses on laptop • 87 CASI interviews • R reads Q on desktop screen • Enters answers by typing or clicking

10. 37 survey Qs • 9 neutral Qs • from National Survey of Student Engagement, 2007 • 18 sensitive behavioral Qs • from 7 large scale surveys, including • Behavior Risk Factor Surveillance System, 2007 • National Survey of Drug Use and Health, 2006 • National Survey of Family Growth, 2003 • 10 personal distress Qs • Patient-Health Questionnaire-8 • Used in slightly modified form in BRFSS (2006) • Used in clinical practice • Generalized Anxiety Disorder-2

11. Post-interview measures • Paper and pencil self-administered, in different room: • Beck Depression Inventory-II • Beck Anxiety Inventory • Marlowe-Crowne X-2 Social Desirability Scale FTF and CASI groups did not differ on any

12. Respondents • 174 undergraduate college students, balanced across FTF and CASI for • Age (Mean age 20, range 18-24) • Gender (half F, half M) • Year in college (1/4 in each year) • Race/ethnicity (almost balanced) • 45% white, 17% Black or African-American (non-Hispanic), 16% Asian, 8% Hispanic or Latino, 6% multiracial, 7% other • 91% from New York area schools • Rs paid $15 for 1hr

13. Depression Level • Depression level assessed after the interview • Rs not selected or assigned to mode based on depression level • Almost equal numbers of depressed and non-depressed in each mode • 113 total non-depressed, 61 depressed • Depressed = any BDI-II score above 13

14. Mode effects • Sample large enough to detect reliable mode effects - 1/3 of Qs • Replicates larger-sample findings that Rs report more sensitive/stigmatized behaviors in CASI than FTF

15. How many times in the past 4 weeks have you masturbated on your own?

16. Mode and mood: Across items • 9 neutral Qs: no reliable effects • 12 numerical-response sensitive Qs: • Mode effect for depressed Rs (more reports CASI) • No mode effect for non-depressed Rs • Significant interaction by MANOVA • 10 personal distress Qs: • Mode effect for depressed Rs (more reports CASI) • No mode effect for non-depressed Rs • Significant interaction by MANOVA

17. Sensitive example 1:During the past 30 days, on how many days did you use marijuana or hashish?

18. Sensitive example 2:On the days that you drank during the past 30 days, how may drinks did you usually have each day?

19. Personal distress example:Over the last 2 weeks, how often have you been bothered by feeling bad about yourself – or that you are a failure or have let yourself or your family down? Response options 0 = not at all 3 = nearly very day

20. Summary • In general, depressed college student Rs • reported more sensitive behaviors and more personal distress in CASI than FTF • Non-depressed college student Rs either • Reported equally FTF and in CASI • OR reported more sensitive behaviors and personal distress FTF • Effects are not because of gender (despite greater female reporting of depression): • effects are even stronger with gender covaried out

21. Why? Could be: • Fear of negative evaluation by others • can cause people to hide, not want to be “seen” • E.g., Tangney Wagner & Gramzow, 1992; Lewis, 1987 • shame linked with depression • e.g. Hobletzelle, 1987; Tangney, et al., 1992 • Depressed Rs: Shame might cause less reporting FTF • Non-depressed: Less shame, natural variation in what Rs might find embarrassing; or see behavior/experience as “just me”

22. Humanness of “interviewer”? • Humanness of “interviewer” (human or computer) may be important • Partially human interfaces (recorded voices, video interviewers, animated agents) may activate different interpersonal schemas

23. Need more nuanced theories of mechanisms for mode effects Mode effects may be moderated by • Interpersonal dynamics • Nature of what is being asked about • Behaviors vs. subjective experience • Why people think they’re answering • e.g., help-seeking vs. survey responding • Mood states and variations other than demographic

24. Acknowledgments • NSF grant SES-0551294 (Methodology, Measurement, and Statistics program) • Laura Hahn Lind • Michelle Levine • Shawn Mason • Deb Schwartz • Josh Rosen • Courtney Kellner • Stefanie Fail • Shireen Rizvi • Ali Khadivi