40 likes | 63 Views
Learn when to choose an interview, considerations, steps, and best practices to gather valuable insights. Understand the scope of the problem, assess respondent demographics, and address potential biases. Develop clear, unbiased questions for fruitful discussions with participants.
E N D
Interviews Alfred Kobsa University of California, Irvine
When to chose an interview • Scope of problem not fully clear, unclear what to ask • Questions abstract, possibly not well understood, open-ended • Mailing lists not available • Rapid answers not needed • Specific location needed • Recording of responses difficult • Lots of information / holistic view from a few users needed (vs. little information from many users) • Narrow geographic distribution of respondents • Anonymity not required • Topics difficult to talk about
Problems to consider • Honesty (☛ check consistency, challenge answers, discard data, blacklist potentially dishonest user) • Self-incrimination (☛ emphasize “harmlessness”, “anonymity”, impunity) • Social desirability bias (☛ phrase questions carefully, use several questions for same concept, go for facts and not habits, attitudes or intentions) • Self-image (☛ see above) • Prestige response bias (☛ go for facts)
Steps • Identify the objectives of the study (in writing) • Select the type of interview (structured, unstructured, semi-structured, contextualized, via phone vs. in person) • Decide how you will analyze the data (analysis software, statistical tests if any) • Formulate questions (mind double-barreled, double negatives, leading or loaded questions, and questions with self-image and social desirability bias) • Write questions down • Test your questions • Audiotape answers or use note-taker • Decide on awards for interviewees (if any)