1 / 20

Analysing Open-ended Survey Question Responses in CAQDAS

Analysing Open-ended Survey Question Responses in CAQDAS. Graham Hughes NCRM QUIC Node - University of Surrey Research Methods Festival - 6th July 2010 n.hughes@surrey.ac.uk. Data collection methods and OEQ data quality. Interview Type. Life History Interview. Survey Interview.

ruby-phelps
Download Presentation

Analysing Open-ended Survey Question Responses in CAQDAS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Analysing Open-ended Survey Question Responses in CAQDAS Graham Hughes NCRM QUIC Node - University of Surrey Research Methods Festival - 6th July 2010 n.hughes@surrey.ac.uk

  2. Data collection methods and OEQ data quality Interview Type Life History Interview Survey Interview Flexibility to Respondent Self-completion Face to Face Data Collection Recorded & transcribed Interviewer mediation Questionnaire Design OEQs grouped at start OEQs spread around

  3. Data used in these examples • Professional survey of flooding experiences • Households in England • Events in 2000 • 1,250 respondents • Face to Face using CAPI • Mainly closed questions, but 8 OEQs • Interviewers typed responses in real time

  4. Who might be asked to analyse it? • Quantitative survey analyst: • Because you are analysing the rest of the data • Qualitative research analyst: • Because it’s qualitative and that’s what you do • Online research analyst: • Because it is easier to phrase open ended questions

  5. Why use CAQDAS? • ATLAS.ti, Nvivo, MAXqda, QDA Miner • Speed • Accuracy • Transparency • Replicable • Tools designed for the task

  6. Four main phases of work • Data preparation & introduction to CAQDAS • Development & application of themes (coding) • Exploration of relationships between codes, respondent attributes, and the texts • Export of selected coding data to SPSS for further analysis (“Quantitising”)

  7. Nvivo Main Screen

  8. MAXqda Main Screen

  9. Developing Themes • A range of possibilities from fully manual to fully automatic • Range of data quantities and qualities should be considered • Our own prejudices and preconceptions hold us back • Inductive approach based on the data

  10. Nvivo – Word Frequency Tag Cloud

  11. MAXqda – Word Frequency Table

  12. QDA Miner/Wordstat – Phrase Finder

  13. Coding in MAXqda

  14. Reporting and Checking Codes • “X% of respondents mentioned Y” • Reference coding - (“signposts”) • Substitution coding – (“exact”) • So, check for errors • Code definition • Incorrect use • Omissions

  15. But also, look for difference. • Make rarity a virtue! • “My personal experience was being told my family had been evacuated when they had not and not being allowed access to my own road when my family were trapped inside” (R:12284 – male, aged 35/44, working full time, house was flooded) – response to a question about better ways to warn people.

  16. MAXqda – Attributes Table

  17. Crosstabs in MAXqda

  18. Nvivo – Matrix Coding Query

  19. QDA Miner – Coding by Variable

  20. Data collection methods and CAQDAS programs Interview Type Life History Interview Survey Interview Flexibility to Respondent Self-completion Face to Face Data Collection Recorded & transcribed Interviewer mediation Online survey Questionnaire Design OEQs grouped at start OEQs spread around

More Related