1 / 37

QUESTIONNAIRE DESIGN

QUESTIONNAIRE DESIGN. QUALITIES OF A GOOD QUESTIONNAIRE. Should be client-friendly : It should capture the information required to meet the study tasks in as accurate a form as possible Should be respondent-friendly : It should be easy to answer

ovid
Download Presentation

QUESTIONNAIRE DESIGN

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. QUESTIONNAIRE DESIGN

  2. QUALITIES OF A GOOD QUESTIONNAIRE • Should be client-friendly: It should capture the information required to meet the study tasks in as accurate a form as possible • Should be respondent-friendly: It should be easy to answer It should not capture info that is not needed since fatigue is a very real factor pulling down quality • Should be interviewer-friendly • Should be analysis-friendly

  3. SCREENING QUESTIONNAIRES, RQS, LISTING QUESTIONNAIRES • Screening and RQs are just aimed at finding whether a particular respondent is eligible or not. • Listing questionnaires are used when penetration is being estimated, and sampling is correspondingly that much better controlled. • The difference between screening and RQ is just whether the main interview is happening later or right away

  4. KINDS OF QUESTIONS

  5. THREE KINDS OF QUESTIONS • Behaviour questions • Opinion questions • Classification questions

  6. BEHAVIOUR QUESTIONS • Record facts, not opinions • Can generally be assumed to be accurate Important exceptions are: - when memory is stretched too far “the last 20 times you ate / drank anything other than at regular meals, what did you eat / drink?” - when the subject is sensitive e.g. money, personal habits, etc.

  7. BEHAVIOUR QUESTIONS…Contd. Examples • Have you ever….? • Do you ever….? • When did you last…? • Which do you do most often….? • Who does it….? • How many…? • In what way do you do it…?

  8. OPINION QUESTIONS • Not such an easy area • Attitude measurement has spawned a lot of literature and conflicting views • Addressed more in section “Scaling” • Examples: - What do you think of….? - Why do you….? - Do you agree or disagree….? - How do you rate…? - Which is the best (or worst) for….?

  9. CLASSIFICATION QUESTIONS • Help to understand market in terms of demographic segments • Examples are: • Monthly household income • Monthly household expenses • Occupation • education • No. of children at home • SEC • etc.

  10. INTERVIEWER FRIENDLY

  11. SOME PRINCIPLES….. • Plenty of space for recording answers to open - ended questions • Plenty of space for recording translations for those responses • Clear flow instructions (GOTO…, CONTINUE, ASK ALL, ASK ONLY IF….OTHERWISE) • Whenever there is a “SHOW CARD…” question, print the card option on the questionnaire. This will enable checking later if there is a doubt about the way the question has been administered.

  12. SOME PRINCIPLES…..(Contd.) • The questionnaire brief note is a crucial aid to quality fieldwork. The purpose is to explain the way a question is to be ahead, the way probing is to be done, the way responses are to be recorded. For example, • Q Statements Brands • 1 2 3 4 5 • 1 • 2 • 3 • 4 • 5 Associations OR Ratings on 5-pt scale • …finish one statement for all the brands, and then move on to the next statement.

  13. ANALYSIS - FRIENDLY

  14. SOME PRINCIPLES (Discuss…) • Example: TOM Spont Aided • 1(1) 1(2) 1(3) • 2(1) 2(2) 2(3) 3(1) 3(2) 3(3)

  15. ANALYSIS - FRIENDLY

  16. KNOWLEDGE OF RESPONDENT • Is an issue when doing B2B research (does any one person know all about the decision), children’s product research (does the mother answer on behalf of the child) • Is also an issue when doing customer satisfaction research. Different people within the respondent organisation / household can answer about different aspects - purchase process, product in use, service.

  17. ORDER OF QUESTIONS • Clearly falls more into the ‘art’ part than the ‘science’ part, but there are some general principles that are proven to work. • By and large, classification questions, unless required for screening purposes, towards the end of the questionnaire. • It is a good idea to start with easy and straight forward questions, go on to more difficult questions, and then finish with easy questions • This means that we normally start with awareness questions, go on to behaviour questions such as products and brands used, bought, etc., then go on to opinion questions such as rating of brands, and finish with classification questions and media habits.

  18. WORDING AND TYPE OF QUESTIONS • It is a rule-of-thumb that the very factual questions should be short, while the questions that require opinion answers tend to get better answers if the wording is not very abrupt. This explains why you will often see brand rating questions having a rather long introduction. The longer wording serves to explain and to make the questions less threatening.

  19. WORDING AND TYPE OF QUESTIONS…Contd. • Avoid ambiguous words such as ‘frequently’. What is frequent to X may be infrequent to Y. • Avoid double-barreled statements (e.g.) “The economy is down and the PM is not doing enough to help”. If this is subjected to an agree/disagree question, and the respondent disagrees with the first and agrees with the second part of the question, then he will not know how to answer • Be specific (e.g.) It is better to ask “Have you traveled by air in the past one year”than “have you traveled by air in the last year” • Avoid jargon: this brand is meant for the ‘discerning consumer’. Hardly anyone knows what that means.

  20. WORDING AND TYPE OF QUESTIONS…Contd. • Avoid slang and colloquialism: They may not be valid throughout the country or across all SEC classes. • Avoid Bias: What actually is this? • Anything that leads the respondent towards one option i.e., anything that interferes with the respondent’s freedom to choose the option on • his / her own. • Example: • Would you agree that brand X is very good? ….. NO • What would you say about brand X?

  21. WORDING AND TYPE OF QUESTIONS…Contd. • Very good : 1 • Quite good : 2 • Neither good nor bad : 3 • Quite bad : 4 • Very bad : 5 • Try and avoid negatively worded questions. They confuse the respondent.

  22. WORDING AND TYPE OF QUESTIONS…Contd. • For most classifications questions, use the standard wording. Always write the wording for the classification question. The list of standard wordings that can be readily used is given below. • Standard wording • - HW • - CWE • - SEC • - MHI • The housewife is the person in the household who is incharge of all purchases for the kitchen • The chief wage earner is the person who contributes the maximum money towards the household expenses

  23. TRANSLATION • Try and think in Hindi/Bengali/Malayalam/Tamil etc • Try this exercise: Get the exact equivalent in the local language of…. • - premium brand • - discerning consumer • - brand preference • - ad gives a you a warm feeling • - cool brand of jeans • Always check questionnaire translation

  24. TRANSLATION • Be sensitive to the fact that field sometimes uses vernacular words even for those English words that are commonly understood e.g. technology, computer etc. • Try and get a back translation for each questionnaire

  25. OPEN-ENDED VS CLOSE-ENDED • The real problem with open-ended questions is that we do not get high quality probing • Probing needs to be of two kinds: further and deeper • Example: • Q : How likely are you to purchase this brand ? • 5 point scale • Q : TO THOSE WITH NEGATIVE INTENTION : • Why do you say that you won’t buy this brand ?

  26. OPEN-ENDED VS CLOSE-ENDED….Contd. R1 : Because I am not interested R2 : Because I do not like feature A R3 : Depends on price R1 Probe R2 Probe R3 Probe ------------ ------------- ---------- Why are you not Is there any other Build into question interested ? reason ? Assuming the price is acceptable to you, or is going to be Rs.X.

  27. PILOTING • Always pilot test the questionnaire • Pilots should be done with specified target group • An interviewer should do the pilot • The researcher should sit through the pilot • What should the pilot check? • - does the respondent understand the questions? • - are the instructions clear to the interviewer? • - are the recording formats convenient and efficient? • - how long is the interview taking? • - options for close ended questions

  28. SCALING

  29. KINDS OF SCALES • Nominal Non metric • Ordinal • Interval Metric • Ratio

  30. KINDS OF SCALES…..Contd. • Nominal : Mode • Ordinal : Median, Mode • Interval : Mean, Median, Mode • Ratio : Mean, Median, Mode

  31. KINDS OF SCALES…..Contd. • Nominal The scale points simply identify the response e.g., Male : 1 Mumbai : 1 Female : 2 Chennai : 2 Delhi : 3 • Ordinal The scale points indicate rank-ordering e.g., Freshers : 1 Sophomore : 2 Final years : 3 No indication on amount of difference

  32. KINDS OF SCALES…..Contd. • Interval The scale points tell us how far apart the responses are: e.g., temperature scale - Celsius, Farenheit The difference between scale points are equal • Ratio Internal scale + absolute zero e.g., Kelvin scale of temperature Heights Weights Quantity consumed etc

  33. SCALES NORMALLY USED • Verbal rating scales • Ranking scales • Agree-Disagree scales • Association scales • Numerical rating scales - Marks out of 10 - Points from 1 to 10 These are useful in comparative product test research. They are to be avoided in monadic measurement studies.

  34. VERBAL RATING SCALES • Examples are 1. How satisfied are you with X? Totally dissatisfied 1 Substantially dissatisfied 2 Somewhat dissatisfied 3 Neither satisfied nor dissatisfied 4 Somewhat satisfied 5 Substantially satisfied 6 Totally satisfied 7 2. How likely are you to buy ABC? Definitely will not buy 1 Probably will not buy 2 May or may not buy 3 Probably will buy 4 Definitely will buy 5

  35. VERBAL RATING SCALES….Contd. 3. How would you rate the strength of the fragrance of this perfume? Much too strong for my liking 1 Somewhat too strong for my liking 2 Just right 3 Somewhat too weak for my liking 4 Much too weak for my liking 5 4. What would you say about the taste of this biscuit? Excellent 1 Very good 2 Quite good 3 Fair 4 Bad 5 Very bad 6

  36. VERBAL RATING SCALES….Contd. 5. Which statement on this card best describes your opinion about statement? Disagree strongly 1 Disagree somewhat 2 Neither agree nor disagree 3 Somewhat agree 4 Strongly agree 5 • Note that we generally start with the negative point in the scale. This is because of a belief that respondents are less likely to feel compelled to be polite. • Also note that all the scales are balanced except for scale no. 4. The reason for scale 4 not being balanced is the belief that respondents tend to give positive - sounding answers even if they don’t really feel positive about the brand (This is perhaps an Indian phenomenon)

  37. VERBAL RATING SCALES….Contd. Having more positive points than negative in the scale can compensate for this by forcing the respondents to choose a lower positive when they want to be polite.

More Related