Chapter

1. Chapter 14 Data Collection in the Field, Response Error, and Questionnaire Screening

2. Nonsampling Error in Marketing Research • Nonsampling error includes • All types of nonresponse error • Data gathering errors • Data handling errors • Data analysis errors • Interpretation errors

3. Nonsampling Errors

4. Possible Errors in Field Data Collection • Field worker error: errors committed by the persons who administer the questionnaires • Respondent error: errors committed on the part of the respondent

5. Possible Errors in Field Data Collection Field-Worker Errors Intentional • Intentional field worker error: errors committed by the persons when a data collection person willfully violates the data collection requirements set forth by the researcher • Interviewer cheating:occurs when the interviewer intentionally misrepresents respondents • Leading respondents: occurs when interviewer influences respondent’s answers through wording, voice inflection, or body language

6. Possible Errors in Field Data Collection Field-Worker Errors Unintentional • Unintentional field worker error: errors committed when an interviewer believes he or she is performing correctly • Interviewer personal characteristics:occurs because of the interviewer’s personal characteristics such as accent, sex, and demeanor • Interviewer misunderstanding:occurs when the interviewer believes he or she knows how to administer a survey but instead does it incorrectly • Fatigue-related mistakes: occur when interviewer becomes tired

7. Possible Errors in Field Data Collection Respondent Errors Intentional • Intentional respondent error: errors committed when there are respondents that willfully misrepresent themselves in surveys • Falsehoods:occur when respondents fail to tell the truth in surveys • Nonresponse:occurs when the prospective respondents fails to take part in or to answer specific questions on the survey

8. Possible Errors in Field Data Collection Respondent Errors Unintentional • Unintentional respondent error: errors committed when a respondent gives a response that is not valid but that he or she believes is the truth

9. Possible Errors in Field Data Collection Respondent Errors Unintentional…cont. • Respondent misunderstanding:occurs when a respondent gives an answer without comprehending the question and/or the accompanying instructions • Guessing:occurs when a respondent gives an answer when he or she is uncertain of its accuracy • Attention loss: occurs when a respondent’s interest in the survey wanes • Distractions: (such as interruptions) may occur while questionnaire administration takes place • Fatigue: occurs when a respondent becomes tired of participating in a survey

10. How to Control Data Collection Errors Types of Errors Control Mechanisms • Intentional Field Worker Errors • Cheating Supervision • Leading respondent Validation • Unintentional Field Worker Errors • Interviewer Characteristics Selection and training of interviewers • Misunderstandings Orientation sessions and role playing • Fatigue Require breaks and alternate surveys } {

11. How to Control Data Collection Errors…cont. Types of Errors Control Mechanisms Intentional Respondent Errors Assuring anonymity and confidentiality Falsehoods Incentives Validation checks Third person technique Assuring anonymity and confidentiality Nonresponse Incentives Third person technique { {

12. How to Control Data Collection Errors…cont. Types of Errors Control Mechanisms Unintentional Respondent Errors Well-drafted questionnaire Misunderstandings Direct Questions Well-drafted questionnaire Guessing Response options (e.g., “unsure”) Attention loss Reversal of scale endpoints Distractions Fatigue Prompters { { } {

13. Data Collection Errors with Online Surveys • Multiple submissions by the same respondent • Bogus respondents and/or responses • Misrepresentation of the population

14. Nonresponse Error • Nonresponse: failure on the part of a prospective respondent to take part in a survey or to answer specific questions on the survey • Refusals to participate in survey • Break-offs during the interview • Refusals to answer certain questions (item omissions) • Completed interview must be defined.

15. Nonresponse Error…cont. • Response rate: enumerates the percentage of the total sample with which the interviews were completed • Refusals to participate in survey • Break-offs during the interview • Refusals to answer certain questions (item omissions)

16. Nonresponse Error…cont. • CASRO response rate formula:

17. Reducing Nonresponse Error • Mail surveys: • Advance notification • Monetary incentives • Follow-up mailings • Telephone surveys: • Callback attempts

18. Preliminary Questionnaire Screening • Unsystematic and systematic checks of completed questionnaires • What to look for in questionnaire inspection : • Incomplete questionnaires • Nonresponses to specific questions (item omissions) • Yea- or nay-saying patterns • Middle-of-the-road patterns

19. Unreliable Responses • Unreliable responses are found when conducting questionnaire screening, and an inconsistent or unreliable respondent may need to be eliminated from the sample.