1 / 30

Chapter 11

Chapter 11. Carl McDaniel, Jr. Roger Gates Slides Prepared by Bruce R. Barringer University of Central Florida. Questionnaire Design. Learning Objectives Slide 1 of 2. To learn the objectives of questionnaire design.

varen
Download Presentation

Chapter 11

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Chapter 11 Carl McDaniel, Jr. Roger Gates Slides Prepared by Bruce R. Barringer University of Central Florida Questionnaire Design

  2. Learning ObjectivesSlide 1 of 2 • To learn the objectives of questionnaire design. • To understand the role of the questionnaire in the data collection process. • To become familiar with the criteria for a good questionnaire. • To learn the process for questionnaire design.

  3. Learning ObjectivesSlide 2 of 2 • To become knowledgeable of the three basic forms of questions. • To understand the key role of the questionnaire in data collection costs. • To learn the necessary procedures for successful implementation of a survey.

  4. Questionnaire Defined A questionnaire is a set of questions designed to generate the data necessary for accomplishing the objectives of the research project.

  5. The Questionnaire’s “Position” in the Research Process Survey Objectives Respondent’s Information Questionnaire Data Analysis Findings Recommendations Managerial Action

  6. Criteria for a Good Questionnaire To design a good questionnaire, the following issues should be considered: Does it Provide the Necessary Decision-Making Information? Does it Consider the Respondent?

  7. Editing and Data Processing Requirements • Editing • Refers to going through the questionnaire to make certain the “skip patterns” are followed and required questions are filled out. • A skip pattern is the sequence in which questions are asked. • Open-Ended Questions • An open-ended question is one that does not contain prerecorded possible responses.

  8. The Questionnaire Development Process Implementation Determine Data Collection Methods Determine Question Response Format Prepare Final Copy Determine Survey Objectives and Constraints Decide Question Wording Pretest and Revise Obtain Approval from all Relevant Parties Describe Questionnaire Flow and Layout Evaluate the Questionnaire and Layout

  9. Step One: Determine Survey Objectives, Resources, and Constraints • Survey (information) objectives should be spelled out as clearly and precisely as possible. • If this step is completed in a thorough fashion, the rest of the process will follow more smoothly and efficiently.

  10. Step Two: Determine the Data Collection Method • Chapter 6 discussed the variety of ways that survey data can be gathered, such as in-person, telephone, mail, or self-administration. • Each method will have an impact on survey design.

  11. Step Three: Determine the Question Response FormatSlide 1 of 5 • Open-Ended Questions • Open-ended questions are those in which the respondent can reply in his or her own words. • Example of an open-ended question: 1. What advantages, if any, do you think ordering from a mail order catalog company offers compared with local retail outlets?

  12. Step Three: Determine the Question Response FormatSlide 2 of 5 • Closed-Ended Questions • A closed-ended question is one that requires the respondent to make a selection from a list of options. • The primary advantage of closed-ended questions is simply the avoidance of many of the problems (such as subjectivity) of open-ended questions.

  13. Step Three: Determine the Question Response FormatSlide 3 of 5 • Dichotomous Questions • This simplest form of a closed-ended question is the dichotomous choice. • Example of a dichotomous question: 1. Would you rather live in a small town or a city? A. Small Town 1 B. City 2

  14. Step Three: Determine the Question Response FormatSlide 4 of 5 • Multiple-Choice Questions • Multiple-Choice Questions permit the respondent to select from several alternatives. • Example of a multiple-choice question: 1. Who do you think will win the World Series? A. New York Yankees B. St. Louis Cardinals C. Los Angeles Dodgers D. Atlanta Braves

  15. Step Three: Determine the Question Response FormatSlide 5 of 5 • Scaled-Response Questions • Question format that permits the measurement of the “intensity” of a respondents’ answers. • Example of a scaled-response question: 1. Now that you have read a sample of the Wall Street Journal, would you say that you would…(Check one) Definitely buy it Probably buy it Might or might not buy it Probably will not buy it Definitely will not buy it

  16. Step Four: Decide the Question Wording • Four Guidelines in Selecting Wording • The wording must be clear. • Select words so as to avoid biasing the respondent. • Consider the ability of the respondent to answer the question. • Consider the willingness of the respondent to answer the question.

  17. Step Five: Establish Questionnaire Flow and Layout • After the questions have been properly formulated, the next step is to sequence them and develop a layout for the questionnaire. • The general guidelines concerning questionnaire flow are included in the next slide.

  18. How a Questionnaire Should be Organized Use the screener questions to identify qualified respondents After obtaining a qualified respondent, begin with a question that obtains a respondent’s interest Ask general questions first Ask questions that require “work” in the middle of the questionnaire Insert “prompters” at strategic points Position sensitive, threatening, and demographic questions as the end

  19. Step Six: Evaluate the QuestionnaireSlide 1 of 2 • Issues to Consider in Reviewing the Design of the Questionnaire • The issues to consider in reviewing the design of the questionnaire are shown on the next slide:

  20. Step Six: Evaluate the QuestionnaireSlide 2 of 2 Is the Question Necessary? Is the Questionnaire Too Long? Will the Questions Provide the Desired Information to Accomplish the Research Objectives? Appearances of Mail and Self-Administered Questionnaires Avoid a Cluttered Look Allow Plenty of Space for Open-Ended Responses Consider Color-Coding the Questionnaires Instructions Printed Within The Questionnaire Should be in Capital Letters

  21. Step Seven: Obtain Approval of AllRelevant Parties • At this point in the questionnaire design process, the first draft of the questionnaire has been completed. • Approval for going forward with the questionnaire is the objective of this step.

  22. Step Eight: Pretest and Revise • When final managerial approval has been obtained, the questionnaire must be pretested. • The primary purpose of a pretest is to make certain that the questionnaire gives the respondent clear, understandable questions that will evoke clear, understandable responses.

  23. Step Nine: Prepare Final Copy • Even the final copy phase does not allow the researcher to relax. • Precise typing instructions, spacing, numbering, and precoding must be set up, monitored, and proofread.

  24. Step Ten: Implementing the SurveySlide 1 of 3 • Supervisor’s Instructions • Inform them of the nature of the study, start and completion dates, quotas, reporting times, equipment and facility requirements, sampling instructions, number of interviewers required, and validation procedures. • Interviewer’s Instructions • Cover many of the same points as supervisor’s instructions but are geared to the actual interview.

  25. Step Ten: Implementing the SurveySlide 2 of 3 • Call Record Sheets • Interviewers’ logs listing the number and results of a contact. • Call record sheets are used to measure the efficiency of the interviewers. • Visual Aids and Other Supplements • Many studies use visual aids to facilitate the interviewing process.

  26. Step Ten: Implementing the SurveySlide 3 of 3 • Field Management Companies • Field management companies such as Qfact, On-Line Communications, and Direct Resource generally provide questionnaire formatting, screener writing, development of instructional and peripheral materials, shipping departments, field auditing, and all coordination of data collection, coding, and tab services required for the project.

  27. Questionnaire Challenges The Difficulty of Finding a Qualified Respondent in a Central Location Telephone Interview 1. Failed Attempts - Busy - No Answer - Answering Machine - Business Number - Phone/Language Problem - Discontinued Line 2. Cooperation Problems - Respondent Not at Home - Refused to be Interviewed

  28. Questionnaire Challenges The Difficulty of Finding a Qualified Respondent in a Central Location Telephone Interview 3. Screener Determines Respondent Not Eligible - Failed security test (works for marketing research firm, advertising agency, or the client) - Doesn’t use the product - Demographic disqualification (wrong gender, age, etc.) - Quota filled (survey has quota of 500 users of Tide and 500 users of other clothing washing powder. Interviewer already has 500 Tide users; the current respondent uses Tide. 4. Respondent Terminates During Interview 5. Completed interview

  29. Summary of Key PointsSlide 1 of 2 • This chapter examines the objectives of the questionnaire, as well as its construction, evaluation, and impact on project costs and profitability. • The criteria for a good questionnaire fall into the following topic area: (1) achieving the goals of the study; (2) fitting the questionnaire to the respondent; and (3) editing, coding, and data processing.

  30. Summary of Key PointsSlide 2 of 2 • The process of developing a questionnaire is discussed. The process contains 10 sequential steps. • The chapter concludes with a discussion of the role of the questionnaire in survey research costs.

More Related