170 likes | 191 Views
This article explores the use of open-ended and closed-ended questions in survey design, including the debate over including nonattitude choices. It also discusses different types of errors related to nonattitude responses and the importance of offering a nonattitude choice. The article concludes with an examination of different formats for attitude questions, including standard format, quasi-filter questions, fully-filter questions, and the concept of floater respondents.
E N D
STAT 472 Survey Design CONSTRUCTING THE QUESTIONNAIRE
Open Versus Closed Questions • Open-ended Question: asks a question to which respondents can give any answer • Closed-ended Question: both ask a question and gives the respondent fixed responses from which to choose
Nonattitude and the middle position • Survey researchers debate whether to include choices for natural, middle and nonattitudes e.g., Not Sure Don’t Know No Opinion
Two types of errors can be made • Accepting a middle choice or “ no attitude” response when respondents hold nonneutral opinion. “ Falsely Stating an opinion when one does not know”
(2) Forcing respondents to choose a position on an issue when they have no opinion on it. “ Falsely stating Don’t Know when one has an opinion”
Yet • It is usually best to offer a nonattitudechoice, because people will express opinions on fictitious issues, objects and events. By offering (middle or no opinion) choice, researchers identify those holding middle positions or those without opinion.
The issue of nonattitudes can be approached by distinguished among three kinds of attitude questions: • Standard – Format • Quasi-Filter • Fully-Filter questions
Standard-Format • The standard format question does not offer a Don’t Know choice. A respondent must volunteer it. i.e., “ The Russian leaders are basically trying to get with America.” Agree Disagree [ ] [ ]
Quasi Filter Questions • Offers respondents a Don’t Know alternative i.e., “ The Russian leaders are basically trying to get with America.” Agree Disagree No opinion [ ] [ ] [ ]
Fully-Filter Question • Is a special case of contingency question; they do not eliminate all answers to nonexistent issues, but they reduce the problem. First it asks if respondents have an opinion Then asks for the opinion those who state that they do have an opinion.
i.e., Not everyone has an opinion on this statement, if you do not have an opinion, just say so. “ The Russian leaders are basically trying to get with America.” Do you have opinion on that?[Yes] [No] If yes, do you[ Agree] [Disagree]
Floater respondents They chose a middle position when it is offer, or another alternative if it is not. Many respondents will answer a question if “No opinion” choice is missing, but they will choose “ Don’t Know” when it is offered, or say they don’t have an opinion if asked.
Recency effect • Respondents are more likely to choose the last alternative offered • The recency effect suggests that it is best to present a responses on a continuum, with the middle or natural position stated in the middle.