What’s wrong with that question?

1. How to design good questions to get good data What’s wrong with that question?

2. Types of Questions • Structured and fixed response. -questions that offer the respondent a closed set of responses from which to choose. -make data collection and analysis much simpler and they take less time to answer. -best suited in the following situations: (1) when you have a thorough understanding of the responses so that you can appropriately develop the answer choices (2) when you are not trying to capture new ideas or thoughts from the respondent.

3. Types of Questions 2. Non-structured and open. -questions where there is no list of answer choices from which to choose. Respondents are simply asked to write their response to a question. -best when you are exploring new ideas and you don't really know what to expect from the respondents. In some situations, you may have a partial list of answer choices, but you may still have some doubt or uncertainty about other possible responses. You can create a partially structured question by adding “other”

4. Good structured questions • Do you have a driver's license?( ) Yes( ) No

5. Good structured questions • How many hours a day do you spend doing homework?( ) 0 to 1 hour( ) 2 to 3 hours( ) 4 to 5 hours( ) more than 5 hours

6. Good structured questions • Which subject do you enjoy the most at school?( ) Math( ) Science( ) English( ) Foreign Language( ) History( ) Government( ) Art / Music( ) Other

7. Good questions • Cover all possible responses • Don’t make a forced choice • Have answers that are unique (no confusion over two being correct but only being able to select one) • Add “don’t know” or “not applicable” if these may be possibilities • Answers are consistent so one does not jump out at the reader

8. Rating, ranking and multiple choice • Rating questions (odd number of choices) • None, little, satisfactory, very, most • Ranking • Allows the reader to number off choices • Multiple choice (only one answer, forces a choice or check all that apply)

9. Non-structured • Ask and give the space to answer. You will get a response based on how each reader interprets the question. Be clear. • Harder to analyze. • E.g. What do you like best about the Famous Scientists Program?___________________________________________________________________________________________________________________________

10. Poor questions • Which subject do you enjoy the most at school?( ) Math( ) Science( ) English( ) Foreign Language( ) History( ) Government( ) Art / Music( ) Football Practice( ) Other

11. Poor questions

12. Poor question • How have teachers and students at your school respondedto the new 45-minute lunch period?( ) Satisfied( ) Unsatisfied

13. Double barreled – two questions at once • Maybe teachers are satisfied, but students are not. • Break into 2 different questions

14. Poor question • Do you think that the new cafeteria lunch menu offers a better varietyof healthy foods than the old one?( ) Yes( ) No( ) No Opinion

15. Leading question • Wording tends to make the easy choice to agree that the new cafeteria lunch is healthier. • Ask in a neutral way: • How do you feel about the new cafeteria lunch menu compared to the old one?( ) The new menu offers a better variety of healthy foods( ) The old menu offers a better variety of healthy foods( ) The selections are similar( ) No opinion

16. So remember: • Clearly state the intentions of your research at the beginning • Ask only for demographic or personal info you will need. • Give instructions where necessary (you must answer all questions; check all that apply; check the boxes below) • Go from general to specific • Go from least sensitive to most sensitive • Avoid stereotypes and bias • Check for spelling and grammar • Test your survey before using it. Try it with a few others to identify problems.