Question Development

1. Question Development

2. Steps in the Measurement Process • The researcher must determine which level is appropriate for the data that will contribute to management decisions • Nominal, ordinal, interval, ratio? • Open-ended or closed-ended?

3. Nominal Level Questions • Appropriate for categorizing responses • Useful when the main purpose is to describe patterns among the sample (descriptive statistics) • Dichotomous • Multiple choice • Checklist

4. Example of Nominal Level Questions • Will you apply for a summer internship? • Yes • No • For which position do you intend to apply? (check one) • Account Management • Creative • Research • Media • Other

5. Considerations for Writing Nominal Level Questions • Alternatives should be exhaustive • Options should avoid response bias • Response alternatives should be appropriate [typical] for the behavior, attitude in question

6. Nominal Level Considerations • When you apply for an internship in advertising, for which area will you apply? (bias) • Are you bothered by the fact that advertising professionals don’t get paid as much as their business counterparts? (bias)

7. Ordinal Level Questions • Appropriate when the order of responses is important • Presents respondents with a series of options and asks for an evaluation relative to other options in the series

8. Ordinal Level Question Example • Rank the following advertising positions in order of your career interest. (specify one rank per position) • Account Management • Creative • Research • Media • Other

9. Considerations for Ordinal Level Questions • Instructions must be explicit

10. Interval Level Questions • Appropriate for gauging opinions/attiudes to an explicit, well-defined question are needed • Rating scale • Frame of reference • Non comparative • Comparative • Graphic Itemized

11. Interval Level Examples – Frame of Reference Evaluate the advertising profession in terms of how much “fun” you perceive it to be (non-comparative) Vs. Relative to other marketing professions, how “fun” do you perceive the advertising profession to be? (comparative)

12. Specific Types of Interval Rating Scales • Semantic differential • bipolar adjective anchors • Stapel scale • semantic differential simplied

13. Interval Rating Scales • Likert scale • agreement/disagreement scales To what extent do you agree or disagree with the idea that advertising as a profession is more “fun” than other marketing professionals? • Strongly agree • Agree • Neither agree nor disagree • Disagree • Strongly disagree

14. Considerations for Writing Interval Level Questions • Lead in questions to the alternatives should be unbiased • Scales should be constructed (visually/verbally) so that there are equal intervals between points

15. Considerations for Writing Interval Level Questions • Correspondence between info requested and response items • 5 to 10 response categories • Decision must be made about scale balance

16. Ratio Level Questions • Appropriate when degree of behavior, attitude OR relative weight is important • Constant sum scale • Generally dividing sums of 10 or 100

17. Ratio Level Questions • The following cities are known hubs for the advertising industry. Allocate 1000 between the cities based on your likelihood of applying for jobs in those markets. (Make sure your results total 1000) • Atlanta • Chicago • New York • San Francisco • Dallas

18. Nominal Categorizes labeled data Ordinal Rank orders data without specifying magnitude of distance Specify gender Indicate yes or no Check all that apply Rank from most important to least important Summary of Measurement Levels

19. Interval  Rank order with comparable magnitude between choices assumed equal Ratio  N,O, I characteristics with verifiable, absolute distances between choices Indicate your level of agreement Allocate a bonus of $10,000 between you and your team members Summary of Measurement Levels

20. Question Development Forms • Closed-ended • Pre-defined response categories • Open-ended • Encourages free response