540 likes | 2.18k Views
Steps in Scale Development (DeVellis, 2003). Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to clarity. Steps in Scale Development (DeVellis, 2003)
E N D
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Specificity as an aid to clarity.
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct?
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example • 2. Generate an item pool.
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example • 2. Generate an item pool. • 3. Determine the format for measurement.
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example • 2. Generate an item pool. • 3. Determine the format for measurement. • 4. Have item pool reviewed.
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example • 2. Generate an item pool. • 3. Determine the format for measurement. • 4. Have item pool reviewed. • 5. Consider inclusion of validation items.
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example • 2. Generate an item pool. • 3. Determine the format for measurement. • 4. Have item pool reviewed. • 5. Consider inclusion of validation items. • 6. Administer items to pilot sample.
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example • 2. Generate an item pool. • 3. Determine the format for measurement. • 4. Have item pool reviewed. • 5. Consider inclusion of validation items. • 6. Administer items to pilot sample. • 7. Evaluate items.
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example • 2. Generate an item pool. • 3. Determine the format for measurement. • 4. Have item pool reviewed. • 5. Consider inclusion of validation items. • 6. Administer items to pilot sample. • 7. Evaluate items. • 8. Produce final scale.
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example • 2. Generate an item pool. • 3. Determine the format for measurement. • 4. Have item pool reviewed. • 5. Consider inclusion of validation items. • 6. Administer items to pilot sample. • 7. Evaluate items. • 8. Produce final scale.
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example • 2. Generate an item pool. • 3. Determine the format for measurement. • 4. Have item pool reviewed. • 5. Consider inclusion of validation items. • 6. Administer items to pilot sample.
Administer items to pilot sample. • For focus group
Administer items to pilot sample. • For focus group • Pretest sample should resemble study sample. • Sample size 3 to 9 • Discuss questions with respondents to find confusion or ambiguity. • Refine answer options. • Time how long it takes.
Administer items to pilot sample. • For pilot study
Administer items to pilot sample. • For pilot study • Pretest sample should resemble study sample. • n>20 • Study descriptive statistics of items. • Refine answer options. • Time how long it takes. Test reliability. • Revise scale based on reliability information • Examine variance among respondents.
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example • 2. Generate an item pool. • 3. Determine the format for measurement. • 4. Have item pool reviewed. • 5. Consider inclusion of validation items. • 6. Administer items to pilot sample. • 7. Evaluate items. • 8. Produce final scale.
Steps in Scale Development (DeVellis, 2003) • Determine clearly what it is you want to measure. • Theory as an aid to clarity. • Measuring “elusive phenomena that cannot be directly observed”. • Specificity as an aid to clarity. • Do you wish to measure a broad, general construct or a context-specific construct? • Locus of control example • 2. Generate an item pool. • 3. Determine the format for measurement. • 4. Have item pool reviewed. • 5. Consider inclusion of validation items. • 6. Administer items to pilot sample. • 7. Evaluate items. • 8. Produce final scale.
Locus of control example Internal-External Scale (Rotter, 1966) Generalized, Broad, One dimension Locus of Control
Locus of control example Internal-External Scale (Rotter, 1966) Generalized, Broad, One dimension Locus of Control Multidimensional Scale (Levinson, 1973) Generalized,Three dimensions One’s Self Powerful Others Luck or Chance
Locus of control example Internal-External Scale (Rotter, 1966) Generalized, Broad, One dimension Locus of Control Multidimensional Scale (Levinson, 1973) Generalized,Three dimensions One’s Self Powerful Others Luck or Chance Multidimensional Scale (Wallston, Wallston & DeVellis, 1978) Health,Three dimensions One’s Self Powerful Others Luck or Chance Health Health Health