Other Measurement Validity Types

1. Other Measurement Validity Types

2. Overview • Face validity • Content validity • Criterion-related validity • Predictive validity • Concurrent validity • Construct validity • Convergent validity • Discriminant validity

3. Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 Face Validity • The measure seems valid “on its face”. • A judgment call. • Probably the weakest form of measurement validity.

4. Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 Content Validity Content domain • Check the measure against the relevant content domain. • Also a judgment call. • Can make this relatively rigorous with a systematic check.

5. Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 Criterion-Related Validity Content domain • Check the measure against a relevant criterion. Test

6. Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 Criterion-Related Validity Content domain • Check the measure against a relevant criterion. • The standard is empirical. Test Criterion

7. Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 Predictive Validity • A type of criterion-related validity Test

8. Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 Predictive Validity • A type of criterion-related validity • Look at measure’s ability to predict something it should be able to predict Test Criterion

9. Concurrent Validity • A type of criterion-related validity

10. Concurrent Validity • A type of criterion-related validity, • Does the measure distinguish between groups that it should distinguish between?

11. Concurrent Validity • A type of criterion-related validity • Does the measure distinguish between groups that it should distinguish between? • Example: a measure of empowerment should show higher scores for managers and lower scores for their workers.

12. Relationships Among Validity Types • Almost all can be considered a sub-case of construct validity. • Construct validity is the most encompassing and comprehensive standard.