Pattern Matching for Construct Validity

1. Pattern Matching for Construct Validity

2. The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches

3. The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task

4. The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task Theoretical pattern

5. The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task Theoretical pattern - Observations - Data - Measures

6. The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches Conceptualization task Theoretical pattern Data Organization - Observations - Data - Measures - Observations - Data - Measures

7. The Pattern-Matching Model - Theories - Ideas - Hunches Conceptualization task Theoretical pattern Observed Pattern Data Organization - Observations - Data - Measures - Observations - Data - Measures

8. The Pattern-Matching Model - Theories - Ideas - Hunches Conceptualization task Theoretical pattern Pattern matching Observed Pattern Data Organization - Observations - Data - Measures - Observations - Data - Measures - Observations - Data - Measures

9. The Pattern-Matching Model - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Theoretical pattern Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures

10. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Theoretical pattern Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures

11. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures

12. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures

13. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observational Realm Data Organization - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?

14. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observational Realm Data Organization Data Analysis - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?

15. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Observed Pattern Observed Pattern Observational Realm Data Organization Data Analysis - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?

16. A Pattern-Matching Example - Arithmetic - Geometry - Reading - Theories - Ideas - Hunches Theoretical Realm Conceptualization task Concept mapping Theoretical pattern Concept Map Pattern matching Pattern match r Observed Pattern Observed Pattern Observational Realm Data Organization Data Analysis - Observations - Data - Measures - Arithmetic? - Geometry? - Reading?

17. A Pattern-Matching Example Theoretical realm Spelling Arithmetic Test questions Algebra Geometry Reading Observational realm

18. A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Geometry Reading Closer if more similar Observational realm

19. A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Farther if less similar (low distance means more similar) Geometry Reading Observational realm

20. Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Farther if less similar (low distance means more similar) Geometry Reading Observational realm

21. Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Spelling Arithmetic Algebra Farther if less similar (low distance means more similar) Geometry Reading High interitem correlation means more similar. Observational realm

22. Spelling Arithmetic Algebra Geometry Reading A Pattern-Matching Example Theoretical realm Observational realm

23. Spelling Arithmetic Algebra Geometry Reading A Pattern-Matching Example Theoretical realm Observational realm

24. Spelling Arithmetic Algebra Geometry Reading A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Observational realm

25. Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Observational realm

26. Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Observational realm

27. Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Matrix of inter-item correlations Observational realm

28. Spelling Arithmetic Algebra Geometry Reading Rating Sheet 1 Manage time effectively 2 Manage resources effectively. 3 Scan a multitude of information and decide what is important. 1 2 3 4 5 4 Decide how to manage multiple tasks. 5 Organize the work when directions are not specific. 1 2 3 4 5 1 2 3 4 5 3 Scan a multitude of information and decide what is important. 1 Manage time effectively 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 A Patter- Matching Example Theoretical realm Matrix of inter-point distances Pattern match r Matrix of inter-item correlations Observational realm

29. A Pattern-Matching Example Theoretical realm Matrix of inter-point distances Pattern match r Matrix of inter-item correlations Observational realm

30. A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Pattern Match r Matrix of inter-item correlations Observational realm

31. A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Pattern Match r Matrix of inter-item correlations Items Correlation 1,2 .92 1,3 .89 ... ... n,n-1 .03 Observational realm

32. A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Pattern Match r r = -.93 Matrix of inter-item correlations Items Correlation 1,2 .92 1,3 .89 ... ... n,n-1 .03 Observational realm

33. A Pattern-Matching Example Theoretical realm Pair Distance 1,2 .342 1,3 .457 ... ... n,n-1 3.241 Matrix of inter-point distances Estimate of construct validity Pattern match r r = -.93 Matrix of inter-item correlations Items Correlation 1,2 .92 1,3 .89 ... ... n,n-1 .03 Observational realm

34. Why Does Pattern Matching Work? • Theoretical pattern is like a fingerprint -- more detail is better, if you can match it to reality. • If you find a match to a detailed theoretical pattern, it provides evidence for your theory. • The more detail, the less likely there are alternative explanations (threats) to construct validity.

35. Disadvantages of Pattern Matching • Requires a detailed conceptual framework • Requires that theoretical and observed patterns are structured the same

36. Advantages of Pattern Matching • More general and flexible than MTMM • Yields an overall estimate of construct validity • Requires you to specify what you think about the constructs • Treats convergence and discrimination as a continuum