Introduction to Validity

1. Introduction to Validity

2. What is Validity? • The best available approximation to the truth or falsity of a given inference, proposition, or conclusion • A set of standards by which research can be judged

3. The Causal Context Theory Observation

4. The Causal Context Theory Cause construct Observation

5. The Causal Context Theory Cause construct Observation

6. The Causal Context Theory Cause construct Effect construct cause-effect construct Observation

7. The Causal Context Theory What you think Cause construct Effect construct cause-effect construct Observation

8. The Causal Context Theory What you think Cause construct Effect construct Cause-Effect Construct Operationalize Program Observation In this study

9. The Causal Context Theory What you think Cause construct Effect construct Cause-effect Construct Operationalize Operationalize Program Observations Observation In this study

10. The Causal Context Theory What you think Cause construct Effect construct Cause-effect Construct Operationalize Operationalize Program Observations What you do What you see Observation In this study

11. The Causal Context Theory What you think Cause construct Effect construct Cause-effect Construct Operationalize Operationalize Program Observations Program-outcome Relationship What you do What you see What you test Observation In this study

12. Conclusion Validity Is there a relationship between... • What you did and what you saw? • Your program and your observations? Program Observations Program-outcome Relationship What you do What you see Observation In this study

13. Internal Validity Is the relationship causal between... • What you did and what you saw? • Your program and your observations? Alternative cause Alternative cause Program Observations Program-outcome Relationship What you do What you see Alternative cause Alternative cause Observation In this study

14. Construct Validity Theory What you think Can we generalize to the constructs? Cause construct Effect construct Cause-effect Construct Program Observations Program-outcome Relationship What you do What you see Observation

15. Program Observations Program Observations program-outcome relationship program-outcome relationship What You Do What You See What You Do What You See Observation Observation Program Observations Program Observations program-outcome relationship program-outcome relationship What You Do What You See What You Do What you see Observation Observation External Validity Theory What you think Can we generalize to other persons, places, times? Cause construct Effect construct Cause-effect Construct

16. The Validity Questions Are Cumulative...

17. The Validity Questions Are Cumulative... Is there a relationship between the cause and effect? In this study

18. The Validity Questions Are Cumulative... In this study Is the relationship causal? Is there a relationship between the cause and effect? Conclusion

19. The Validity Questions Are Cumulative... Can we generalize to the constructs? In theory Internal Is the relationship causal? Is there a relationship between the cause and effect? Conclusion

20. The Validity Questions Are Cumulative... Can we generalize to other persons, places, times? In theory Can we generalize to the constructs? Construct Internal Is the relationship causal? Is there a relationship between the cause and effect? Conclusion

21. The Validity Questions are cumulative... Validity Can we generalize to other persons, places, times? External Can we generalize to the constructs? Construct Internal Is the relationship causal? Is there a relationship between the cause and effect? Conclusion

22. Threats to Validity • There is a relationship between the cause and effect. • The relationship is causal. • You can generalize to the constructs. • You can generalize to other persons, places, and times. You Want to Make an Inference...

23. Threats to Validity How could you be wrong in the inference? • There is a relationship, but you don’t see it. • There is no relationship, but you do see one. Conclusion Validity

24. Threats to Validity How could you be wrong in the inference? • There is a causal relationship, but you don’t see it. • There is no causal relationship, but you do see one. Internal Validity

25. Threats to Validity How could you be wrong in the inference? • You can generalize to constructs, but you conclude you can’t. • You can’t generalize to constructs, but you conclude you can. Construct Validity

26. Threats to Validity How could you be wrong in the inference? • You can generalize to other contexts, but you conclude you can’t • You can’t generalize to contexts, but you conclude you can External Validity

27. Threats to Validity • How you can be wrong in making your inference • Specific factors that can bias or distort your conclusions • A list of common threats to the quality of your study • A “checklist” you can use in planning your study