150 likes | 178 Views
External Validity. The External Validity Question. Theory. What you think. Cause construct. Effect construct. Cause-effect construct. Program. Observations. Program. Observations. Program-outcome relationship. Program-outcome relationship. What you do. What you see.
E N D
The External Validity Question Theory What you think Cause construct Effect construct Cause-effect construct
Program Observations Program Observations Program-outcome relationship Program-outcome relationship What you do What you see What you do What you see Observation Observation Program Observations Program Observations program-outcome relationship Program-outcome relationship What you do What you see What you do What you see Observation Observation The External Validity Question Theory Can we generalize to other persons, places, OR times? Cause construct Effect construct Cause-effect construct
How Do We Generalize?Model I: Sampling Specified persons, places, and times Population
How Do We Generalize?Model I: Sampling Population Draw sample Sample Draw sample
How Do We Generalize?Model I: Sampling GeneraLize back Generalize back Population Sample
How Do We Generalize?Model II: Proximal Similarity Our Study
How Do We Generalize?Model II: Proximal Similarity Settings Our Study Times People Places
How Do We Generalize?Model II: Proximal Similarity Less similar Settings Our Study Less similar Less similar Times People Places Less similar
How Do We Generalize?Model II: Proximal Similarity Less similar Settings Our Study Less similar Less similar Times People Places Gradients of similarity Less similar
Threats to External Validity Maybe it is just these people. Maybe it is just these places. Maybe it is just these times. Interaction of selection and treatment Interaction of setting and treatment Interaction of history and treatment
Population Sample How Can We Improve External Validity? Random sampling
Population Sample Our Study Places Times People How Can We Improve External Validity? Random sampling Replicate, Replicate, Replicate
Population Sample Our Study Places Times People settings Our Study times people places How Can We Improve External Validity? Random Sampling Replicate, Replicate, Replicate Use theory