100 likes | 187 Views
Program monitoring & tracking: Research design issues. Presented by: Dr. Kimberly Kempf-Leonard School of Social Sciences University of Texas at Dallas kleonard@utdallas.edu. Performance Measurement Training. Purposes Quality Control Tracking of Subjects Measuring Variables.
E N D
Program monitoring & tracking: Research design issues Presented by: Dr. Kimberly Kempf-Leonard School of Social Sciences University of Texas at Dallas kleonard@utdallas.edu Performance Measurement Training
Purposes • Quality Control • Tracking of Subjects • Measuring Variables
Why are we doing this? • Monitoring & Assessment • Improve our juvenile justice system Convince other systems they can benefit from what we’ve done Describe… Explain… Evaluate… Predict…
Quality Control of Output & Outcome measures • Add a time dimension to data collection longitudinal data (6-12 months follow-up) • Precise measures • Reliable measures • Valid measures • Generalizable measures
Time-related problems with Subjects • “Creaming” • Attrition or “Mortality” • Solution: assure sample represents total • Know characteristics of those missing
Clear, relevant variables • Consistency in measurement both times • Representative subjects • Same subjects • sample chosen same way both times • Explain any attrition • Simple data collection instrument
What types of data are collected in longitudinal designs? • All types! • Surveys (trends: multiple “waves” of cross-sectional designs) • Participant observation • Archival records • Experiments • Content analysis • Secondary data & primary data from a “follow-up”