120 likes | 248 Views
What We Have Learned ? Research & Evaluation Presentation. Charles Smith, Stephen Baker, Neil Naftzger Leadership Institute Thursday, May 9. What does the research say about how quality afterschool programming makes a difference for youth ?
E N D
What We Have Learned?Research & Evaluation Presentation Charles Smith, Stephen Baker, Neil Naftzger Leadership InstituteThursday, May 9
What does the research say about how quality afterschool programming makes a difference for youth? • Why should we invest in evaluating the quality of afterschool programs?
Four Continuous Improvement Practices4Organization Level Setting (Plus 10 hours of TA/coaching for site managers to implement the four CI practices)
l 2012-2013 Dissemination Policy Setting 85 Networks/ Systems Organization Setting >3250 Sites >21,125 Staff Estimate based on mean of 6.5 staff per site in YPQI Study Sample Point of Service Setting >276,250 Child & Youth Estimate based on mean daily attendance of 85 youth per day in YPQI Study Sample
System Accountabilities: Higher Stakes • Higher Stakes • Accountabilities
System Accountabilities: Lower Stakes • Higher Stakes Accountabilities • Interpretive Community • Team Self Assessment • Review external scores • Team Planning and Implementing • Improvement planning • Performance coaching • Lower Stakes Accountabilities
System Supports for CI Practices Policy: Eligibility, Targeting, Low/high stakes Training, TA & Coaching Evaluation External Raters, Program Evaluation
Conclusions from Qualistar Evaluation Third, the study examined the relationships between the Q-QRIS star ratings, the individual Q-QRIS component measures that yield those ratings, and two commonly used measures of adult-child interaction. (Adult-child interaction is generally agreed to be the most important aspect of childcare quality.) The study found that the star ratings and the Q-QRIS components are generally unrelated to measures of staff -child interaction, but the lack of results may reflect the fact that these latter quality measures were collected in only one classroom per provider. Fourth, according to the logic model underlying QRISs, an improved child-care environment, characterized by more responsive caregiving and enriched content, will lead to better outcomes for children. The researchers examined relationships between the star ratings, Q-QRIS components, and child cognitive and social outcome measures. The researchers found few relationships between individual Q-QRIS components and child outcomes and virtually none between star ratings and child outcomes.
What We Have Learned?Research & Evaluation Presentation Charles Smith, charles@cypq.org Leadership InstituteThursday, May 9