The Age of Accountability

1. The Age of Accountability 2009 PAT Coordinator’s Meeting Janet Newton, Education Program Consultant Kansas State Department of Education PAT Vision: All children will learn, grow and develop to realize their full potential.

2. Overview • Using Data to Drive Decisions • Getting at Outcomes – Changes for 2009-10 • Using Annual Program Report Data • To illustrate • To analyze • Continuous Quality Improvement: Data - APR Methodology PAT Vision: All children will learn, grow and develop to realize their full potential.

3. Using data to drive decisions – BENEFITS • Factual • Measure change to determine impact on the outcome – “turning the curve” • Demonstrate the effectiveness of the program – Accountability – telling the story PAT Vision: All children will learn, grow and develop to realize their full potential.

4. Getting At outcomes – Change is in the air! • To measure child outcomes over time • PAT children will be incorporated into the KIDS Database System – connecting with K-12 in 2009-10 • Ethnicity and Race must be collected as required by the Federal Government • Enroll children using legal first and last names PAT Vision: All children will learn, grow and develop to realize their full potential.

5. Getting At outcomes: • To measure change on parenting skills – Survey of Parenting Practices – all KSDE funded PAT programs implementing in 2009-10 for families exiting the program • Defining “exiting” – measuring change over time • Comments about methodology • Tabulating local data • RAW data will be collected by KSDE from programs via Survey Monkey – same way raw data was collected on the Parent Satisfaction Survey. PAT Vision: All children will learn, grow and develop to realize their full potential.

6. Using Annual Program Report Data • To illustrate • To analyze PAT Vision: All children will learn, grow and develop to realize their full potential.

7. Looking & Presenting data in multiple ways - • In 2008-09, Kansas PAT programs served 19,314 children. • In 2007-08, Kansas PAT programs served 19,504 children. • In 2006-07, Kansas PAT programs served 18,256 children. • In 2005-06, Kansas PAT programs served 18,824 children. • In 2004-05, Kansas PAT programs served 17,328 children. PAT Vision: All children will learn, grow and develop to realize their full potential.

8. PAT Vision: All children will learn, grow and develop to realize their full potential.

9. In relation to National Data - National Data from the Parents As Teachers National Center. PAT Vision: All children will learn, grow and develop to realize their full potential.

10. In relation to funding - PAT Vision: All children will learn, grow and develop to realize their full potential.

11. State and Local Funding PAT Vision: All children will learn, grow and develop to realize their full potential.

12. State and Local Funding in relation to number of children served PAT Vision: All children will learn, grow and develop to realize their full potential.

13. Number of Children Served with Number of Families Served - trend PAT Vision: All children will learn, grow and develop to realize their full potential.

14. Number of Families in Relation to Total State and Local Funding PAT Vision: All children will learn, grow and develop to realize their full potential.

15. In relation to total eligible population • In 2008-09, PAT served only 15% of the eligible population Prenatal to Age 3. • Total of 3 years Live Births to determine all eligible children; KDHE, Office of Vital Statistics PAT Vision: All children will learn, grow and develop to realize their full potential.

16. So How Well Were Families & Children Served? • Goal: Provide early detection of developmental delays and health issues. • Outcome: Children who participate in PAT receive developmental screening and have delays identified early. • This chart does not reflect outcome data; this chart reflects output data. PAT Vision: All children will learn, grow and develop to realize their full potential.

17. This chart reflects the outcome of the screenings – children identified and referred. PAT Vision: All children will learn, grow and develop to realize their full potential.

18. Goal: Provide early detection of developmental delays and health issues. • Outcome: Children who participate in PAT receive developmental screening and have delays identified early. PAT Vision: All children will learn, grow and develop to realize their full potential.

19. So…are our numbers of children identified good? Too high? Too low? – The Good, the Bad and The Ugly! • Using National Trend Data to answer the question. National Data from the Parents As Teachers National Center. PAT Vision: All children will learn, grow and develop to realize their full potential.

20. Goal: Provide early detection of developmental delays and health issues. • Children who participate in Parents As Teachers are Healthier Looks good at 90% plus but is that good in comparison to the general population? PAT Vision: All children will learn, grow and develop to realize their full potential.

21. Goal: Provide early detection of developmental delays and health issues. • Children who participate in Parents As Teachers are Healthier Kansas Immunization Data obtained from Kansas Kids Count; Kansas Action for Children. PAT Vision: All children will learn, grow and develop to realize their full potential.

22. Using APR data for PROGRAM ANALYSIS - National Data from the Parents As Teachers National Center. PAT Vision: All children will learn, grow and develop to realize their full potential.

23. Same data – different chart type PAT Vision: All children will learn, grow and develop to realize their full potential.

24. Same Data – and another look - National Data from the Parents As Teachers National Center. PAT Vision: All children will learn, grow and develop to realize their full potential.

25. Looking at trend data - % of parents that followed up a referral from screening for evaluation National Data from the Parents As Teachers National Center. PAT Vision: All children will learn, grow and develop to realize their full potential.

26. National Data from the Parents As Teachers National Center. PAT Vision: All children will learn, grow and develop to realize their full potential.

27. Looking at participation of teen parents in PAT National Data from the Parents As Teachers National Center. PAT Vision: All children will learn, grow and develop to realize their full potential.

28. Comparing Teen Parent Participation with the % of Teen Pregnancies Kansas Teen Pregnancy Data & Number of Live Birth data; KDHE; Office of Vital Statistics PAT Vision: All children will learn, grow and develop to realize their full potential.

29. APR Data – to be helpful in decision making data must be - • Reliable - consistency of your measurement, or the degree to which an instrument measures the same way each time it is used under the same condition with the same subjects. In short, it is the repeatability of your measurement. • Valid -strength of our conclusions, inferences or propositions. In short, were we right? Is there a connection between A and B? Did change A cause outcome B? PAT Vision: All children will learn, grow and develop to realize their full potential.

30. Data = Continuous Quality Improvement • Review of the Annual Program Reports submitted to PAT National Center – checked for: • Incomplete Data Fields • Totals that did not match but should match – • Section II – Number of children in questions 1 – total prenatal to five served with at least 1 BTL personal visit, 2 total by age prenatal to five served with at least 1 BTL personal visit, and 3 ethnicity and race prenatal to five served with at least 1 BTL personal visit should all be the same. • Section II, question 4 number of families with at least 1 BTL personal visit and Section III, question 3, number families receiving ranges of BTL personal visits should be the same. • Data that raised questions • Number of children eligible for screening exceeded the total number of children served • Number of children referred for further evaluation exceeded the number identified with possible concerns. PAT Vision: All children will learn, grow and develop to realize their full potential.

31. SMALL GROUP WORK – APR METHODOLOTY • PROPOSE SOLUTIONS FROM YOUR QUESTIONS • COME TO CONSENSUS • BE RESPECTFUL THAT NOT ALL PROGRAMS HAVE THE SAME DATA SYSTEM CAPACITY PAT Vision: All children will learn, grow and develop to realize their full potential.

32. Small Group Work – Annual Program Report methodology • GROUPING 1:  Service Delivery - Children and Family Count Pages 1, 2 and ADDITIONAL DATA QUESTIONS 16 and 17 • GROUPING 2:  Service Delivery - Families Characteristics Pages 3 through 9 and ADDITIONAL DATA QUESTIONS 16 and 17 • GROUPING 3:  Personal Visits Page 10,Resource Network and Retention page 14 and 15 and ADDITIONAL DATA QUESTIONS 16 and 17 • GROUPING 4:  Screening pages 11 through 13, AND ADDITIONAL DATA QUESTIONS 16 and 17 PAT Vision: All children will learn, grow and develop to realize their full potential.

33. For more information, contact: Janet Newton, Education Program Consultant Parents As Teachers Kansas State Department of Education 120 SE 10th Ave Topeka, KS 66612 jnewton@ksde.org PAT Vision: All children will learn, grow and develop to realize their full potential.