310 likes | 435 Views
Looking for Patterns in Child Outcome Data – Examples from NYS. New York State Department of Health Bureau of Early Intervention. New York’s Child & Family Outcomes System. New York’s Early Intervention Program (NYSEIP) is one of the largest in the nation
E N D
Looking for Patterns in Child Outcome Data – Examples from NYS New York State Department of Health Bureau of Early Intervention
New York’s Child & Family Outcomes System • New York’s Early Intervention Program (NYSEIP) is one of the largest in the nation • Provides services to nearly 75,000 children and families each year • 58 local programs administered by 57 county government agencies and New York City • Given size and scope of the NYSEIP, a sampling approach has been implemented for collection of child and family outcome data Measuring Child & Family Outcomes
New York’s Child & Family Outcomes System • Child outcomes data are collected using the COSF • Each year, local programs enroll up to a designated number of children in child outcomes samples • COSF forms are completed at entry and exit for children enrolled in child outcomes samples Measuring Child & Family Outcomes
New York’s Child & Family Outcomes System • A memorandum of understanding with the University at Buffalo, School of Public Health and Health Professions, Population Health Observatory, to partner with BEI in implementing New York’s child and family outcomes system • Responsible for data entry, quality control, management, and analyses • Maintains a suballocation with the University At Binghamton, Institute for Child Development, for materials development, training and technical assistance, and annual family survey Measuring Child & Family Outcomes
New York’s Child & Family Outcomes System • Special thanks to University at Buffalo, PHO staff who collaborated on the analyses and presentation • Li Yan, Ph.D., M.A., Data Manager • Amy Barczykowski, M.S.Ed., Project Coordinator • Randy Carter, Ph.D., Director of PHO • Our partners at University at Binghamton staff are • Ray Romanczyk, Ph.D., Director, Institute for Child Development • Emily Huber-Callahan • Jamie Silverio Measuring Child & Family Outcomes
Pattern 1a Children will differ from one another in their entry scores in reasonable ways (few scores at the high and low ends and more in the middle) Measuring Child & Family Outcomes
Pattern 1aEntry Scores Across All 3 Outcome Areas Measuring Child & Family Outcomes
Pattern 1b Children will differ from one another in their exit scores in reasonable ways Measuring Child & Family Outcomes
Pattern 1bExit Scores Across all 3 Outcome Areas Measuring Child & Family Outcomes
Pattern 1c Children will differ from one another in their OSEP Progress Categories in reasonable ways Measuring Child & Family Outcomes
Pattern 1cOSEP Categories Across all 3 Outcome Areas Measuring Child & Family Outcomes
Pattern 2 Functioning in one outcome area will be related to functioning in other outcome areas Measuring Child & Family Outcomes
Pattern 2Comparisons Between Outcome 1 and Outcome 2 Measuring Child & Family Outcomes
Pattern 2Comparisons Between Outcome 1 and Outcome 2 Measuring Child & Family Outcomes
Pattern 2Comparisons Between Outcome 1 and Outcome 2 OSEP Categories Measuring Child & Family Outcomes
Pattern 3 Functioning at entry within one outcome area will be related to functioning at exit (children who have higher functioning at entry in an area will be the ones who are high functioning at exit in that area) Measuring Child & Family Outcomes
Pattern 3Comparisons Between Entry Outcome 2 and Exit Outcome 2 Measuring Child & Family Outcomes
Pattern 4 Most children will either hold their developmental trajectories or improve their trajectories from entry to exit Measuring Child & Family Outcomes
Pattern 4Outcome 2Exit Score-Entry Score Measuring Child & Family Outcomes
Pattern 5 Entry, exit, and OSEP progress category distributions should be similar from year to year Measuring Child & Family Outcomes
Pattern 5Outcome 2 Entry Scores Across 4 Cohort Years Measuring Child & Family Outcomes
Pattern 5 Outcome 2 Exit Scores Across 3 Exiting Periods Measuring Child & Family Outcomes
Pattern 5 Outcome 2OSEP Categories Across 3 Entry Cohort Years Measuring Child & Family Outcomes
Pattern 7 Entry and exit scores and OSEP categories should be related to the nature of the child’s disability Measuring Child & Family Outcomes
Pattern 7Children with Only a Communication Delay ENTRY Scores for 3 Outcome Areas Measuring Child & Family Outcomes
Pattern 7 Children with Only a Communication Delay EXIT Scores for 3 Outcome Areas Measuring Child & Family Outcomes
Pattern 7OSEP Categories for Children with Only a Communication Delay Measuring Child & Family Outcomes
Pattern 8 Scores at entry and exit should not be related to certain characteristics Measuring Child & Family Outcomes
Pattern 8Outcome 2Percentage of Male and Female Entry Scores Measuring Child & Family Outcomes
Pattern 8Outcome 2Medicaid Status and Entry Scores Measuring Child & Family Outcomes
Conclusion/Next Steps • Pattern checking is a useful way to begin the data quality assurance/quality improvement process • Analyzing the data in these ways has helped NY target areas for improvement • Planning/designing a webinar to share data with local programs • Identifying other strategies to provide training and technical assistance to programs, providers, and families Measuring Child & Family Outcomes