1 / 20

Evaluating the Implementation of Child Welfare System Change

Evaluating the Implementation of Child Welfare System Change. Introduction. The evaluation of implementing system change is complex. The emerging science of implementation provides multiple frameworks that guide the evaluation. Why Evaluate?. Document what IS implemented

jamuna
Download Presentation

Evaluating the Implementation of Child Welfare System Change

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluating the Implementation ofChild Welfare System Change

  2. Introduction • The evaluation of implementing system change is complex. • The emerging science of implementation provides multiple frameworks that guide the evaluation

  3. Why Evaluate? • Document what IS implemented • Effectiveness of Intervention(s) • Effectiveness of Implementation • Inform both through the stages of implementation

  4. Why Evaluate? • Development of ongoing Quality Assurance framework and process for sustainability • Impact that implementation has on child welfare system

  5. Complexity of IC Evaluation • Evaluation of implementation of change at multiple levels: • Practice (EBP and non EBPs) • Organization • System

  6. Complexity of IC Evaluation • We also evaluate: • The process of implementation • Levels of fidelity • Outcomes of the intervention(s)

  7. Evaluation System Change Matrix

  8. Logic Model • Each MCWIC implementation project includes a logic model that: • Provides an overall framework for implementation • Makes explicit the logical connections in a complex project • Identifies products, outcomes, and system impacts

  9. Logic Model • Logic model development is key to planning the evaluation • The logic model is explicitly referenced in the development of: • Evaluation plans outlining all project evaluation activities • Work plans providing a timeline for project activities

  10. Implementation Process Review • Links implementation drivers to the logic model • Measures fidelity of the implementation in reference to the logic model & work plan • Provides ongoing monitoring of implementation • Identifies emerging Project TA needs

  11. Evaluating Interventions & Implementation • An implementation project often includes multiple specific interventions • Each specific intervention has specific outcomes. • Each intervention contributes to the implementation outcomes

  12. Long Term Outcomes (examples) • Organizational structure & functions identified to work more effectively with county service organizations (OH) • Improved intake information collected, documented, & available (IN) • Child Welfare staff will have increased understanding of the history and purpose of ICWA (WI)

  13. System Impacts (examples) • Improved working relationship between OFC and County Child Welfare Agencies (OH) • Improved customer satisfaction with intake reporting experience (IN) • Agency culture reflects a strength based perspective on parents (IA)

  14. System Impacts / Child and Family Outcomes (examples) • Increased number of cases maintaining tribal connection (WI) • Shorter length of stay in foster care (IA) • Increased use of relative care (IN)

  15. Conclusions • Evaluation is not a scary addition to an implementation project

  16. Conclusions • Rather, evaluation is an integral aspect of the implementation itself, providing: • A guiding logic to the implementation • A procedure for monitoring the progress of the implementation • A means of assessing implementation success as well as emerging needs and challenges

  17. Questions? • Comments? • Tomatoes?

More Related