1 / 18

University of Wisconsin Population Health Institute Kit R. Van Stelle, Principal Investigator

Treatment Alternatives and Diversion (TAD) Program. The Importance of Evaluation for TAD Programs: Why It Makes $ ense. University of Wisconsin Population Health Institute Kit R. Van Stelle, Principal Investigator krvanste@wisc.edu.

jemima
Download Presentation

University of Wisconsin Population Health Institute Kit R. Van Stelle, Principal Investigator

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Treatment Alternatives and Diversion (TAD) Program The Importance of Evaluation for TAD Programs: Why It Makes $ense University of Wisconsin Population Health Institute Kit R. Van Stelle, Principal Investigator krvanste@wisc.edu Treatment Alternatives And Diversion - Effective Criminal Justice Reform Through Research Based Practice The Madison Concourse Hotel, August 23, 2013

  2. What is Program

  3. Program evaluation is the systematic collection, analysis, and interpretation of data for the purpose of determining the value of a social policy or program, to be used in decision making about the policy or program. Research is a systematic investigation designed to develop or contribute to generalizable knowledge. “Research seeks to prove, evaluation seeks to improve…” -- Michael Quinn Patton 3

  4. Evaluation Is Used…. • For program accountability • To improve programs— midcourse or for future implementation and expansion • To provide data for making evidence-based decisions about policy and practice Evaluation and program design go hand in hand. Evaluation doesn’t happen at the end of something; it starts at the design phase and becomes an integral part of implementation.

  5. Framework for Evaluation Centers for Disease Control and Prevention 5

  6. Why is Program Evaluation Important for TAD? Evaluation Unifies… Evaluation Documents… Evaluation Communicates… Evaluation Bridges Gaps… 6

  7. The TAD Evaluation Unifies… • Evaluation helps tie diverse TAD sites together into one approach – consistent thread among projects • Evaluation is part of TAD infrastructure • Evaluation is link between the “ones and zeros” of data and program practice

  8. The TAD Evaluation Documents… • Evaluation documents program implementation, fidelity to service models, and short-term and long-term impacts • It will be essential during TAD expansion to provide technical support and monitoring of implementation for new sites • Avoid common error of “dilute and disseminate” 8

  9. The TAD Evaluation Communicates… • The evaluation provides ongoing feedback to sites for program improvement • The evaluation provides ongoing information about program effectiveness and intermediate outcomes • Completion rates, Incarceration averted • Periodically provides findings on criminal recidivism and state prison incarceration outcomes • Results of cost-benefit analyses • Information for state agency and legislative policy development and decision-making

  10. The TAD Evaluation Bridges Gaps…. • Evaluators are connection among TAD projects • Evaluators serve as a liaison between the TAD projects and state agency partners • Evaluators act as liaison between TAD projects and TAD Advisory Committee • Evaluators act as liaison between TAD projects and Statewide CJCC • Provides linkage to UW Medical School Advisory Board, health policy stakeholders statewide, and national criminal justice stakeholders

  11. What is required of TAD sites for the evaluation? What must they put into it? 11

  12. Collection of participant-level information using the TAD database • Monthly upload of the database file to PHI • Monthly correction of any missing/incorrect data • Prepare quarterly reports for DOJ/PHI • Participate in annual allsite meeting in Madison • Annual survey or teleconference with evaluation staff on a topic of interest • Network with and support the work of the other TAD sites when issues arise • Write success stories for inclusion in major reports 12

  13. How do TAD sites benefit from the evaluation? What do they get out of it? 1. Linkages 2. Technical Assistance 3. Feedback for Program Improvement 4. Evidence of Program Impacts 13

  14. Other TAD sites and staff TAD Advisory Committee TAD state partner agencies DOJ (OJA) DOC DHS Office of State Courts Benefit #1. Facilitate linkages with…. 14

  15. TA with program implementation TA with database and data collection Answers to questions from site staff related to program eligibility, admission, and discharge criteria Assistance with evidence-based practices (EBPs) Benefit #2. Technical Assistance 15

  16. TA with program implementation Input and assistance from the TAD Advisory Committee Benefit #3. Ongoing Evaluation Feedback for Quality Improvement Monthly review and feedback on data from PHI to sites….. Allow barriers to be addressed thru modifications to policy or practice Allow correction of missing data or mistakes Identify problems or patterns in data 16

  17. Outcomes Results [Matching of TAD participant data to state data systems] Annual summary for each site describing participants and primary measures DOC State Prison Admission CCAP Recidivism Data (new conviction) Response to periodic data requests from sites Anticipated DWD Employment Data Cost-Benefit Analyses Using WSIPP Model Benefit #4. Evidence of Program Effectiveness 17

  18. Questions and Wrap-up Contact Kit R. Van Stelle at krvanste@wisc.edu with questions or comments http://uwphi.pophealth.wisc.edu/

More Related