290 likes | 442 Views
Evidence-Based Models for Court-Involved Youth. Jeffrey A. Butts John Jay College of Criminal Justice City University of New York August 7, 2012. WHAT IS EVIDENCE BASED PRACTICE?.
E N D
Evidence-Based Models for Court-Involved Youth Jeffrey A. Butts John Jay College of Criminal Justice City University of New York August 7, 2012
WHAT IS EVIDENCE BASED PRACTICE? • The use of systematic decision-making processes or provision of services which have been shown, through available scientific evidence, to consistently improve measurable client outcomes. Instead of tradition, gut reaction or single observations as the basis for making decisions, EBP relies on data collected through experimental research and accounts for individual client characteristics and clinician (or program) expertise. • - University of Washington Evidence Based Practice Institute Notice the creative contrast…
3 WHERE CAN WE GO FOR HELP? Colorado Department of Public Safety George Mason University
EVIDENCE IS PURCHASED, NOT SIMPLY DISCOVERED • Research is a competitive enterprise • There are limited funds • Researchers are not always disinterested • Funding of research can be (is?) political • Some program models are easier than others to evaluate properly • Marketing forces often overwhelm data
SO NOT ALL PROGRAMS CAN BE EVALUATED… WHAT OTHER OPTIONS ARE THERE?
STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP) • Georgetown University Center for Juvenile Justice Reform • http://cjjr.georgetown.edu/pdfs/ebp/ebppaper.pdf • SPEP developed by Mark Lipsey of Vanderbilt University
STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP) • Based on meta-analysis -- 600 studies of programs that reduce recidivism • SPEP assigns scores to a select core of program components based on how closely the components match programs with demonstrated effectiveness in prior research • Service Type • Supplemental Services • Treatment Amount (duration & contact hours) • Treatment Quality • Youth Risk Level
STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP) • Two purposes of the instrument: • Assess the effectiveness of programs that seek to reduce recidivism • Identify the components of a program that need improvement • States already using SPEP to assess youth programs • North Carolina • Arizona • Pennsylvania* • Florida* • Connecticut* * participating in Georgetown’s Juvenile Justice System Improvement Project (JJSIP) that incorporates SPEP
STANDARDIZED PROGRAM EVALUATION PROTOCOL (SPEP) • The SPEP approach would allow us to ensure higher quality programs without spending so much on evaluation • Incorporating principles supported by SPEP would allow programs to deliver better services during implementation and the scaling up of program procedures rather than waiting for data collection and follow-up • Research dollars could be use more efficiently, focusing on a smaller set of critical questions and answering them with a higher degree of accuracy • Many important questions have not been answered or even asked yet…
WHAT’S YOUR THEORY? 25 Family support Community disorder School success Thrill seeking Cognitive defects Secure housing Stable employment School failure Poverty Health Positive friends Mental illness Family violence Youth Crime Protective Factors Risk Factors Greed Ethical framework Belonging Unemployment Poor nutrition Adult guidance Self-efficacy Substance abuse Hopelessness Community respect Lack of empathy Defiance Physical safety Poor decision-making Future aspirations We Aren’t Even Close to Having All The Answers
IF OUR GOAL IS EFFECTIVENESS… • When choosing interventions for youth in the justice system, we must be AGNOSTIC -- open to new facts • Advocating one intervention over another based on turf, convenience, bias or financial interests is simply wrong • Central goal of intervention is to ensure community safety by changing youth behavior -- NOT merely to deliver a particular type of service or to ensure the financial stability of providers
WHY IS THIS SO DIFFICULT? We seem to hear mostly about mental health, substance abuse, and trauma? Most troubling cases often involve MH, SA and Trauma MH, SA, Trauma overlooked & under-diagnosed for years The science related to these issues has improved Interest group politics and public relations
CONTACT INFORMATION Jeffrey A. Butts, Ph.D. Director, Research & Evaluation CenterJohn Jay College of Criminal JusticeCity University of New York http://about.me/jbutts jbutts@jjay.cuny.edu