Robert Walker, Allison Mateyoke-Scrivener, & Jennifer Cole University of Kentucky

1. Using Research/Evaluation Questions to Define Data Collection and Findings:Findings from the FY 2004 KTOS Follow-up Study Robert Walker, Allison Mateyoke-Scrivener, & Jennifer Cole University of Kentucky Center on Drug and Alcohol Research

2. Question 1: What are the demographic characteristics of KTOS sample? • Almost any study asks for these data • As with all research questions and decisions about measures, you must know how fine a detail is needed – e.g., on ethnicity. • Does your survey discriminate between race and ethnicity? • Can subjects have more than one race? • More than one ethnicity?

3. Demographics

4. Question 2: Policy Q #1 is about abstinence • The study must address the sophistication level of the users of the data. • Current political climates have little tolerance for harm reduction ways of understanding treatment outcomes. • Moralistic views of substance abuse call for abstinence, not reduced use.

5. Increase in Percent of Clients with Alcohol Abstinence During Preceding 30 Days(n=888)

6. How to present findings that highlight change • Raw numbers help, but often do not help the reader understand the effect of seemingly modest differences in numbers. • Findings should include ways of showing the significance of change both statistically and through the use of different ways to think about change values.

7. Rate of Percent Increase in Alcohol Abstinent Clients(n=888)

8. Increase in Percent of Clients who Reported Abstinence from Illegal Drugs in the Past 30 Days (Excluding Alcohol) aSignificance established using z test for proportions. *p < .01. **p < .001

9. Question 3: Are there differences by drug type? • Measures in KTOS instrument continue to drill down to greater detail on specific drugs. • Differences in drug use patterns may suggest differences in the rates of becoming abstinent as well. • Taking each drug separately may help discriminate which drugs appear more difficult for recovery.

10. Increase in Percent of Clients who Report Past 30 Day Tranquilizer Abstinence and Rate of Change aSignificance established using z test for proportions. *p < .01. **p < .001

11. Increase in Percent of Clients who Report Past 30 Day Opiate Abstinence and Rate of Change aSignificance established using z test for proportions. *p < .01. **p < .001

12. Increase in Percent of Clients who Report Stimulant Abstinence from Intake to Follow-up and Rate of Change aSignificance established using z test for proportions. *p < .01. **p < .001

13. Sub-question: For those who continue to use, are there any reductions in frequencies? • Validated instruments such as the ASI use a composite scores of past 30 days use to examine level of drug use. • However, none of these instruments control for time in jail or hospital. • For example, consider two clients, both of whom report using marijuana for 15 of the past 30 days. • 1 client was in jail for 15 days in the past 30 days • The other client had been on the street for 30 of the past 30 days • Using the ASI, both clients would be evaluated the same • In KTOS, we use a proportion of days to estimate use levels • Client 1 would use 100% • Client 2 would use 50%

14. Percent Reduction in Proportion of Past 30 Days that Substances were Used (n=888)

15. Question 4: Does Treatment Result in Increased Employment? The Role of Functionality Variables • Apart from drug use changes, functionality measures can be used to partially confirm clinical results. • Given extensive research on substance use and employment, the equations should be: • Decrease in drug use = Increased employment • Increased employment consistent with decreased drug use

16. Percent of Clients in Each Employment Category

17. Rate of Change in Employment(n=888) aSignificance established using z test for proportions. *p < .01. **p < .001

18. Question 5: Are there any changes in arrests after treatment? Another Functionality Variable • As with employment, the equation typically is: • Decreases in drug use = Decreases in criminal activity and therefore, decreases in arrests. • Likewise, decreases in arrests tend to confirm that decreases in substance use have occurred.

19. Percent of Clients Arrested in the Past 12 Months

20. Rate of change in arrests Significance established using z test for proportions. *p < .01. **p < .001

21. Question 6: Are there changes in mental health symptoms after treatment? • Given robust associations of mental health problems associated with substance use, the equation should be: • Decreases in substance use should = Decreases in mental health problems. • Likewise, decreases in mental health problems should be consistent with decreased mental health problems.

22. Changes in Mental Health Ratings (n=888)

23. Rate of change in MH symptoms Significance established using z test for proportions. *p < .01. **p < .001

24. Question 7: Are there any cost offsets to society from treatment? • Substance abuse treatment, more than any other behavioral treatment, has had to show that it saves taxpayers money. • The changes in employment and arrests offer the clearest behaviors to measure in terms of cost changes from intake to follow-up.

25. Total Cost of Publicly-funded Treatment Services

26. Past 12-month Arrest at Baseline and Follow-up and Estimated Victim Costs of Crime (n = 888) Reduction in Nights in Jail and Related Costs

27. Increased Employment and Earnings (n=888)

28. Conclusion • The reductions in self-reported arrests for Kentucky clients • Combined with estimates for reduced victim costs of their crimes • Reduced costs of jail time and - • Increased earnings and tax revenues • Suggest a cost offset benefit for Kentucky taxpayers estimated at a ratio of 5.35 to 1. • In other words, Kentucky saved $5.35 for every dollar spent on treatment during 2004.