Substance Abuse and Mental Health Services Administration (SAMHSA) Fetal Alcohol Spectrum Disorders (FASD) Center for E

1. Substance Abuse and Mental Health Services Administration (SAMHSA) Fetal Alcohol Spectrum Disorders (FASD) Center for Excellence “Building FASD State Systems (BFSS) Meeting”  Colorado Springs, Colorado May 6 – 8, 2008

2. National Registry of Evidence-based Programs and Practices and Service to Science May 8, 2008 Carol R. McHale, Ph.D. Substance Abuse and Mental Health Services Administration Center for Substance Abuse Prevention

3. Objectives • Become familiar with SAMHSA’s Science to Service and Service to Science Initiatives • Learn about the revised NREPP system and rationale for changes • Become familiar with how NREPP rates programs • Learn how to use the NREPP searchable website • Learn about SAMHSA/CSAP’s Service to Science regional activities • Learn how Service to Science assists innovative programs to improve evaluation –capacity and quality

4. Overview of SAMHSA’s NewNational Registry of Evidence-based Programs and Practices (NREPP)April 2008

5. SAMHSA’s Vision for NREPP “NREPP becomes a leading national resource for contemporary and reliable information on the scientific basis and practicality of selected interventions to prevent and/or treat mental and substance use disorders.”

6. 1996 – National Registry of Effective Prevention Programs created 1997 to 2003 – 1,100+ substance abuse prevention programs reviewed 150 recognized as Model, Effective, or Promising programs (www.modelprograms.samhsa.gov) 2003 – NREPP expanded to include substance abuse treatment and mental health programs 2005 – Comments solicited on NREPP system redesign 2006 – New NREPP system finalized 2007 – New NREPP Web site launched History of NREPP

8. New system: Ratings of the quality of evidence are specific to an identified set of outcomes emphasizing significant behavioral changes. Also includes separate Readiness for Dissemination ratings. Old system: Ratings of the quality of evidence were assigned at the program/intervention level. Major Changes to NREPP

9. New system: Recognizes that evidence quality is continuous and context dependent. Old system: Considered evidence quality according to categorical ratings (e.g., model, effective, promising). Major Changes to NREPP (continued)

10. New system: Provides a searchable database that includes multiple dimensions of evidence that should be considered and integrated by the user in a decision support context. Old system: Provided somewhat static listings of “approved” interventions. Major Changes to NREPP (continued)

11. As of April 1, 2008: 88 interventions have been reviewed and posted on the NREPP Web site 121 additional interventions have been accepted for review 92 interventions have been posted on the NREPP Web site as “Legacy Programs” Summary of Reviews

12. Summary of Reviews (continued) Distribution of interventions by Center:

13. 69% of posted interventions developed/ evaluated with National Institutes of Health (NIH) support NREPP Web site interest (as of March 1, 2008): 162,635 total hits 131,072 unique visitors Summary of Reviews (continued)

14. New NREPP Submissions

15. Substance Abuse Prevention Programs Under Review (23) • Across Ages • AlcoholEdu for High School • Al’s Pals: Kids Making Healthy Choices • Brief Alcohol Screening and Intervention for College Students (BASICS) • Brief Strategic Family Therapy (BSFT)/ Family Effectiveness Training • Caring School Community Program (Formerly known as Child Development Project [CDP]) • Community Trials Intervention To Reduce High-Risk Drinking (RHRD) • Families And Schools Together, Inc. (FAST) • Healthy Workplace • Not On Tobacco • Nurse-Family Partnership (NFP) • Olweus Bullying Prevention • Parenting Wisely • Partners With Families and Children: Spokane Starting Early, Starting Smart (formerly Casey Family Partners: Spokane) • Prolonged Exposure Therapy for Posttraumatic Stress Disorders • Protecting You/Protecting Me • Right Decisions, Right Now: Be Tobacco Free • SPORT • Start Taking Alcohol Risks Seriously— STARS for Families • Strengthening Families Program: For Parents and Youth 10-14 • Storytelling for Empowerment • Trauma-Focused Cognitive Behavioral Therapy (TF-CBT) • Wellness Outreach At Work

16. Substance Abuse Prevention Programs Pending Review (25) • Alcohol: True Stories • Brain Train 4 Kids • Drugs: True Stories • Familias Unidas • Families in Action • Healer Women Fighting Disease: An Integrated HIV and SA Prevention Project • Healthy Alternatives for Little Ones (HALO) • High/Scope Perry Preschool Program • Hip Hop 2 Preventive Substance Abuse and HIV (H2P) • Know Your Body • LifeSkills Training (LST) • Media Detective/Media Ready • Peer Assistance and Leadership (PAL) • PRIME for Life • Project ACHIEVE/The Stop and Think Social Skills Program • Rainbow Days Curriculum-Based Support Groups (CBSGs) Part I • Reality Tour • Reconnecting Youth (RY) • Residential Student Assistance Program (RSAP) • Reward and Reminder • Say It Straight • Stay on Track • Teaching Students To Be Peacemakers • Teenage Health Teaching Modules • The Corner Theater Troupe/Peer Education Substance Abuse Prevention Project

17. NREPP can be a first step to promoting informed decisionmaking. NREPP rates the quality of research supporting intervention outcomes and the quality and availability of training and implementation materials. NREPP does not provide an exhaustive list of interventions or endorsements of specific interventions. Using NREPP

22. Intervention Summary NREPP publishes and posts an intervention summary for each intervention reviewed. Summaries include: • Descriptive information • Quality of Research and Readiness for Dissemination ratings • A list of studies and materials examined during the review • Contact information for the intervention developer and dissemination staff

35. Find out when the next submission period will be held (periodically check online at http://nrepp.samhsa.gov/about-news.htm) Determine whether your program is appropriate for submission. Does your program meet the minimum requirements? Is your program likely to receive priority points? How will your program fare using the NREPP rating criteria? Create and submit an application packet according to submission guidelines outlined in the current Federal Register notice. How to Submit to NREPP

36. Demonstrates one or more positive behavioral outcomes (p ≤ .05) in mental health and/or substance use Results published in a peer-reviewed publication or comprehensive evaluation report Dissemination materials available to the public (e.g., manuals, process guides, tools, training materials) Minimum Submission Requirements

37. SAMHSA prioritizes all interventions submitted for review using a system of awarded points. Points may be awarded for: Study design: Intervention has been evaluated using an experimental or quasi-experimental study design May include a longitudinal/time series design if there are at least three data points at preintervention/baseline and at least three data points postintervention Priority area: Primary targeted outcomes are in one or more priority areas established by SAMHSA in the current Federal Register notice. Priority Points

38. Reliability of outcome measures Validity of outcome measures Intervention fidelity Missing data and attrition Potential confounding variables Appropriateness of analysis NREPP Rating Criteria:Quality of Research

39. Availability of implementation materials Availability of training and support resources Availability of quality assurance procedures NREPP Rating Criteria: Readiness for Dissemination

40. Contact for Submission Guidance Individuals and/or organizations interested in submitting an intervention for potential inclusion in NREPP should contact the NREPP contractor, MANILA Consulting Group: Telephone: 571-633-9797, extension 406E-mail: nrepp@samhsa.hhs.gov

41. Following Up More information on NREPP is available at: http://www.nrepp.samhsa.gov For questions about NREPP or other SAMHSA activities to promote the use of evidence-based services, contact: Kevin D. Hennessy, Ph.D. Science to Service Coordinator, SAMHSA Phone: 240-276-2234 E-mail:kevin.hennessy@samhsa.hhs.gov

42. Service to Science Initiative: Working with Innovative Prevention Programs to Improve Evidence of Their Effectiveness

43. SAMHSA’s Strategic Prevention Framework Assessment Profile population needs, resources, and readiness to address needs and gaps Evaluation Capacity Sustainability & Cultural Competence Monitor, evaluate, sustain, and improve or replace those that fail Mobilize and/or build capacity to address needs Implement evidence-based prevention programs and activities Develop a Comprehensive Strategic Plan Implementation Planning

44. Service-to-Science Goals • To help innovative, field-grown prevention interventions that address substance abuse (or related issues) develop and document evidence of their effectiveness. • To increase the pool of evidence-based interventions – diversity.

45. Guiding Principles for Service-to-Science • Meet programs “where they are” along a continuum of evidence of effectiveness. • Participating programs have a common direction but different final destinations.

46. Service-to-Science Activities • CAPTs solicit prevention program nominations from State prevention officials. • CAPTs assess the readiness of candidate programs. • CAPTs conduct regional Service to Science Academies. • CAPTs provide follow-up technical assistance.

47. Service-to-Science Activities(Continued) • Service-to-Science Academy participants – eligible to compete for “mini-subcontracts” to further enhance evaluation capacity through the CRP, Inc. Service to Science Contract. • CAPTs provide limited technical assistance post “mini-subcontract” award. • New outreach activities: • Pacific Jurisdictions • Atlantic Jurisdictions; and • American Indian/Native Alaskans in collaboration with CSAP’s Native American Center for Excellence (NACE)

48. Number of Programs Served Through Service-to-Science • As of October 2007, the CAPTs had provided 230 prevention programs with technical assistance. • From 2005 to 2007, 79 programs received subcontracts of up to $30,000 each.

49. Distribution of Mini-Subcontract Proposals and Awards(2007 Cycle)

50. Defining Features of Service-to-Science TA • Customized • Long-term • Relationship-based • Flexible