Community Level Instrument (CLI): Part 2

1. Community Level Instrument (CLI): Part 2 SPF SIG State-Level Evaluation

2. Webinar agenda • SAMHSA/CSAP cross-site evaluation overview • Purpose of the CLI: Parts 1 & 2 • Data collection required for the CLI: Part 2 • Roles and responsibilities • Timing and submission deadlines • Resources available

3. Samhsa cross-site evaluation instruments • All communities funded by the SPF SIG are required to submit cross-site evaluation data. • Quick Cross-site evaluation terms in cross-site evaluation tools: • “Grantee” (State of AK who received the SPF SIG) • “Subrecipients” (6 funded communities in Alaska)

4. Samhsa cross-site evaluation instruments • Completed annually throughout the SPF SIG (Steps 1-5) • Completed quarterly for each intervention once implementation begins (Step 4) • Completed by participants of individual level interventions at pre, post, & follow-up (Step 4) • CLI: Part 1 –progress through the Strategic Prevention Framework • CLI: Part 2 –information about the specific interventions being implemented (adaptations, # reached, demographics) • PLI – participant change in alcohol consumption resulting from individual level interventions

5. Purpose of Collecting CLI: part 1 and 2 Data • Assess • community implementation of the SPF process • changes in communities’ prevention infrastructure • types of interventions implemented • challenges to the implementation of the SPF process and alcohol prevention interventions • overall impact of the SPF SIG initiative • Identify • characteristics of community-level interventions • approaches that are most effective in producing population-level and participant-level outcomes.

6. How ARE CLI: part 1 and 2instruments linked together? Complete Q163 in CLI:Part 1 for each intervention being implemented in your Strategic Plan (We will individually work with you on this): • Intervention Name • Strategy Name (if a multi-component intervention) • CSAP Strategy Type • Alternative Drug-free Activities • Prevention Education • Problem Identification and Referral • Information Dissemination • Environmental Strategies • Community-Based Processes Complete CLI:Part 2 for each strategy identified in Q163

7. Things to keep in mind • Interventions/ Strategies are planned activities intended to change alcohol related behavior (not general capacity building) • Defining strategies accurately in Q163 is important because it determines which questions are asked in CLI Part II. • Detailed guidance, including examples, can be found in the document “Detailed Guidance for Completing Q163.” Again, we will work closely with you to complete Q163!!

8. CLI: Part 2 • Uses a combination of multiple choice, fill in the blank, and open-ended questions to gain information about your implemented strategies. • Completed quarterly online for each strategy https://www.pmrts.samhsa.gov/pmrts/ • Some information is best tracked on a regular basis to provide accurate number in quarterly reports • Completed by Project Directors and Evaluators • May take up to 3 hours to complete each quarter

9. Components of CLI: Part 2 Strategy Information • Consumption pattern the strategy targets • Intervening variables the strategy targets • Date strategy first funded • Whether or not strategy is evidence-based • Criteria to determine whether it was evidence-based • Areas served by strategy (city, zip code, estimated population) • Cost of strategy during reporting period • Percent of funding from SPF SIG funds

10. Components of CLI: Part 2 Strategy Adaptations • Whether or not it is a new strategy • Whether or not any adaptations were made: • Target population • Curriculum or manual • Dosage • Duration • Setting • Cultural appropriateness • Whether or not any participant satisfaction was conducted on cultural appropriateness

11. Components of CLI: Part 2 Strategy Outcomes • Whether or not any outcome data was collected during reporting period (attitudes, behaviors, knowledge) • Sampling strategy for outcome data collection • Whether any outcome data was analyzed during reporting period • Which CSAP National Outcome Measures were collected during reporting period

12. Components of CLI: Part 2 Strategy Subforms(one is required for each strategy depending on which CSAP 6 category your strategy falls under): • Alternative Drug-free Activities • Community-Based Processes • Prevention Education • Information Dissemination • Problem Identification and Referral • Environmental Strategies All are a little bit different in their content

13. CLI: Part 2 Strategy subforms: Prevention Education, Alternative Drug-Free Activities, and Problem Identification/Referral • IOM Classification (Universal, Selective, Indicated) To be reported quarterly for each strategy: • Number of participants reached in total • Number of new participants reached • Demographics of new participants reached • Number of females/males reached • Number of individuals reached within age categories (0-11, 12-17, 18-20, 21-25, 26+) • Number of individuals reached within ethnic categories (American Indian/AK Native, Asian, Black or African American, White, Multiracial, Other, Unknown)

14. CLI: Part 2 Strategy subforms: Community Based Processes, Environmental Strategies, and Information Dissemination Subforms • Unduplicated count of individuals reached during fiscal reporting period (since last October 1st) • percentage of individuals who were reached since last October 1st • % female/male • % within age categories (0-11, 12-17, 18-20, 21-25, 26+) • % reached within ethnic categories (American Indian/AK Native, Asian, Black or African American, White, Multiracial, Other, Unknown) Percentages should equal 100%

15. Other Questions for Environmental strategies Some examples…… Social Marketing Environmental strategies • # of radio ads created • # of radio ads aired Enforcement Environmental Strategies • # of compliance checks conducted • # of sobriety checkpoints established

16. Submission Deadlines for CLI: Part 2 …..Continue with same schedule throughout life of grant

17. 17 What assistance is available? • Local assistance by state evaluators • Submission deadlines schedule • Guidance documents • 1) Question by Question (QxQ) guides for CLI Parts I and II • 2) Detailed Guidance document for Q163 • 3) Checklist for Reviewing the CLI Parts I and II • Frequently Asked Questions • Federal Cross-site evaluation team collects grantee questions and disseminates FAQ document to grantees regularly. • CLI Response Report • Communities can print reports showing what responses they have given in previous reporting periods.

18. What assistance is available to communities? (cont’d) • On-line Instrument Training Video • Interactive videos demonstrating navigation through the web-based MRT system.http://kitusers.kithost.net/support/diticsupport/MRT/SPFSIGInstrumentsGLICLIPLITrainingVideos/tabid/1114/Default.aspx • Help Line • If you experience technical difficulties in using the web-based system, contact the DITIC Help Desk by email or phone 1-888-DITIC-4-U (1-888-348-4248) Monday - Friday, 9:00 am - 8:00 pm EST