Moving Towards Sustainability: The Journey Continues

1. COAGSMH Meeting January 31, 2014 Moving Towards Sustainability: The Journey Continues

2. Agenda Our Time Together • Welcome and Introductions • The Journey Towards Sustainability • CalMHSA Partner Updates • Capitalizing on Innovation • Taking the Show on the Road • Continuing the Discussion

3. Welcome and introductions Staff, members, and those calling in

4. The Journey So Far: Assessing Where We Are Recap of last meeting: focus areas and next steps Review agenda adjust as needed

5. Goals for the Day Seek Innovate Contribute Build Collaborate

6. Making Change

7. Collective Impact 7

8. CalMHSA Updates

9. Capitalizing on Innovation Fostering Partnerships Mobile Applications Other Strategies

10. Capitalizing on Innovation: Sharing Knowledge with Community Colleges Sally Jue, MSW

11. Building Collaborative Relationships:Community Colleges County Mental Health DepartmentsLocal Mental Health Providers

12. Challenges • Finding local resources • Finding the right DMH contact • Competing priorities—no time or resources • Not getting a response

13. Success Factors • Committed, persistent, patient individuals • In person initial meeting • Identified mutual benefits and incentives • Clear immediate and long term expectations, especially re: communication • College participation in local MH community • DMH and CBO on campus activities • Sustainable infrastructure

14. Innovative CBG Activities • Santa Monica College and Los Angeles County DMH case conferences • Los Angeles College Consortium and LAC DMH Strategic Action Plan • Campus based mental health intern programs • Wellness centers • Coping skills and support groups provided by community providers on campus

15. Knowledge Transfer Ideas • Webinars • Case studies • CCC and DMH collaboration toolkit

16. Taking the Show on the Road Review Existing Data Determine Key Messages and Best Ways to Share Findings Next Steps Maximizing Our Data and Sharing Our Results

17. Using Data in PracticeA brief overview Bob Saltz, PIRE

18. Purposes of Evaluation/Evaluation Questions • Produce information in order to enhance management decision-making • Improve program operations • Maximize benefits to clients: to what extent and how well was the policy/program implemented? Arden Handler, DrPH Professor, Community Health SciencesUniversity of Illinois at Chicago

19. Purposes of Evaluation/Evaluation Questions • Assess systematically the impact of programs/policies on the problems they are designed to ameliorate • How well did the program/policy work? • Was the program worth its costs? • What is the impact of the program/policy on the community?

20. Two Main Types Of Evaluation • Process or formative • Outcome or summative

21. Process or Formative Evaluation • Did the program/policy meet its process objectives? • Was the program/policy implemented as planned? • What were the type and volume of services provided? • Who was served among the population at risk?

22. Why Do We Do Process Evaluation? • Process evaluation • Provides feedback to the administrator regarding the program • Allows others to replicate the program if program looks attractive • Provides info to the outcome evaluation about program implementation and helps explain findings

23. Outcome or Summative Evaluation • Did the program/policy meet its outcome objectives/goals? • Did the program/policy make a difference?

24. Outcome or Summative Evaluation • What change occurred in the population participating in or affected by the program/policy? • What are the intended and unintended consequences of this program/policy? • Requires a comparison group to judge success • What impact did the program/policy have on the target community? • Requires information about coverage

25. Why Do We Do Outcome Evaluation? • We want to know if what we are doing works better than nothing at all • We want to know if what we are doing new works better than what we usually do

26. Summary • However, the ability to translate evaluation findings into good programs and policy does not only depend on quality data, but on political will

27. Integrated Model of theResearch – Policy Relationship • ContextPolitical and Institutional structuresInterests and roles of stakeholders • EvidenceCredibility of the researchActive engagement with research • LinksClose links between researchers and policy-makersPerceived expertise or legitimacy

28. Supporting the Use ofResearch in Practice • Research must be translated • Ownership is key • Need “enthusiasts” • Contextual analysis • Credibility • Provide leadership • Develop integration

29. Types of Questions We Plan to Address for SMHP • Assessment questions incl. key subgroups • Immediate or proximal impact of program components • Ultimate impact of program components 29

30. Types of Data • Basic Descriptive Data • Campus Infrastructure • Prevention & Early Intervention Activities • Basic Outcome Data 30

31. Sources of Data • Training Surveys • Kognito Online Training Survey • Training and Technical Assistance (TTA) Survey (CARS-developed) • CCC Campus Training Survey (RAND-developed) • RSF Survey and materials (RAND-developed) • Pre/Post Comparison Surveys • Capacity Survey of Mental Health Services (PIRE-developed) • ACHA/NCHA Survey • CalMHSA Higher Education Student Survey (RAND + PIRE-developed) • CalMHSA Higher Education Faculty/Staff Survey (RAND-developed) • Regular Reporting (CBGs only) • Monthly Progress Report • Quarterly Report 31

32. Examples of Data collected to date

33. Kognito On-line Training Survey 1=hostile, 2=somewhat hostile, 3=neutral, 4=somewhat welcoming, 5=welcoming

34. Training & Technical Assistance

35. Quarterly Reporting Tool

36. Capacity Survey (baseline)

37. Capacity Survey (baseline)

38. Capacity Survey (baseline)

39. SNAPSHOT of California Community College Students and Mental Health ServicesMarch 18, 2011Revised January 29, 2013 Becky Perelli, RN, MS

40. What have we learned about our students? Health Services Association of California Community Colleges ACHA-NCHA II 2010 Consortium Project

41. ACHA – NCHAAmerican College Health AssociationNational College Health Assessment The ACHA-National College Health Assessment (NCHA) is a nationally recognized research survey that can assist us in collecting precise data about students’ health habits, behaviors, and perceptions and covers a wide range of health issues - • Alcohol, tobacco, and other drug use • Sexual health • Weight, nutrition, and exercise • Mental health • Personal safety and violence

42. ACHA – NCHAAmerican College Health AssociationNational College Health Assessment • Since spring 2000 > 825,000 students/550+ colleges and universities across the country have taken the survey. • Used by two- and four-year public and private institutions from varied geographical regions, Carnegie Foundation Classifications, and campus settings.

43. Participating CCC CampusesSpring 2010 • North N=7 • CentralN=3 • South N=4

44. ACHA-NCHA IIHSACCC Consortium – Spring 2010 14 Colleges N = 11,386 Students F 52.7% M 41.6% Tr 0.3% Av Age - 24.20 Age >24 – 26% Part time status – 30.5% Live w/Parent/guardian – 64.4% Work hours for pay – 61.2 %

45. ACHA-NCHA Cohort White 39.4% Black – not Hispanic 4.3% Hispanic/Latino(a) 26.4% Asian/Pacific Islander 20.7% American Indian/ Alaskan Native/ Native Hawaiian 1.9% Biracial/Multiracial 5.1% Other 5.7% ETHNICITY STATEWIDE White 31% African American 7% Hispanic 30% Asian 11% Pacific Islander 0.5% Filipino 3% American Indian/Alaskan Native 0.5% Multiracial 1% Unknown 16%

46. MENTAL HEALTH OF CCC STUDENTS

47. Top 10 Factors CCC Students ReportImpact Academic Performance

48. Mental Health Experience anytime in last 12 Months • Overwhelmed 72.8% • Exhausted (not physical activity) 69.0 • Very Sad 57.3 • Very Lonely 50.7 • Hopeless 48.4 • Overwhelming Anxiety 43.7 • Overwhelming Anger 43.3 • So Depressed difficult to function 33.9 • Seriously considered suicide 8.2 • Intentionally injured self 7.4 • Attempted suicide 2.6

49. Mental Health Experienceanytime in last 12 months Traumatic/Difficult to Handle Diagnosed or Treated by Prof. • Anxiety 9.4% • Depression 9.4% • Panic Attacks 5.1 • Insomnia 4.9 • ADHD 3.7

50. What have we learned about CCC Health and Mental Health Services? HSACCC Annual Survey 2012-2013