STARBOARD COMMUNICATIONS & GRANTS

1. STARBOARD COMMUNICATIONS & GRANTS

2. MEASURING YOUR PROGRAMS Why spend time and effort?

3. Outcome Measurement Outcome measurement involves: • the identification of how the program benefits clients (how – in what way); • development of appropriate outcome indicators and data collection procedures (who collects the data); • data analysis to better understand organizational achievements (why services benefit clients) ; • User-friendly, regular reporting of the findings.

4. Outcome Measurement Outcomes measures are important because: • adds credibility to program/services; • supports fundraising efforts; • drives allocation of resources (staff & program funding); • builds case for support; • necessary to secure grant funding; and • helps link budget directly to outcomes.

5. Types of Evaluation • Formation or process evaluation: focus on information for program improvement, modification and management. • Summative or impact evaluation: focuses on determining program results and effectiveness (merit and worth). Serves the purpose of making major decisions about program: continuation, expansion, reduction, and funding.

6. Getting Started How does an organization get started? • What to measure? • Think in terms of how clients/customers benefit (in one sentence) examples: • families secure safe housing. • students learn a new skill. • kids grow-up tobacco free.

7. Key Steps Set-up: • what programs to include; • determine who will be involved in developing the process and how; • establish an overall schedule; and • define the background, purpose and methodology of the program.

8. Key Steps Deciding what and how to measure: • identify the program’s mission, objectives and clients; • identify the outcomes of the program; • select specific indicators to measure the outcomes; select data sources and data collection procedures for each indicator; • identify key client and service characteristics to link to outcome information; pilot test the procedures, make modifications and implement.

9. Key Steps Analyzing the data: • examine the outcome data; • report the findings; • seek explanations for unusual or unexpected findings.

10. Key Steps Using the results: • use the outcome information to improve services and report findings to stakeholders and others; • capture impact of outcomes in marketing material and grant applications.

11. Measuring Your Program • Linking program measures to outcomes (e.g. your program results).

12. Benefits of Measurement How do your clients/customers benefit? • Show the value of the program: • e.g. 25% of students learned a subject. • e.g. 50% of students improved their test scores. • e.g. 10% of adults decreased their smoking frequency.

13. Benefits of Measurement • direct decision-making and accountability responsibilities; and • provide evidence that an organization’s resources have improved the lives of clients through program effectiveness, cost-effectiveness, efficiency, or quality.

14. Benefits of Measurement • Operate and manage those resources in a way that maximizes effectiveness in helping clients; and • Help managers and board members become learning organizations that constantly improve the effectiveness of their services, identifying specific steps and providing suggestions for examining and using the outcome information.

15. Ongoing Program Measurement • Define measurement objectives and outcomes; • Integrate measurement into the program; • Establish a cost/benefit analysis before beginning the project.

16. Cost/Benefit Analysis • How do I begin a cost benefit analysis? • describe individual activities and elements of each program; • quantify activities in terms of time and personnel (and/or resources used); • list program functions (areas); and • establish program budget categories for each activity area within the overall budget.

17. Cost/Benefit Examples: Assigning quantifiable measures to program activities such as: • number of hours spent per client; • categories of activities within a program; and/or • client satisfaction in services provided.

19. Outcome Measurement Strategy: • identify broad outcome areas; • assign programs to areas; • create program outcome statement for each area; • define outcomes (goals & objectives); and • use financial data to show #’s served, resources used & links to outcomes.

21. Outcomes OUTCOMES FROM PERSEUS HOUSE, INC: RESIDENTIAL AND EDUCATIONAL SERVICES

31. CICTP Outcomes Aggression Testing Scores Pre Post 56.7 60.0 54.2 53.4 53.3 52.5 52.3 52.2 51.3 50.5 50.5 49.5 48.2 50.0 40.0 30.0 20.0 10.0 0.0 Total Physical Hostile Verbal Indirect Anger N=171 N=171 N=171 N=171 N=171 N=171 -3.3 Significant -2.0 Significant -2.7 Significant -1.9 Significant -2.0 Significant -2.3 Significant

36. Residential Outcomes History of Residential Placement Recidivism Rates N=81 Missing=34 Yes N=7 14.9% No N=40 85.1%

39. Residential Outcomes Aggression Testing Scores Pre Post 60.0 54.2 53.2 53.1 52.7 52.2 52.2 52.2 50.6 49.7 49.2 48.8 48.1 50.0 40.0 30.0 20.0 10.0 0.0 Total Physical Hostile Verbal Indirect Anger N=130 N=129 N=130 N=130 N=130 N=130 -0.4 Not Significant -1.5 Not Significant -2.0 Significant -5.1 Significant -2.5 Significant +0.4 Not Significant

41. Sample using pre and post tests

42. Sample using numbers served:

43. Sample using time study:

44. STARBOARD COMMUNICATIONS & GRANTS

45. Starboard Communications & Grants offers comprehensive communications, grant and development services specifically for the nonprofit and government sector.

46. Starboard Communications & Grants is a joint social enterprise between Perseus House, Inc., and Safe Harbor Behavioral Health. A social enterprise is an earned-income business or strategy undertaken by a nonprofit for the purpose of generating revenue in support each nonprofit’s social mission.

47. Starboard: • improves the capacity of nonprofit organizations to effectively seek & secure grant funding for operating and/or capital needs; • improves planning, marketing & communications to initiate greater public support; and • increases capacity of non-profit development functions.

48. Starboard: • Grants and research services. • Marketing and development services. • Outcomes measurement services.

49. Other grants: 7.3 million: • USDA telemedicine grant for visiting nurse agency. • SAMHSA grant for improving mental health svcs. • Robert Wood Johnson Foundation grant for nursing outreach program. • Ronald McDonald House Charities provided neonatal equipment. • Tax credits benefited capital campaign initiatives. • Susan Komen Fdn. funded cancer education & outreach.

50. Questions?