OUTCOME BASICS United Way of Metropolitan Atlanta

1. OUTCOME BASICSUnited Way of Metropolitan Atlanta

2. TODAY’S MAIN QUESTIONS Why is evaluating your program important? What do we really mean by Outcome Measurements? How do I identify the right outcomes and indicators for my program? When do I start tracking data? Logic Models, Data Collection and the like Who wants to read the report anyway?

3. Why is evaluating your program important?

4. Why is evaluating your program important? • The findings (data) and the logic model provide your agency with a communication tool; • Clarify the intended purpose of the program(s) and the agency’s mission; and help to focus staff • Improve the service delivery of the program by focusing on key tasks; • Identify effective practices within the program and/or agency; • Enhance record keeping system

5. OUTCOME FOCUSED GRANT-MAKING Traditional Outcomes -Focused How are people better off?

6. What do we really mean by Outcome Measurements?

8. Agency Outcome Measurement Is a system of evaluation that focuses on measuring the collective effect of an agency’s different programs on the participants. Community Outcome Measurement Is a system of evaluation that focuses on measuring the collective effect of programs, agencies and policies on a particular community. WHAT IS OUTCOME MEASUREMENT? Program Outcome Measurement Is a system of evaluation that focuses on measuring the effect of a program on the participants. Outcome Measurement Basics

9. PROGRAM OUTCOMES Individuals & Families Changes that occur for individuals in the program Direct Service Programs

10. COMMUNITY OUTCOMES Personal networks Organizations Individuals & families Neighborhood environments what happens to the whole system. Community systems

11. How do I identify the right outcomes and indicators for my program?

12. Which populations are we concerned about? • Populations • Children • Youth • Families • Communities • Places • Neighborhood • City • County • State

13. IDENTIFYING YOUR BIG GOAL & MAKING THE CONNECTION My program does Health Screenings. How do Health Screenings help people avoid ER visits? • Preventable ER Visits are – Emergency Room visits that are not for urgent health issues as well as those that are for conditions "for which good outpatient care can potentially prevent the need for hospitalization, or for which early intervention can prevent complications or more severe disease" (Agency for Healthcare Research and Quality AHRQ)

14. When do I start tracking data? Logic Models, Data Collection and the like

15. TERMS & DEFINITIONS Logic Model • An agreed upon path that links inputs, activities, outputs, and outcomes in a logical fashion. • A breakdown of the program “theory” into pieces – inputs, activities, outputs, and outcomes. • A diagram for explaining why we think our programs will have a positive effect on a person or group of people. Outcome Measurement Basics

16. TERMS & DEFINITIONS Inputs • Resources dedicated to or consumed by the program(s) within an agency and constraints on the agency • Financial Resources • Staff Skills • Funder Requirements Activities • What the agency does with the inputs to fulfill its mission – the program services • Feed and shelter homeless families • Discuss problems and barriers to employment Outputs The direct products of agency services – the results of the process • Number of classes taught • Number of disabled children in program Outcome Measurement Basics

17. TERMS & DEFINITIONS Outcomes Benefits or changes to individuals or populations during or after participating in agency activities • Programs often seek to change or improve: • Attitude • Skills • Behavior • Condition Outcome Measurement Basics

18. Overview of Key Terms Inputs - Resources dedicated to or consumed by the program(s) within an agency and constraints on the agency Activities - What the agency does with the inputs to fulfill its mission – the program services Outputs - The direct products of agency services – the results of the process Outcomes - Benefits or changes to individuals during or after participating in program activities Outcome Measurement Basics

19. Sample Logic Model

20. Road Trip How do you know if the kids are behaving? Outcome Measurement Basics

21. TERMS & DEFINITIONS Indicators The specific information that track a program’s success. It’s how you know something changed Traits of an Effective Indicator • Measurable • Meaningful • Manageable • Clear • As unbiased as possible • Sensitive to Change • Acceptable to Stakeholders Outcome Measurement Basics

22. SAMPLE INDICATORS Outcome Measurement Basics

23. Who wants to read the report anyway?

24. HOW DO WE MEASURE IMPACT/OUTCOMES/RESULTS Outcome-driven grant-making means focusing more on results that program participants achieve. Instead of focusing only on how much did a program do (touches) the focus on whether anyone is better off (outcomes)? 1. What did we do?(Quantity) 2. How well did we do it?(Quality) 3. Who is better off?(Impact/Outcomes)

25. MATRIX Quality Quantity How much did we do? How well did we do it? What difference did we make? Effect Effort

26. WHAT DO YOU MEAN BY BETTER OFF ? 1.Behaviors(#/% of participants who report to work on time) • Attitudes (Opinions)(#/% of participants who value seeking a degree) • Circumstances(#/% of participants who have a job at program completion) BACKS • Knowledge/Skills(#/% of individuals who have job increased skills)

27. HOW DO YOU MEASURE SUCCESS? Quality Quantity How much did we do? a.k.a. How well did we do it? What difference did we make? a.k.a. outcome Impact Long term indicators Effect Effort

28. Thank You Ginneh Baugh Sr. Director Measurement & Knowledge Development gbaugh@unitedwayatlanta.org 404-527-3563