Program Outcomes & Logic Models

1. Program Outcomes &Logic Models United Way of Blair County February 6, 2013 Presented by: Robin Beck, CPO, United Way of Blair County

2. What is Outcome Measurement? • Outcome measurement is a process for the ongoing monitoring of the results of an organization or program against agreed upon goals and objectives Community Impact Training

3. Why Measure Outcomes? • To see if programs really make a difference in the lives of people. • To help programs improve services. • To provide a clear definition of the programs work. • To improve effectiveness in helping clients. • Target services for growth and expansion. Community Impact Training

4. Program Outcome Model • A flow chart which depicts the logical relationship between program activities and the changes expected to occur as a result of these activities. • IF—THEN, IF—THEN, IF—THEN Community Impact Conference

5. Key Terms • Input: A resource dedicated to or consumed by a program • Activity: Type of service the program provides to fulfill its mission. What the program does with the inputs—how it goes about transforming them into products. • Output: The direct product of program operation. • Outcome: Benefit to participants during or after participating in the program. • Indicator: Identifies what is being measured to track the program’s success on an outcome. Indicators are specific and measureable pieces of information that show the outcome is occurring. They will be shown as aggregate data gathered on a group of individuals. • Target: The desired level of achievement of a program on its indicators Community Impact Conference

6. Program Outcome Model INPUTS ACTIVITES OUTPUTS OUTCOMES • Resources • money • staff • volunteers • equipment & supplies Constraints • laws • regulations • funder requirements • Services • shelter • training • education • counseling • mentoring • Products • classes taught • counseling sessions conducted • educational materials distributed • hours of service delivered • participants served • Benefits for People • New knowledge • Increased skills • Changed attitudes or values • Modified behavior • Improved condition • Altered status Community Impact Training

7. Immediate Outcomes Intermediate Outcomes Long-Term Outcomes First benefits or changes participants experience Link initial changes to longer-term outcomes Ultimate outcome a program desires for participants Levels of Outcomes Community Impact Training

8. Keep Expectations Modest • Outcome findings will not tell you: • Whether the program caused the outcome • Why this level of outcome was achieved • What actions can be taken to improve the outcome Community Impact Training

9. Outcome Indicator • The specific item of information that tracks a program’s success on an outcome • Identifies the characteristic or change that signals that an outcome has been achieved • Is observable and measurable • Usually is expressed as number and percent of participants achieving the outcome Community Impact Training

10. Program Outcome Criteria • For each outcome: • Is it reasonable to think the program can influence the outcome in a non-trivial way, even though it can’t control it? • Would measurement of the outcome help identify program successes and pinpoint problems? • Will the program’s various “publics” accept this as a valid outcome of the program? • For the set of outcomes: • Do they reflect the program logic—the chain of changes program outputs are intended to set in motion for participants? • Do the longer-term outcomes represent meaningful benefits or changes in participants’ condition or quality of life • Are potential negative outcomes identified? Community Impact Training

11. Issues in Defining Outcomes • There is not a right number of outcomes for a program • Some programs may have more than one “outcome track” • For some programs, initial outcomes may be closer to outputs • The more immediate the outcome, the more influence the program has on its achievements • The longer the outcome, the less direct the influence a program has on the outcome and the more chance an outside influence can be involved • A program’s outcomes should not go beyond the scope of its target audience Community Impact Training

12. Program Outcomes vs. Community Outcomes • Program Outcomes: Changes that program activities intend to create in program participants • Community Outcomes: Changes in a defined community population brought about by changing conditions in the community Community Impact Training

13. Program to Community Outcomes • How do program outcomes relate to community outcomes and community level change? Community Impact Conference

14. Program to Community Outcomes • Some early assumptions that were made: • Funding programs with good outcomes will produce community outcomes • Funding programs whose outcomes align with community goals will produce community outcomes • Aggregating program outcome data will provide community outcome data Community Impact Training

15. Community Outcomes Focused on by United Way of Blair County • Education: “We envision a Blair County where children and youth achieve their potential.” • Health:“We envision a Blair County where young and old alike are physically and mentally healthy.” • Income:“We envision a Blair County where individuals and families attain financial stability and independence.” • Meeting Emergency Needs: “We envision a Blair County where there is a safety net for those experiencing emergencies.” Community Impact Conference

16. Questions and Answers Community Impact Training