Outcome Based Accountability

1. Outcome Based Accountability

2. Mark Friedman Fiscal Policy Studies Institute Sante Fe, New Mexico www.resultsbasedaccountabilty.com www.raguide.com www.trafford.com

3. Purpose • Improve outcomes • Offer a partnership way of working that helps move from: • outcomes to needs analysis • to inter-agency service planning and development • to joint commissioning.

4. Why is it so good? • Adopted by government agencies (including IdEA) • Widely used in the US • Used within many local authorities already • Simple, flexible • Common language, common sense, common ground

5. Outcome Accountabilityis made up of two parts: Population Accountability about the well-being of WHOLE POPULATIONS for neighbourhoods – districts – regions - countries Performance Accountability About the well-being of CLIENT POPULATIONS for projects – agencies – service providers

6. Definitions Outcomes Indicators Performance Measures

7. Definition: OUTCOMES “A condition of well-being for children, adults, families or communities.” • Children born healthy • Children succeeding in school • Safe communities • Clean Environment • Prosperous Economy Stated in plain language that people can understand Not about government jargon “A condition of well-being for people in a place......” E.g. “All Babies in xxx are born healthy”

8. Every Child Matters Outcomes Being Healthy: enjoying good physical and mental health and living a healthy lifestyle. Staying Safe: being protected from harm and neglect and growing up able to look after themselves. Enjoying and Achieving: getting the most out of life and developing broad skills for adulthood. Making a Positive Contribution: to the community and to society and not engaging in anti-social or offending behaviour. Economic Well-being: overcoming socio-economic disadvantages to achieve their full potential in life.

9. Definition: INDICATORS A measure which helps quantify the achievement of an outcome. • Rate of low birth weight babies • Key stage test scores • Burglary rate • Air quality index • Life expectancy rates How would we recognise these outcomes in measurable terms if we tripped over them? E.g. Low burglary rate helps to quantify a safe community

10. Definition: PERFORMANCE MEASURES A measure to evaluate how well a programme, agency or service system is working. Performance measures tell us how well service providers are working as opposed to the impact on whole populations (i.e. outcomes)

11. “All Performance Measures that have ever existed for any program in the history of the universe involve answering two sets of interlocking questions….”

12. Programme Performance Measures QUANTITY QUALITY How Much did we do? (number) How Well did we do it? (percent)

13. Programme Performance Measures Effort How hard did we try? Effect Is anyone any better off?

14. Mark Friedman

15. Programme Performance Measures Effort How hard did we try? Effect Is anyone any better off?

16. Identifying Performance Measures QUANTITY QUALITY How much did we do? How well did we do it? Number of customers served (by customer characteristic) Number of Activities (by type of activity) % Common Measures % Activity measures EFFORT Is anyone better off? (Skills/knowledge; attitude/opinion; behaviour; circumstances) (Quantity) (Percentage) EFFECT

17. From ends to means... OUTCOMES “A condition of well-being for children, adults, families or communities” Population Accountability ENDS INDICATORS “A measure which helps quantify the achievement of an outcome” PERFORMANCE MEASURES “A measure to evaluate how well a programme, agency or service system is working” Performance Accountability MEANS

18. MEANS not ENDS: Collaboration (eg Local Strategic Partnership) System Reform (eg Progressing Integration Project) Service Integration (eg Children’s Trusts) Funding pools (eg Pooled Budgets) Strategies and Plans (eg Sustainable Community Strategy, Children and Young People Plan, Local Area Agreement) (to improving outcomes) (in themselves)

19. The Leaking Roof Experience Measure Forecast Inches of Water Time Story behind the baseline (causes) Partners What Works? Action Plan (Strategy)

20. OUTCOME “Children Being Healthy” • Infant mortality rate • Use of Class A Drugs • % Teenage Smokers Measures of the outcome INDICATORS BASELINES • Where we’ve been • Where we’re going • Where we want to be Data Development Agenda (Pt 1) • The causes, the forces at work • What’s driving the baselines? STORY Behind the baselines • Public, Private and Voluntary Sector • Community groups • Residents PARTNERS With a role to play • What would it take to turn the curve? • Best practice • Best hunches WHAT WORKS Data Development Agenda (Pt 2) ACTION PLAN • What we propose to do, how and by when

21. Using The Framework

22. The Linkage between Population and Customer Outcomes POPULATION ACCOUNTABILITY Being Healthy Rate of low birth-weight babies Staying Safe Rate of Child Abuse and Neglect Enjoying and Achieving % with five GCSEs Grade A-C POPULATION OUTCOMES Contribution Relationship Alignment of Measures PERFORMANCE ACCOUNTABILITY Child Protection Service Appropriate Responsibility % initiated within 24 hours of report No. of Investigations completed No. of repeat abuse/neglect cases % of repeat abuse/neglect cases CUSTOMER OUTCOMES

23. Turning the curve ANDNarrowing the gap • Improving outcomes for vulnerable populations • Use the “turning the curve” templates to narrow the gap.

24. Narrowing The Gap “Backcasting” Where have we been? Forecasting Where are we going? Not OK? Vulnerable group Indicator Result The curve to turn: bigger for vulnerable groups to narrow the gap All C&YP PAST NOW FUTURE Good performance is low