Results Based Accountability Basics A One Day Presentation

1. Results Based Accountability BasicsA One Day Presentation Standard Training Slides Sponsored by the Ministry of Social Development

2. Results Based Accountability The Fiscal Policy Studies Institute Santa Fe, New Mexico Websites raguide.orgresultsaccountability.com Book - DVD Orderssheapita.co.nz amazon.comresultsleadership.org

3. How could RBA add value to you?

4. SIMPLE STEPS COMMON SENSE PLAIN LANGUAGE MINIMUM PAPER TALK TO ACTION!

5. Results Based Accountabilityis made up of two parts: Population Accountabilityabout the wellbeing ofWHOLE POPULATIONS For Communities – Cities – Districts – Countries E.g. All Rangatahi/Youth in Te Tai Tokerau, All Migrants in Nelson Performance Accountabilityabout the wellbeing ofCLIENT GROUPS/CUSTOMERS For Teams - Providers – Programmes - Agencies – Service Systems E.g. Clients of Services, Collectives, Ministries or the Health System

6. The Language TrapToo many terms. Too few definitions. Too little discipline Benchmark Outcome Result Modifiers Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic Indicator Goal Measure Objective Target Lewis Carroll Center for Language Disorders Core qualitative strategic objectives Your made up jargon here Measurable urgent systemic indicators

7. ResultsBased Accountability COMMON LANGUAGE COMMON SENSE COMMON GROUND

8. RESULT / OUTCOME A condition of wellbeing for children, adults, families or communities All Tamariki in Hamilton are Born Healthy,Safe Roads, Nurturing Whānau/Families, A Prosperous Economy INDICATOR / BENCHMARK A measure which helps quantify the achievement of a result. Rate of low-birth weight babies,Rate of road crashes, Rate of child abuse and neglect, Unemployment rate PERFORMANCE MEASURE A measure of whether a programme, agency or service system is working. Three types How much did we do? How well did we do it? Is anyone better off? = Client Results / Outcomes Definitions Population Performance

9. TRANSLATION Back to the Idea Translation Guide/Rosetta StoneNot the Language Police Ideas Group 1 Group 2 Group 3 etc. 1. A condition of well-being for children, adults, families & communities 2. 3. etc. RESULT OUTCOME GOAL

10. Client /Customer result = Ends Service delivery = Means From Ends to Means From Talk to Action RESULT / OUTCOME ENDS Population INDICATOR / BENCHMARK PERFORMANCEMEASURE MEANS Performance

11. Results – Indicators – Performance Measures in Maori, Fijian, Tuvaluan

12. Result, Indicator, Strategy or Performance Measure? Result Indicator Perf Measure Result Strategy Result Indicator Perf Measure A Safe Community Percentage of Total Recorded Offences Average Police response time An Educated Workforce Installing street lights to make people feel safe People have living wage jobs and income % of people with living wage jobs and income % of participants in job training programme who get living wage jobs

13. Key RBA concepts • 2key types of accountability and language discipline: • Population accountability - results / outcomes and indicators • Performance accountability - performance measures • 3types of performance measures: • How much did we do? • How well did we do it? • Is anyone better off? • 7questions from ends to means: • baselines and turning the curve – to make life better for our families / whānau, children / tamariki, and communities.

14. Population Accountability For whole populations in a geographic area Mark Friedman (author)www.resultsaccountability.comwww.raguide.org

15. The 7Population Accountability Questions • What are the quality of life conditions we want for the children, adults and families who live in our community? (Population & Results) • What would these conditions look like if we could see them? (Experience) • How can we measure these conditions? (Population Indicators) • How are we doing on the most important of these measures? (Baseline Data and Story) • Who are the partners that have a role to play in doing better? (Partners) • What works to do better including no- cost and low-cost ideas? (What works) • What do we propose to do? (Action Plan)

16. 16

17. Christchurch City Community Outcomes • A safe city • A city of inclusive and diverse communities • A city of people who value and protect the natural environment • A well governed city • A prosperous city • A healthy city • A city of recreation, fun and creativity • A city of lifelong learning • A city that is attractive and well designed

18. Kotahitanga Whānau Ora Collective All whaanau in Te Puuaha ki Manuka(Greater South Auckland) are ... Mana Ora: Healthy and safe; Mana Motuhake: Economically secure; Mana Tangata: Culturally confident; Mana Rangatiratanga: Knowledgeable and skilled; Mana Whānau: Connected, engaged and entrepreneurs positive statements - positive focus Acknowledgement: Kotahitanga Collective Members: Turuki Healthcare Trust, Papakura Marae, Huakina Development Trust and Te Kaha O Te Rangatahi Trust, South Auckland, New Zealand.

19. Aranui Community Trust Acknowledgement: Aranui Community Trust Inc Society (www.actis.org.nz)

20. Implementing RBA Aranui Result areas and indicators A community full of knowledge and learning Indicator: % of students with NCEA level 1 @year 11 % primary school students performing at national average for literacy and numeracy Result Area 1: A community that is spiritually and socially strong Indicator: % of police callouts for family violence Result Area 2:

21. Result Area 3: A great physical environment Indicator: Expenditure on repairs and maintenance to city property in the Aranui Burwood Pegasus area % of $ R & M that is due to damage Result Area 4: People who know and fit in Aranui Indicator: % of people who offer to participate in local events

22. Result Area 5: A community that is healthy Indicator: % of Aranui residents presenting at Accident and Emergency with no trauma needs/ concerns # of total acute inpatient admissions

23. Results for Children, Families and CommunitiesA Working List • Healthy Births • Healthy Children and Adults • Children Ready for School • Children Succeeding in School • Young People Staying Out of Trouble • Stable Families • Families with Adequate Income • Safe and Supportive Communities 23

24. Georgia Policy Council for Children and Families RESULTS • Healthy children • Children ready for school • Children succeeding in school • Strong families • Self-sufficient families 24

25. Tip for Drafting Population Accountability Results All ______ in ______ are __________ Families Tauranga Economically Secure Insert your Population Insert your Geographic area Insert your Condition of Wellbeing 25

26. Examples of MeansnotEnds 1. COLLABORATION 2. SYSTEMS REFORM 3. SERVICE INTEGRATION 4. DEVOLUTION 5. FUNDING POOLS 26

27. ? Fixed Leaking Roof(Results thinking in everyday life) Experience: Not OK Inches of Water Measure: Turning the Curve Story behind the baseline (causes): Partners: What Works: Action Plan: #2 Action Plan: 27

28. 3 criteria for choosing Indicators Communication Power Does the indicator communicate to a broad range of audiences? Proxy Power Does the indicator say something of central importance about the result? Does the indicator bring along the data HERD? Data Power Quality data available on a timely basis. 28

29. Choosing IndicatorsWorksheet Safe Community Outcome or Result_______________________ ProxyPower DataPower CommunicationPower Candidate Indicators Measure 1 Measure 2 Measure 3 Measure 4 Measure 5 Measure 6 Measure 7 Measure 8 H M L H M L H M L H H H H L H DataDevelopmentAgenda

30. Three Part Indicator List for each Result Part 1: Primary Indicators • 3 to 5 “Headline” Indicators • What this result “means” to the community • Meets the Public Square Test Part 2: Secondary Indicators • Everything else that’s any good (Nothing is wasted.) • Used later in the Story behind the Curve Part 3: Data Development Agenda • New data • Data in need of repair (quality, timeliness etc.) 30

31. H M L What do we mean by a baseline? OK? Point to Point Turning the Curve Forecast History Baselines have two parts: history and forecast 31

32. Indicator Reports Neighbourhood Country City KruidenbuurtTilburg, Netherlands New Zealand Portsmouth, UK

33. MADD 33

34. Key RBA concepts • 2key types of accountability: • Population – results / outcomes and indicators • Performance – performance measures • 3types of performance measures: • How Much Did We Do? • How Well Did We Do It? • Is Anyone Better Off? • 7questions that take you from talk to action • From Ends to Means:Change our thinking and approach - from what we do, to what we achieve

35. Population Accountability quick exercise

36. Tip for Drafting Population Accountability Results All ______ in ______ are __________ How would you experience this outcome? What would be different? Insert your Geographic area How would you measure success? What Indicator would you use? Insert your Population Insert your Condition of Wellbeing

37. Performance Accountability For clients of programmes, agencies, teams and service systems Mark Friedman (author)www.resultsaccountability.comwww.raguide.org

38. Results Based Accountabilityis made up of two parts: Population Accountabilityabout the wellbeing ofWHOLE POPULATIONS For Communities – Cities – Districts – Countries E.g. All Rangatahi/Youth in Te Tai Tokerau, All Migrants in Nelson Performance Accountabilityabout the wellbeing ofCLIENT GROUPS/CUSTOMERS For Teams - Providers – Programmes - Agencies – Service Systems E.g. Clients of Services, Collectives, Ministries or the Health System

39. The 7Performance Accountability Questions • Who are our clients? (Client Group/Customers) • How can we measure if our clients are better off? (Client/Customer Result / Outcome) • How can we measure if we are delivering services well? (Quality Measures) • How are we doing on the most important of these measures? (Baseline Data and Story) • Who are the partners that have a role to play in doing better? (Partners) 6. What works to do better including no-cost and low cost ideas? (Common sense ideas & research where available) • What do we propose to do? (Action Plan)

40. Performance AccountabilityGetting from talk to action Client Group/Customers

41. “All performance measures that have ever existed for any programme in the history of the universe involve answering two sets of interlocking questions.”

42. Performance Measures Quantity Quality HowMuch did we do? ( # ) HowWell did we do it? (%)

43. Performance Measures Effort How hard did we try? Effect Anyone better off?

44. Performance Measures Effort HowWell HowMuch Effect

45. Performance Measures Quantity Quality How welldid we deliver it? How much service did we deliver? Effect Effort Output Input How much change / effect did we produce? What quality of change / effect did we produce?

46. # of clients who move off a working age benefit and into employment (at 6 months and at 12 months) Social Services Example Quantity Quality How well did we do it? How much did we do? % clients who complete the job training / mentoring programme # of young people (clients) receiving job training / mentoring services Effect Effort Is anyone better off? % of clients who move off a working age benefit and into employment (at 6 months and at 12 months)

47. Education example Quantity Quality How well did we do it? How much did we do? Student-teacherratio Number ofstudents Effect Effort Is anyone better off? Number ofgraduates Percent ofgraduates

48. Drug/Alcohol Treatment Programme Quality Quantity How well did we do it? How much did we do? Percent ofstaff withtraining/certification Number ofpersonstreated Effect Effort Is anyone better off? Number of clientsoff of alcohol & drugs- at exit - 12 months after exit Percent of clientsoff of alcohol & drugs- at exit - 12 months after exit

49. Number of secondary school students whograduate on timeand enter Uni oremployment after graduation Education example # 2 Quality Quantity How well did we do it? How much did we do? Student-teacherratio Number ofstudents Effect Effort Is anyone better off? Percent of secondary school students whograduate on timeand enter Uni oremployment after graduation

50. #childrenaged 8 monthsimmunised(in the practice) %childrenaged 8 monthsimmunised(in the practice) Primary Care Practice Quality Quantity How well did we do it? How much did we do? Percent ofchildren who did not attend Number ofchildren aged 0-2 enrolled Effect Effort Is anyone better off?