RBA Results-Based Accountability

1. RBA Results-Based Accountability The Fiscal Policy Studies Instituteraguide.org & resultsaccountability.com Book &DVD Ordersamazon.comclearimpact.com SCORECARD

2. SIMPLE COMMON SENSE PLAIN LANGUAGE MINIMUM PAPER USEFUL

3. Population Accountabilityis about the well-being ofWHOLE POPULATIONS for Communities – Cities – Counties – States - Nations Performance Accountabilityis about the well-being ofCUSTOMER POPULATIONS for Programs – Agencies – Service Systems Results-Based Accountabilityis made up of two parts: Population Accountability 1. Performance Accountability 2.

4. Results-Based Accountability COMMON LANGUAGE COMMON SENSE COMMON GROUND

5. Common Language

6. THE LANGUAGE TRAPToo many terms. Too few definitions. Too little discipline Benchmark Outcome Result Modifiers Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic Indicator Goal Measure Objective Target Core qualitative strategic objectives Make up your own jargon. Measurable urgent systemic indicators Lewis Carroll Center for Language Disorders

7. RESULT or OUTCOME A condition of well-being for children, adults, families or communities. Population Population INDICATOR or BENCHMARK A measure which helps quantify the achievement of a result. PERFORMANCE MEASURE A measure of how well a program, agency or service system is working.Three types: Performance Performance DEFINITIONS RESULT 3. Children born healthy, Children ready for schoolSafe communities, A Healthy Green City, Prosperous Economy Children born healthy Children ready for school Safe communities Prosperous Economy A Healthy Green City INDICATOR 4. Rate of low-birthweight babies Rate of low-birthweight babies, Percent ready at K entry, crime rate, air quality index, unemployment rate Percent ready at K entry crime rate air quality index unemployment rate PERFORMANCE MEASURE 5. 6. How much did we do? 7. How well did we do it? 8. Is anyone better off? = Customer Results

8. Population Performance Customer result = Ends Service delivery = Means From Ends to Means From Talk to Action From Talk to Action RESULT ENDS INDICATOR PERFORMANCEMEASURE MEANS

9. IS IT A RESULT, INDICATOR OR PERFORMANCE MEASURE? 1.Safe Communities 2.Crime rate 3.Average police response time 4.People live in safe stable affordable housing 5.% spending >30% of income on housing 6.People have living wage jobs and income 7.% of people with living wage jobs and income 8.% of participants in job training who get living wage jobs Pop. RESULT Pop. INDICATOR Perf. MEASURE Pop. RESULT . . Pop. INDICATOR . . Pop. RESULT . . Pop. INDICATOR . . Perf. MEASURE . |

11. TRANSLATION Back to the Idea Translation Guide/Rosetta StoneNot the Language Police Ideas Group 1 Group 2 Group 3 etc. 1. A condition of well-being for children, adults, families & communities 2. 3. etc. RESULT OUTCOME GOAL

12. Results – Indicators – Performance Measures in Amharic, Cambodian, Laotian, Somali, Spanish, Tigrigna, Vietnamese

13. Searching for the 3rd L Leverage Latitude Levity The Three L’s of Successin any serious change effort 1. Leadership 2. Language Lithium Luggage

14. Population Accountability

15. Georgia Policy Councilfor Children and Families RESULTS ● Healthy Children ● Children Ready for School ● Children Succeeding in School ● Strong Families ●Self Sufficient Families

16. VERMONTPopulation Outcomes (Act 186) 1. Vermont has a prosperous economy. 2. Vermonters are healthy. 3. Vermont’s environment is clean and sustainable. 4. Vermont’s communities are safe and supportive. 5. Vermont’s families are safe, nurturing, stable, and supported. 6. Vermont’s children and young people achieve their potential. 7. Vermont’s elders and people with disabilities and people with mental conditions live with dignity and independence in settings they prefer. 8. Vermont has open, effective, and inclusive government at the State and local levels.

17. VERMONTPopulation Outcomes (Act 186) 1. Vermont has a prosperous economy. 2. Vermonters are healthy. 3. Vermont’s environment is clean and sustainable. 4. Vermont’s communities are safe and supportive. 5. Vermont’s families are safe, nurturing, stable, and supported. 6. Vermont’s children and young people achieve their potential. (A) Pregnant women and young people thrive. (B) Children are ready for school. (C) Children succeed in school. (D) Youth choose healthy behaviors. (E) Youth successfully transition to adulthood. 7. Vermont’s elders and people with disabilities and people with mental conditions live with dignity and independence in settings they prefer. 8. Vermont has open, effective, and inclusive government at the State and local levels.

18. CARDIFF, WALESCommunity Outcomes 1. People in Cardiff are healthy 2. Cardiff has a clean attractive and sustainable environment 3. People in Cardiff are safe and feel safe 4. Cardiff has a thriving and prosperous economy 5. People in Cardiff achieve their full potential. 6. Cardiff is a great place to live, work and play. 7. Cardiff has a fair, just and inclusive society.

19. Hillsborough Co.

20. NEW MEXICO DOH

24. Getting from TALK TO ACTION

25. Leaking Roof(Results thinking in everyday life) ? Fixed Experience Cm of WaterBASELINE Not OK Measure Turning the Curve Story behind the baseline (causes) Partners What Works Action Plan # 2 Action Plan

26. Results / Outcomes Indicators Experience Baseline & Story

27. Criteria forChoosing Indicatorsas Primary vs. Secondary Measures Communication Power Does the indicator communicate to a broad range of audiences? Proxy Power Does the indicator say something of central importance about the result? Does the indicator bring along the data HERD? Data Power Quality data available on a timely basis.

28. Choosing IndicatorsWorksheet Safe Community Outcome or Result_______________________ ProxyPower DataPower CommunicationPower Candidate Indicators Measure 1 Measure 2 Measure 3 Measure 4 Measure 5 Measure 6 Measure 7 Measure 8 H M L H M L H M L H H H H L H DataDevelopmentAgenda

29. Three Part Indicator List for each Result Part 1: Primary Indicators ● 3 to 5 “Headline” Indicators● What this result “means” to the community● Meets the Public Square Test Part 2: Secondary Indicators ● Everything else that’s any good (Nothing is wasted.)● Used later in the Story behind the Curve Part 3: Data Development Agenda ● New data● Data in need of repair (quality,timeliness etc.)

30. H M L The Matter of Baselines OK? Point to Point Turning the Curve Forecast History Baselines have two parts: history and forecast

31. 75 people per day 45 people per day MADD 28 people per day 2010

33. Rebound

39. Hull, UK"Woundings"

40. 2 …and it had a timely relationship to…. 3 …. a turn in the curve. Alternative to Traditional Evaluation Methods:DEMONSTRATING the CONTRIBUTIONof complex change efforts… requires 3 elements: Bonus: a background trend stayed the same or got worse. 4 A Curve to Turn 1 We tried a bunch of stuff that had a credible chance of making a difference … c FPSI

41. Rebound

42. “If I include you,you will be my partner. If I exclude you,you will be my judge.” - Rosell

43. Performance Accountability

44. “All performance measures that have ever existed for any program in the history of the universe involve answering two sets of interlocking questions.”

45. Performance Measures Quality Quantity HowWell did we do it? ( % ) HowMuch did we do? ( # )

46. Performance Measures Effort How hard did we try? Effect Is anyone better off?

47. Effort HowWell HowMuch Effect Performance Measures

48. Performance Measures Quality Quantity How welldid we deliver it? How much service did we deliver? Effect Effort Output Input How much change / effect did we produce? What quality of change / effect did we produce?

49. Performance Measures Quality Quantity How welldid we do it? How much did we do? Effect Effort Is anyonebetter off? # %

50. Education Quality Quantity How well did we do it? How much did we do? Student-teacherratio Number ofstudents Effect Effort Is anyone better off? Number ofhigh schoolgraduates Percent ofhigh schoolgraduates