RBA

1. RBA Results-Based Accountability The Fiscal Policy Studies Institute raguide.org & resultsaccountability.com SCORECARD Book &DVD Orders amazon.com clearimpact.com

2. SIMPLE COMMON SENSE PLAIN LANGUAGE MINIMUM PAPER USEFUL

3. Results-Based Accountability is made up of two parts: 1. Population Accountability 1. Population Accountability is about the well-being of WHOLE POPULATIONS for Communities – Cities – Counties – States - Nations 2. Performance Accountability is about the well-being of CUSTOMER POPULATIONS 2. Performance Accountability for Programs –Agencies – Service Systems CA/CN

4. Results-Based Accountability COMMON LANGUAGE COMMON SENSE COMMON GROUND

5. Common Language

6. THE LANGUAGE TRAP Too many terms. Too few definitions. Too little discipline Benchmark Outcome Result Modifiers Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic Indicator Goal Measure Objective Target Measurable urgent systemic indicators Core qualitative strategic objectives Make up your own jargon. Lewis Carroll Center for Language Disorders

7. DEFINITIONS RESULT or OUTCOME A condition of well-being for children, adults, families or communities. Children born healthy RESULT 3. Children born healthy, Children ready for school Safe communities, Sustainable environment, Prosperous Economy Safe communities Sustainable environment Children ready for school Population Population Prosperous Economy INDICATOR 4. INDICATOR or BENCHMARK A measure which helps quantify the achievement of a result. Rate of low-birthweight babies Percent ready at K entry Rate of low-birthweight babies, Percent ready at K entry, crime rate, air quality index, unemployment rate crime rate air quality index unemployment rate PERFORMANCE MEASURE A measure of how well a program, agency or service system is working. Three types: PERFORMANCE MEASURE 5. Performance Performance 6. How much did we do? 7. How well did we do it? 8. Is anyone better off? = Customer Results

8. From Ends to Means From Talk to Action From Talk to Action RESULT Population ENDS INDICATOR PERFORMANCE MEASURE Performance MEANS Customer result = Ends Service delivery = Means

9. IS IT A RESULT, INDICATOR OR PERFORMANCE MEASURE? 1. Safe Community RESULT 2. Crime rate INDICATOR 3. Average police response time PERF. MEASURE 4. Healthy People RESULT 5.% of youth overweight or obese INDICATOR 6. People have living wage jobs and income RESULT 7. % of people with living wage jobs and income INDICATOR 8.% of participants in job training who get living wage jobs PERF. MEASURE |

11. Translation Guide/Rosetta Stone Not the Language Police Group 1 Group 2 Group 3 Ideas etc. 1. A condition of well-being for children, adults, families & communities RESULT OUTCOME GOAL TRANSLATION Back to the Idea 2. 3. etc.

12. Results – Indicators – Performance Measures in Amharic, Cambodian, Laotian, Somali, Spanish, Tigrigna, Vietnamese

13. Population Accountability

14. Georgia Policy Council for Children and Families RESULTS ● Healthy Children ● Children Ready for School ● Children Succeeding in School ● Strong Families ● Self Sufficient Families

15. CARDIFF, WALES Community Outcomes 1. People in Cardiff are healthy 2. Cardiff has a clean attractive and sustainable environment 3. People in Cardiff are safe and feel safe 4. Cardiff has a thriving and prosperous economy 5. People in Cardiff achieve their full potential. 6. Cardiff is a great place to live, work and play. 7. Cardiff has a fair, just and inclusive society.

16. VERMONT Population Outcomes (Act 186) 1. Vermont has a prosperous economy. 2. Vermonters are healthy. 3. Vermont’s environment is clean and sustainable. 4. Vermont’s communities are safe and supportive. 5. Vermont’s families are safe, nurturing, stable, and supported. 6. Vermont’s children and young people achieve their potential. 7. Vermont’s elders and people with disabilities and people with mental conditions live with dignity and independence in settings they prefer. 8. Vermont has open, effective, and inclusive government at the State and local levels.

23. Getting from Talk to Action

24. Leaking Roof (Results thinking in everyday life) Experience Cm of Water 9. BASELINE Not OK Measure ? Fixed 10. Turning the Curve Story behind the baseline (causes) Partners What Works Action Plan Action Plan # 2

25. Results / Outcomes Experience Indicators Baseline & Story

26. Criteria for Choosing Indicators as Primary vs. Secondary Measures Communication Power Does the indicator communicate to a broad range of audiences? Proxy Power Does the indicator say something of central importance about the result? Does the indicator bring along the data HERD? Data Power Quality data available on a timely basis.

27. Choosing Indicators Worksheet Outcome or Result_______________________ Safe Community Proxy Power Data Power Communication Power Candidate Indicators Measure 1 H M L H M L H M L Measure 2 H H H H L Measure 3 Measure 4 H Measure 5 Measure 6 Data Development Agenda Measure 7 Measure 8

28. Three Part Indicator List for each Result Part 1: Primary Indicators ● 3 to 5 “Headline” Indicators ● What this result “means” to the community ● Meets the Public Square Test Part 2: Secondary Indicators ● Everything else that’s any good (Nothing is wasted.) ● Used later in the Story behind the Curve Part 3: Data Development Agenda ● New data ● Data in need of repair (quality,timeliness etc.)

29. The Matter of Baselines H OK? M L Point to Point Turning the Curve Forecast History Baselines have two parts: history and forecast

30. Alcohol-Related Traffic Fatalities United States 1975 to 2005 30 75 people per day 25 45 people per day 20 Thousands 15 MADD 10 28 people per day 5 0 1980 1982 1990 2000 1975 2005 2010 Source 1982 to 2005: Actual data from the NHTSA Fatality Analysis Reporting System (FARS) Source 1975 to 1981: Estimate based on NHTSA data on % of fatality drivers with BAC of .10 or greater.

32. Rebound

33. Newcastle, UK Nov 08 – Jan 09 8.5

38. Hull, UK "Woundings"

39. “If I include you, you will be my partner. If I exclude you, you will be my judge.” - Rosell

40. Performance Accountability

41. “All performance measures that have ever existed for any program in the history of the universe involve answering two sets of interlocking questions.”

42. Performance Measures Quality Quantity How Well How Much did we do it? did we do? ( % ) ( # )

43. Performance Measures Effort How hard did we try? Effect Is anyone better off?

44. Performance Measures Effort How Well How Much Effect

45. Performance Measures Quality Quantity How well did we deliver it? How much service did we deliver? Effect Effort Output Input How much change / effect did we produce? What quality of change / effect did we produce?

46. Performance Measures Quality Quantity How well did we do it? How much did we do? Effect Effort Is anyone better off? # %

47. Education Quality Quantity How well did we do it? How much did we do? Student-teacher ratio Number of students Effect Effort Is anyone better off? Number of high school graduates Percent of high school graduates

48. Education Quality Quantity How well did we do it? How much did we do? Student-teacher ratio Number of students Effect Effort Is anyone better off? Percent of 9thgraders who graduate on time and enter college or employment after graduation Number of 9thgraders who graduate on time and enter college or employment after graduation

49. Pediatric Practice Quality Quantity How well did we do it? How much did we do? Percent of patients waiting less than 30 min in the waiting room Number of children treated Effect Effort Is anyone better off? # % children fully immunized (in the practice) children fully immunized (in the practice)

50. Drug/Alcohol Treatment Program Quality Quantity How well did we do it? How much did we do? Percent of staff with training/ certification Number of persons treated Effect Effort Is anyone better off? Number of clients off of alcohol & drugs - at exit - 12 months after exit Percent of clients off of alcohol & drugs - at exit - 12 months after exit