1 / 66

Minnesota DHS

Minnesota DHS. Results Accountability Training. Results Accountability. The Fiscal Policy Studies Institute • Santa Fe, NM. Overview. Agenda 1 day overview Handouts http://www.ronmirr.com Performance measure for today’s session

zarek
Download Presentation

Minnesota DHS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Minnesota DHS Results Accountability Training

  2. Results Accountability The Fiscal Policy Studies Institute • Santa Fe, NM

  3. Overview • Agenda • 1 day overview • Handouts • http://www.ronmirr.com • Performance measure for today’s session • Increased knowledge of how to measure your program’s performance

  4. Who are you? • Program name • Target population • List of services

  5. Quiz

  6. Ernest Rutherford, Physicist "Gentlemen we have no money, therefore we must think.”

  7. How do you “do” results? • Simple • Common Sense • Plain Language • Minimum Paper • Useful

  8. Population Accountabilityabout the well-being ofWhole Populations Communities – Cities – Counties – States - Nations Performance Accountabilityabout the well-being ofClient Populations Programs – Agencies – and Service Systems Results Accountability has 2 parts

  9. Results Accountability • Common Language • Common Sense • Common Ground

  10. THE LANGUAGE TRAPToo many terms. Too few definitions. Too little discipline Benchmark Outcome Result Modifiers Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic Indicator Goal Measure Objective Target Core qualitative strategic objectives Your made up jargon here Measurable urgent systemic indicators Lewis Carroll Center for Language Disorders

  11. Result or Outcome A condition of well-being for children, adults, families or communities. Population Indicator or Benchmark A measure which helps quantify the achievement of a result. How we know we achieve the result. Performance Measure A measure of how well a program, agency or service system is working.Three types: Performance Definitions Children born healthy, Children ready for school, Safe communities, Clean Environment, Prosperous Economy Children born healthy Children ready for school Clean Environment Prosperous Economy Safe communities Rate of low-birthweight babies, Percent ready at K entry, crime rate, air quality index, unemployment rate Rate of low-birthweight babies Percent ready at K entry crime rate air quality index unemployment rate 1. How much did we do? 2. How well did we do it? 3. Is anyone better off? = Customer Results

  12. Population Performance Customer result = Ends Service delivery = Means From Ends to Means From Talk to Action From Talk to Action Result or Outcome Ends Indicator or Benchmark Performance Measure Means

  13. Is it a result, indicator or performance measure? 1. Safe Community 2. Crime Rate 3. Average Police Dept response time 4. An educated workforce 5. Adult literacy rate 6. People have living wage jobs and income 7. % of people with living wage jobs and income 8. % of participants in job training who get living wage jobs Result Indicator Perf. Measure Result Indicator Result Indicator Perf. Measure

  14. Performance Accountability

  15. ? Fixed Experience: Not OK Inches of Water Measure: Turning the Curve Story behind the baseline (causes): Partners: Leaking Roof(Results thinking in everyday life) What Works: Action Plan:

  16. “All performance measures that have ever existed for any program in the history of the universe involve answering two sets of interlocking questions.”

  17. Performance Measures Quality Quantity HowWell did we do it? ( % ) HowMuch did we do? ( # )

  18. Performance Measures Effort How hard did we try? Effect Is anyone better off?

  19. Effort HowWell HowMuch Effect Performance Measures

  20. Performance Measures Quality Quantity How welldid we deliver it? How much service did we deliver? Effect Effort Output Input How much change / effect did we produce? What quality of change / effect did we produce?

  21. Education Quality Quantity How well did we do it? How much did we do? Student-teacherratio Number ofstudents Effect Effort Is anyone better off? Number ofhigh schoolgraduates Percent ofhigh schoolgraduates

  22. Percent of 9th graders whograduate on timeand enter college oremployment after graduation Number of 9th graders whograduate on timeand enter college oremployment after graduation Education Quality Quantity How well did we do it? How much did we do? Student-teacherratio Number ofstudents Effect Effort Is anyone better off?

  23. #childrenfullyimmunized(in the practice) %childrenfullyimmunized(in the practice) Pediatric Practice Quality Quantity How well did we do it? How much did we do? % ofpatients treatedin less than1 hour Number ofpatientstreated Effect Effort Is anyone better off?

  24. Drug/Alcohol Treatment Program Quality Quantity How well did we do it? How much did we do? Percent ofstaff withtraining/certification Number ofpersonstreated Effect Effort Is anyone better off? Number of clientsoff of alcohol & drugs- at exit - 12 mos. after exit Percent of clientsoff of alcohol & drugs- at exit - 12 mos. after exit

  25. Fire Department Quality Quantity How well did we do it? How much did we do? ResponseTime # ofresponses Effect Effort Is anyone better off? # of fireskept toroom of origin % of fireskept toroom of origin

  26. Importance • Which quadrant is mostimportant? • Which quadrant is leastimportant? • Why? Upper Right How well did we deliver it? Upper Left How much service did we deliver? Lower Right What quality of change / effect did we produce? Lower Left How much change / effect did we produce?

  27. Not All Performance Measures Are Created Equal Quality Quantity How well did we do it? How much did we do? LeastImportant Least AlsoVery Important Effect Effort Is anyone better off? MostImportant Most

  28. The Matter of Control Quality Quantity How well did we do it? How much did we do? MostControl Effect Effort Is anyone better off? LeastControl PARTNERSHIPS

  29. Program Performance Measures 3 Quality Quantity How welldid we do it? How much did we do? Effect Effort Is anyonebetter off? # %

  30. % Common measures e.g. client staff ratio, workload ratio, staffturnover rate, staff morale, % staff fully trained, % clients seen in their own language,worker safety, unit cost % Activity-specific measures e.g. % timely, % clients completing activity, % correct and complete, % meeting standard % Skills / Knowledge (e.g. parenting skills) # % Attitude / Opinion (e.g. toward drugs) # Point in Time vs. Point to Point Improvement % Behavior (e.g.school attendance) # % Circumstance (e.g. working, in stable housing) # Separating the Wheat from the ChaffTypes of Measures Found in Each Quadrant How well did we do it? How much did we do? # Clients/customers served # Activities (by type of activity) Is anyone better off?

  31. Performance Measures Quality Quantity How well did we do it? How much did we do? # Measure 1 ---------------------------- # Measure 2 ---------------------------- # Measure 3 ---------------------------- # Measure 4 ---------------------------- # Measure 5 ---------------------------- # Measure 6 ---------------------------- # Measure 7 ---------------------------- % Measure 8 ---------------------------- % Measure 9 ----------------------------- % Measure 10 --------------------------- % Measure 11 --------------------------- % Measure 12 --------------------------- % Measure 13 --------------------------- % Measure 14 --------------------------- Effect Effort Is anyone better off? # Measure 15 ---------------------------- # Measure 16 ---------------------------- # Measure 17 ---------------------------- # Measure 18 ---------------------------- # Measure 19 ---------------------------- # Measure 20 ---------------------------- # Measure 21 ---------------------------- % Measure 15 ---------------------------- % Measure 16 ---------------------------- % Measure 17 ---------------------------- % Measure 18 ---------------------------- % Measure 19 ---------------------------- % Measure 20 ---------------------------- % Measure 21 ----------------------------

  32. Point in Time vs. Point to Point Improvement Complete Upper Left Sheet 4 Chart How much did we do? # Clients/customersserved # Activities (by type)

  33. % Common measures e.g. client staff ratio, workload ratio, staffturnover rate, staff morale, % staff fully trained, % clients seen in their own language,worker safety, unit cost Point in Time vs. Point to Point Improvement Upper Right Sheet 5 Chart How well did we do it? % Activity-specific measures e.g. % timely, % clients completing activity, % correct and complete, % meeting standard

  34. % Skills / Knowledge (e.g. parenting skills) # % Attitude / Opinion (e.g. toward drugs) Point in Time vs. Point to Point Improvement # % Behavior (e.g.school attendance) # % Circumstance (e.g. working, in stable housing) # Lower Left Sheet 6 & 7 Lower Right Sheet Chart Is anyone better off?

  35. Choosing Headline Measures and theData Development Agenda Quality Quantity How well did we do it? How much did we do? #3 DDA # Measure 1 ---------------------------- # Measure 2 ---------------------------- # Measure 3 ---------------------------- # Measure 4 ---------------------------- # Measure 5 ---------------------------- # Measure 6 ---------------------------- # Measure 7 ---------------------------- % Measure 8 ---------------------------- % Measure 9 ----------------------------- % Measure 10 --------------------------- % Measure 11 --------------------------- % Measure 12 --------------------------- % Measure 13 --------------------------- % Measure 14 --------------------------- #2 Headline Effect Effort Is anyone better off? #2 DDA # Measure 15 ---------------------------- # Measure 16 ---------------------------- # Measure 17 ---------------------------- # Measure 18 ---------------------------- # Measure 19 ---------------------------- # Measure 20 ---------------------------- # Measure 21 ---------------------------- % Measure 15 ---------------------------- % Measure 16 ---------------------------- % Measure 17 ---------------------------- % Measure 18 ---------------------------- % Measure 19 ---------------------------- % Measure 20 ---------------------------- % Measure 21 ---------------------------- #3 Headline #1 Headline #1 DDA

  36. 8

  37. Your Performance Measures • Headline Measures 1-6 • Data Development Agenda 1-6

  38. 9

  39. Sample performance measure • Where will the line go if we continue to do the same thing?

  40. Discussing the data • What is the story behind the curve? • What would work to fix the problem? • What partners do we need? • Action plan

  41. % of staff with full caseload

  42. % in program after 1 year

  43. 30 day alcohol usage

  44. 30 day marijuana use

  45. Binge drinking

  46. Meeting AGENDA 1. New data 1. New data 2. New story behind the curves 2. New story behind the curves 3. New partners 3. New partners 4. New information on what works. 5. New information on financing 6. Changes to action plan and budget 6. Changes to action plan and budget 7. Adjourn 7. Adjourn

  47. Questions?

  48. Ends vs. Means Exercise Like this On a blank sheet of paper… Step 1. Draw 4 points that represent the 4 corners of a box or square, about two inches on a side. Step 2. Draw a line from the upper left point to the lower right point. Step 3. Draw a line from the upper right point to the lower left point. Step 4. Draw a horizontal line connecting the bottom two points. Step 5. Mark another  point approximately 1 inch below the middle of the horizontal line. Step 6. Connect the upper left point to this new point Step 7. Connect the upper right point to this new point.

  49. What do you have? A Star !!!

  50. Question If I asked you to draw a star would you need the step-by-step instructions? Of course not ! So what’s the point?

More Related