1 / 29

Measure What Matters

Measure What Matters. Karen MacDonald, BGCA Midwest Leadership Conference October 16, 2009. “Not everything that counts can be counted, not everything that can be counted counts.”. “So What?”. “In God we trust, all others bring data.”. “Data is the new sexy!”.

ricoa
Download Presentation

Measure What Matters

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Measure What Matters Karen MacDonald, BGCA Midwest Leadership Conference October 16, 2009

  2. “Not everything that counts can be counted, not everything that can be counted counts.”

  3. “So What?”

  4. “In God we trust, all others bring data.”

  5. “Data is the new sexy!”

  6. Why is Outcome Measurement important?

  7. The Importance of Measurement • Era of accountability • Doing good is not enough • Stakeholders are asking more difficult questions

  8. Program Evaluation vs Outcome Measurement: Formal Program Evaluation Outcome Measurement Does the program work? How well is it working? • Proving • Improving • Research tool • Management tool • Applies to programs • Applies across org • Analyzing • Learning • Theory of Change • Best Practices

  9. Key Elements of Impact • Safe, positive environment • Fun • Supportive relationships • Opportunities and expectations • Recognition

  10. Making Every Day Count Longitudinal Study Tracked 7th and 8th graders for 30 months Linked levels of attendance at Boys & Girls Clubs to outcomes Finding – MORE IS BETTER

  11. Four things led to teen participation… • Fully engaged in a variety of activities • Friends came to the Club • Involved in leadership roles • First became involved as preteens or even younger

  12. Making Every Day Count affirms… • Attendance matters • Participation matters • Fun matters • Relationships matter • Programs matter

  13. Annual Visits Definition: The number of times a member attends the Club over the course of the year. It’s important to track this metric. 52 - 104 times per year is the baseline Increase attend levels of all members regardless of current attendance patterns

  14. A big thank you to… • Boys & Girls Clubs of Greater Milwaukee • Boys & Girls Clubs of Omaha

  15. Planning a Measurement Strategy:Key Steps • Identify key organizational priorities and select key indicators • Track attendance and program participation • Locate and collect data • Understand and use data • Communicate results

  16. Identify Organizational Priorities • Review sources that outline your priorities including your strategic plan • Review the needs of your community • Involve your board by asking questions

  17. Success Equation Components What are you ultimately trying to accomplish? Priority Outcomes What changes in behavior or condition are required? A + B + C = D A + B + C = D Indicators How do we measure progress against our outcomes? Key Strategies Which programs or activities will drive results?

  18. Select Indicators to Track Progress • Use your success equation and priority outcomes as your guide • Start with the basics: attendance and program participation • Continue with more complex indicators: changes in knowledge/attitude and changes in behavior • Use the Outcomes Framework as a guide • Select indicators that are feasible to collect and credible to communicate

  19. Characteristics of Good Indicators Practical – Can you realistically capture this data without a lot of cost or difficulty? Actionable – Will the data allow you to make decisions in a timely manner? Relevant – Does it answer the “so what” question? Controllable – Is it within your sphere of influence or control?

  20. Track Attendance and Program Participation • more time spent going to the Club was linked to positive change • research supports the importance of regular attendance and the links to positive outcomes. • at least 52 times per year is a baseline • Clubs should strive to increase the attendance levels of all members • Average daily attendance is an important measure of Club’s operational capacity, but does not measure individual members and is therefore not an indicator of changes for youth.

  21. Locate and Collect Data • Collect on a program-by-program basis • Leverage existing tools, i.e. test or surveys • Use Club-wide surveys when warranted • Tests or Surveys can be administered by hand or electronically • Results from the tests or surveys can be tracked in the member’s management system.

  22. Locate and Collect Data

  23. Understand and Use Results • Improve program and/or youth results • Share progress and success • Share results alone • 50% of members participated in community service. • Share results compared past performance (growth/change) • Participation in community service activities has increased by 25%.

  24. Simply based on regular member attendance and program participation, Clubs can demonstrate the impact they are having by linking participation to external research on positive activities:

  25. Engage your Staff • Explore and define how measurement can and will be used • Setting the right tone and creating ownership and buy-in • Setting the process in motion • Identify the processes and plans needed to bring measurement to life

  26. Available Resources www.bgca.net/demonstratingimpact • Demonstrating Impact Guide • Outcome Measurement Framework • BGCA - Public/Private Ventures Study • Distance Learning courses Abigail Diner, adiner@bgca.org Karen MacDonald, kmacdonald@bgca.org Romero Brown, rbrown@bgca.org

More Related