1 / 25

Using Data to Measure and Report Program Impact

Using Data to Measure and Report Program Impact. Anne Basham, MFA MEMconsultants. Agenda. Introductions Define Learning Objectives and Key Concepts Apply Knowledge to Your Work Conclusions Questions?. Introductions. About Anne Program Evaluation Consultant, www.memconsultants.com

ianthe
Download Presentation

Using Data to Measure and Report Program Impact

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Using Data to Measure and Report Program Impact Anne Basham, MFA MEMconsultants

  2. Agenda • Introductions • Define Learning Objectives and Key Concepts • Apply Knowledge to Your Work • Conclusions • Questions?

  3. Introductions • About Anne • Program Evaluation Consultant, www.memconsultants.com • Organizations serving youth and communities • Collect data to determine what is working well about a program and to identify opportunities for improvement

  4. Learning Objectives • become familiar with the concepts of Performance Measurement and Theory of Change; • understand how data can be used to measure performance at your specific site; • clarify barriers to collecting quality data and strategies to overcome these barriers; • learn to interpret and report data once it has been collected; • share findings with multiple stakeholders; and • identify next steps in the continuous quality improvement cycle

  5. Performance Measurement • Performance measurement is the process by which businesses, governments and other organizations establish criteria for determining the quality of their activities, based on organizational goals. • Performance measure: A value or characteristic that measures progress toward goals, and also used to improve progress, reduce risks, or improve cost-effectiveness.

  6. Theory of Change • Theory of Change defines all building blocks required to bring about a given long-term goal.1 • Includes assumptions, strategies and predicted outcomes • Customized to reflect the goals and needs of an organization • AKA: pathway of change, blueprint, logic model, outcome map, “so that”chain 1 as defined at www.theoryofchange.org

  7. Logic Models

  8. Logic Model Example:WSCAcademic Improvement Programs

  9. Logic Model Example:WSCEnvironmental Stewardship Programs

  10. Logic Models

  11. “So That” chains…

  12. “So That” Chain Example:WSC Healthy Futures Programs

  13. “So That” Chain ExampleWSC Veterans & Military Families Programs

  14. Indicators

  15. Measuring Performance - Indicators • Indicators are the measurable evidence that demonstrate progress towards your long term goal. • To restate, they are measurable. • Examples: • Number of people participating in a program, event or activity • Number of economically disadvantaged individuals • Increased interest or prediction of involvement • Increased knowledge and/or awareness • Increased confidence to act • Demonstrated gains in school readiness or academic performance

  16. Data Collection Methods:Tracking Indicators Quantitative Qualitative • Program Records (attendance) • Structured Assessment • (test scores) • Surveys • Interviews • Observations • Focus Groups • Document/ Literature Review

  17. Common Data Collection Challenges • Time • Working with others • Measurement mismatch • Access • Sample size • Comprehension • “Bad” data • Poorly designed tools • Measuring prevention • What else?

  18. Data Analysis • Quantitative • Totals • Averages • Percentages • Pre/Post Comparison • Qualitative • Emergent • Top Down

  19. Research-based strategies • Don’t reinvent the wheel – learn from past successes – “best practices” • Acknowledge you aren’t doing research or studies that are genearlizable • You are collecting information about your program • Build off of the research of others

  20. Data Reporting • Other Staff or Volunteers • Program Participants • Board Members • Funders • Washington Service Corps • Who else?

  21. Continuous Quality Improvement

  22. Learning Objectives • become familiar with the concepts of Performance Measurement and Theory of Change; • understand how data can be used to measure performance at your specific site; • clarify barriers to collecting quality data and strategies to overcome these barriers; • learn to interpret and report data once it has been collected; • share findings with multiple stakeholders; and • identify next steps in the continuous quality improvement cycle

  23. Questions? • Everyone will be unmuted so you can ask your questions. • You may also type questions into the chat box.

  24. Thank you! • Slides will be available for your use • Corporation for National and Community Service (CNCS) Performance Measurement website: • http://www.nationalserviceresources.org/program-financial-and-grant-management/performance-measurement • Contact Anne with questions: anne@memconsultants.com

More Related