1 / 14

Increasing Impact

Increasing Impact. Understanding Measurements of Impact in Evaluation June 2013 Jennifer Farley. Overview . Why evaluate? Evaluation: Types, Continuous Improvement and Neglect Outputs vs. Impact Measures of Impact Is impact good enough? When it’s not good enough Maximizing Evaluation

calla
Download Presentation

Increasing Impact

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Increasing Impact Understanding Measurements of Impact in Evaluation June 2013 Jennifer Farley

  2. Overview • Why evaluate? • Evaluation: • Types, Continuous Improvement and Neglect • Outputs vs. Impact • Measures of Impact • Is impact good enough? • When it’s not good enough • Maximizing Evaluation • Questions

  3. Why Evaluate? • Ensures Quality • Increases Knowledge • Prioritize Resources • Accountability • Demonstrate need and effectiveness • Marketable (Russ-Eft & Preskill)

  4. Types of Evaluation • Developmental • Formative • Summative • Monitoring and Auditing • Outcome Evaluation • Impact Evaluation • Performance Measurement (Russ-Eft & Preskill)

  5. Continuous Improvement Evaluation

  6. Top 10 Reasons Evaluation is Neglected • Misunderstanding the purpose and role of evaluation • Fear • Lack of Skills (Real or Perceived) • No one has asked for it • It is not used • Time-consuming • Perceived costs vs. Perceived benefit • Leaders already know what works • Prior experience • Lack of Value (Russ-Eft & Preskill)

  7. Outputs and Impact

  8. Measures of Impact • Measures of Change • Attitude, Knowledge and Behavior • Comparison • Pre- and Post-program • Calibration • Is the primary impact what is measured? • Is the program driving the measure, or is the measure driving the program?

  9. Is the Impact Good Enough? • Goals • Program established goals • Funder established goals • Comparison • Population level data • Are the target and general population the same? • The continuum of evaluation and research

  10. When Impact isn’t “Good Enough” • Re-calibrate Measures • What is impact? • Participant focus groups • What best measures impact? • Refine measurement tools • Staff Training • Re-Pilot surveys • Incorporate Measures of Program Quality • Look at HOW programs and services are offered • Explore field-specific measures of quality • Youth Program Quality Assessment • Quality Rating System

  11. Results: Maximizing Evaluation • What is the purpose of the evaluation? • Funder Required? • Is there a requirement to “Act” on the results? • How are the results communicated to all stakeholders? • How are results used in planning?

  12. Questions?

  13. Contact Information Jennifer Farley Censeo Solutions jennifer@censeosolutions.com 515.371.1754 www.censeosolutions.com

  14. Works Cited Russ-Eft, D., & Preskill, H. (2009). Evaluation In Organizations: A systematic approach to enhancing learning, performance, and change.New York: Basic Books.

More Related