70 likes | 187 Views
Evaluating Our Impact. Jaime Greene, NPower Emily Bancroft, NPower Simon Moloney, NPower NY. Sample Evaluation Questions – NPower Seattle Evaluation. Who uses, and does not use, NPower’s services? Are NPower’s clients and members satisfied with the services they receive?
E N D
Evaluating Our Impact Jaime Greene, NPower Emily Bancroft, NPower Simon Moloney, NPower NY
Sample Evaluation Questions – NPower Seattle Evaluation • Who uses, and does not use, NPower’s services? • Are NPower’s clients and members satisfied with the services they receive? • Does NPower transfer knowledge to clients and increase their operating capacity? • What opportunities exist for improving NPower’s services?
Common Consulting Evaluation Questions for Mission-Impact • We are able to assist more people or groups. • We have added new programs or services. • We have expanded the geographic reach of our organization. • The quality of our work has improved. • We are better able to communicate with one another and with outside stakeholders. • We are better able to access/share information. • We are better able to analyze and report data to stakeholders and funders. • We are able to do more work with fewer resources. • We are better able to manage our technology systems. • We have eliminated or reduced technology barriers which interfere with our work.
Long-Term Outcomes Measurement Some techniques we’ve tried: • Surveying past clients to learn about long-term impacts and behaviors • Asking “retrospective” questions as well as “projecting” questions • Looking for changes over time
Recent Findings Blueprint Research & Development Report • Focus most outcomes evaluations on client IT and operation outcomes • Share learnings and tools across the sector • Develop a common set of evaluation tools and strategies for the field • Pursue “improvement-oriented” evaluation
More recent findings Evaluation Research Design for a 3-Year Evaluation of Technology Capacity Building Efforts in the Nonprofit Sector Recommendation • NTAP Evaluation & Outcomes Survey • Develop Model Tools • Conduct a Benchmark Analysis Goals • To analyze best practices • Create readiness indicators • Assess the impact of technology assistance on mission achievement and organizational efficiency • Build evaluation capacity of NTAPs
Additional Resources • W.K. Kellogg Foundation Evaluation Toolkit www.wkkf.org/Programming/Overview.aspx?CID=281 • Blueprint Research & Design – From Improving IT Infrastructures to Achieving Something Good: Outcomes of Nonprofit Technology Assistance Providers www.blueprintrd.com/text/ntap_outcomes.pdf • NPower’s Evaluation Toolkitwww.npower.org/tools/directory/eval/index1.htm • Innovation Network’s Workstation 2.0 www.innonet.org/tools