100 likes | 117 Views
This project evaluates program effectiveness for decision-making. It explores what program evaluation entails, methods used, and results obtained. Focus areas include operations management and service management, emphasizing evidence collection and client satisfaction. The text provides guidance on data gathering and analysis, employing mixed-methods for comprehensive data collection. Examples of evaluation approaches and their benefits are highlighted. Special attention is given to obtaining client feedback for program improvement.
E N D
Project Evaluations AMEEL Advisory Board Meeting 2008
Evaluations Why conduct a program evaluation? What constitutes a program evaluation? How is it done? What are the results of doing it?
Why? Areas of focus to consider Operations Management: • Program evidence – fulfill granting agency requirements • Efficient operations – show improvement Service Management • Client Satisfaction – identify and focus on client needs • Positive Outcomes – focus on client and smooth operations To obtain information for making decisions about the program’s future
What? • No single method • Repeated data gathering • Consistent use of measurement units: • resources • processes • units provided • impact
How? • Mixed-methods approach: • qualitative • quantitative • To gather explorative, descriptive and explanatory data
Examples – Mixed Methods • Interface Goals (quantitative, descriptive) • Workshop Evaluation (quantitative, descriptive) • Questions for Scholars (qualitative, explorative) • Usability Testing (qualitative, explanatory)
Examples – Why? • Efficient Operations • Software Analyses • Format Choices • Client Satisfaction • Ground Truth testing • Program Evidence and Positive Outcomes • Regular Program Reports • Periodic Pop-Up Surveys
Impact Challenge for AMEEL • How to measure Impact • How to identify groups to survey • How to carry out surveys • HELP!