130 likes | 332 Views
Utilization-Focused Evaluation and its A pplication to Rural Tourism Programs. Presented By Sean M. Noland January 30, 2007. Evaluation vs. Monitoring. Monitoring Performed by a member of the organization in which the program is conducted Is repetitive and ongoing data collection
E N D
Utilization-Focused Evaluation and its Application to Rural Tourism Programs Presented By Sean M. Noland January 30, 2007
Evaluation vs. Monitoring • Monitoring • Performed by a member of the organization in which the program is conducted • Is repetitive and ongoing data collection • Can be used as progress indicator but is not conclusive • Evaluation • Is time bound and conducted during or after the program • Can be used to make adjustments • Summarizes success or failure
Auditing • Differs from evaluation and monitoring • Measures performance against compliance with predetermined standards, rules or regulations
The “Triad” of Program Management Evaluation Monitoring Auditing
Utilization Focused Evaluation • Advanced chiefly by M.Q. Patton • Emphasizes four reasons for undertaking evaluation • Making Judgments • Improving the effectiveness of the evaluand • Informing decisions about future evaluands • Providing information on specific use for specific users
Distinctiveness from Other Approaches • Less empirical • Includes the participant (and their values) • Effectiveness is measured by utilization of an evaluand (hence the name) and satisfaction with it.
Context for Evaluation • Stage of development of the evaluand (pre-implementation? management?) • Local Circumstances (undeveloped area, urban fringe) • Purpose of evaluation (to acquire funding)
Outlining the Evaluation • Define context • Assemble stakeholders • Acquire information for the selection of questions • Determine benefits of the evaluation • Determine how the information is to be utilized
Poor Evaluation EVALUAND EVALUATION
Patton’s Model EVALUAND Evaluation Stage of Development Local Circumstances Stage of Development Local Circumstances EVALUATION Purpose of Evaluation Purpose of Evaluation
Advantages • Places decision making capacity in the hands of the stakeholders (expressly) and consumers (explicitly & implicitly) • Allows for the consideration of values of those affected and the consumer • Stakeholders are more diverse
Challenges • Stakeholder conflicts arising from broader diversity • Use of findings may be used by stakeholders to highlight program failures