250 likes | 372 Views
Session VI. Evaluation & Wrap Up. Evaluation. Activities directed at collecting, analyzing, interpreting, and communicating information about the effectiveness of social programs undertaken for the purpose of improving social conditions. Evaluation: Uses.
E N D
Session VI Evaluation & Wrap Up
Evaluation • Activities directed at collecting, analyzing, interpreting, and communicating information about the effectiveness of social programs undertaken for the purpose of improving social conditions.
Evaluation: Uses • Assess the effectiveness of an ongoing program in achieving its objectives • Distinguishes a program's effects from those of other forces • Aims at program improvement through a modification of current operations.
Evaluation Types • Formative Evaluation • Strengthens or improves the object (program) by examining • the delivery of the program or technology, • the quality of its implementation • the assessment of the organizational context, personnel procedures and inputs.
Evaluation Types • Summative Evaluation • Examines the effects or outcomes of programs, • Determines the overall impact.
Evaluation Types • Static • Evaluation of a completed program is conducted without the involvement of the target group.
Evaluation Types • Dynamic • Interaction between the target group and the program. • Trochim (1996) suggests an evaluation that occurs throughout the entire "life cycle" of the program.
Evaluation Program Domains • Needs Assessment • Assessment of program theory • Assessment of program process • Impact Assessment • Efficiency Assessment
Evaluation Standards • Utility • Clear identification of audiences • Writing clear and understandable reports • Timeliness • Statement of evaluators’ biases and qualifications • Taking responsibility for the use of the evaluation.
Evaluation Standards • Feasibility • evaluation should be • Realistic • Prudent • Diplomatic • Frugal
Evaluation Standards • Propriety • an evaluation should be • conducted legally • ethically • with due regard for the welfare of those involved in and effected by an evaluation.
Evaluation Standards • Accuracy • Technical adequacy of evaluative information • validity • reliability • data control • Conclusion drawing • objectivity
Evaluation Structure • The question the evaluation is to answer. • The methods and procedures the evaluation will use to answer the questions. • The nature of the evaluator- stakeholder relationship.
Purpose • Evaluations may be preformed to determine information on various aspects of the program such as • determining effectiveness, • providing supporting information for advocates, • providing information for funding decisions, etc.
Stakeholder Needs • The evaluator must determine what aspect of the program is to be assessed and successfully negotiate the contract with the stakeholders in order to present an effective, timely and useful report.
Circumstances • Programs and evaluations are generally not standardized to the point where a formula for evaluation can be applied. Some considerations vital to a successful evaluation are • the stage of program development, • the administrative and political context • the conceptualization and organizational structure
Resources • In order to perform an evaluation that meets expectations, the evaluation must have access to the appropriate resources. Adequate time, funding, personnel, and access to records and data are vital to the development of an effective and useful evaluation.
Challenges • Determining the type of evaluation to be preformed. • Determining the issues surrounding the evaluation. • Negotiating stakeholders’ expectations of the finished product.
Challenges • Allocating necessary funding, staff, access to data, and time constraints. • Upholding utility, feasibility, accuracy and propriety standards to ensure a useful report. • Maintaining an appropriate balance between considerations if the circumstances of the evaluation change.
Resources for Evaluation Design • NC Cooperative Extension • Extension Tourism • County Extension Directors • NCDENR-State Trails Program Staff • County Tourism Directors • Local Government Officials • Non Profit Organizations • Others
References • http://www.cals.ncsu.edu/agexed/aee577/index.html • http://www.ojp.usdoj.gov/BJA/evaluation/glossary/glossary_e.htm • http://hagar.up.ac.za/catts/ole/eel/concept-map/types.html#e
Jan Trask jan_trask@ncsu.edu Parks, Recreation & Tourism Management North Carolina State University Speaker Contact Information