80 likes | 88 Views
Learn how to plan and execute program evaluations effectively from identifying stakeholders to selecting evaluation models, with an emphasis on objectives, accountability, and stakeholder involvement.
E N D
Chapter 2 Planning an Evaluation
It’s all in the planning… • Three ways that program evaluations start: • Program personnel initiate an evaluation • Central administration or the $$$ agency require an evaluation • Internal evaluation team sees a need
Traditional Model Old and not so hot Social Science Research Model Let’s experiment CGs and DVs Industrial Inspection Model Oops! I can fix that! Black Box Evaluation The end result is… How did you get it? I don’t know. Objectives Based Did we meet the goals? Yes or no, but other stuff happened! Goal-Free Who turned out the lights? Models, models, and more models
Fiscal Evaluation $$$ makes the program go around How much do we need and for what? Accountability Model $$$ is being spent as it should be and doing what it is supposed to do. Expert Opinion Model Quantitative and qualitative Naturalistic Seeing is understanding Empowerment Evaluation Involve the clients A board or a council Theory-Driven Evaluation Correlate the variables Improvement-Focused Model The big winner. Why? Models, models, and more models
Steps in Preparing to Conduct an Evaluation • Identify the program and its stakeholders • Obtain a complete program description • What is the goal of this program? • Meet with stakeholders • Providers • Clients • Become Familiar with Information Needs • Who wants the evaluation? • What type of evaluation is appropriate? • Why is an evaluation wanted? • When is an evaluation needed • What resources are available to support an evaluation • Plan the evaluation • Literature, methodology, proposal
Slam-Bang Effect A little goes a long way Being unprofessional Is it an insult to ask? We know what we’re doing! Inhibiting Innovation Ch, ch, ch, changes Termination You’re Fired! Misuse of Information Not a personal job performance evaluation Loss of qualitative data Data is great, so are people! Fears about Program Evaluation
Draining Resources You gotta spend to save. Loss of Control Will the report do all the talking? Little Impact I did all this work for what reason? The Effect of these Fears Someone may try to get you to stack the deck. Fears about Program Evaluation
The Moral of the Story… • Plan • Plan • Plan • then evaluate