1 / 20

Evaluation Defined

Evaluation Defined. FCS 5470 M. Burns. What do you think?. Draw a visual of your definition of evaluation. As a group, write a definition of evaluation. Evaluation as defined by some of the evaluation experts. Michael Scriven Rossi and Freeman Patton Preskill and Torres. Evaluation is.

cayenne
Download Presentation

Evaluation Defined

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation Defined FCS 5470 M. Burns

  2. What do you think? • Draw a visual of your definition of evaluation. • As a group, write a definition of evaluation

  3. Evaluation as defined by some of the evaluation experts • Michael Scriven • Rossi and Freeman • Patton • Preskill and Torres Weiss, 1998

  4. Evaluation is A systematic assessment of the operation and/or outcomes of a program or policy, compared to a set of explicit or implicit standards, as a means of contributing to the improvement of the program or policy. Weiss, 1998

  5. What is evaluated? • Program • Policy • Process • Product • People • Service Evaluand Russ-Eft & Preskill, 2001; Weiss, 1998

  6. My definition • Use of scientific methods to judge and improve something

  7. Evaluation can… • Contribute to increased knowledge among members • Help prioritize resources • Assist in planning/delivering organizational initiatives • Promote accountability • Fulfill grant responsibility • Contribute to improved quality Russ-Eft & Preskill, 2001

  8. Reasons Evaluation is Neglected • Organization members misunderstand evaluation’s purpose and role. • Organization members fear the impact of findings. • There is a real or perceived lack of evaluation skill. Russ-Eft & Preskill, 2001

  9. Reasons Evaluation is Neglected • Evaluation is considered an add-on activity. • Limited utilization of results. • Viewed as time-consuming and laborious. • Perceived costs outweigh perceived benefits. Russ-Eft & Preskill, 2001

  10. Reasons Evaluation is Neglected • Administration doesn’t ‘buy-in’ to evaluation. • Disappointing/disastrous previous experiences. • No one has asked for it! Russ-Eft & Preskill, 2001

  11. When not to conduct evaluation • Results are not going to be utilized. • Program has limited stability • Limited resources Posavac & Carey, 2003

  12. Kinds of Evaluation • Developmental • Formative • Summative • Monitoring/ auditing • Outcome • Impact • Performance Russ-Eft & Preskill, 2001

  13. Developmental Evaluation • Positions the evaluator as a guide throughout the program’s development • Used frequently in a needs assessment Patton, 1994

  14. Needs assessment • Systematic set of procedures undertaken for the purpose of setting priorities and making decisions about program improvement and allocation of resources…the priorities are based on the identified needs Witkin & Altschuld, 1995

  15. Formative Evaluation • Typically conducted • during the development or improvement of a program by internal evaluators • More than once • Intent is to improve the program as the it is being implemented Russ-Eft & Preskill, 2001

  16. Summative Evaluation • Typically conducted • After program completion for the benefit of some external audience or decision maker • By external evaluators • Used to judge worth or value of the program Russ-Eft & Preskill, 2001

  17. Types of summative evaluation • Monitoring and auditing • Implementation issues • Accountability • Outcome • Changes in knowledge, attitudes, values, skills, etc due to intervention Russ-Eft & Preskill, 2001

  18. Types of summative evaluation • Impact • Form of outcome evaluation • Assesses the net effect of a program by comparing outcomes to an estimate of what would have happened without the program Russ-Eft & Preskill, 2001

  19. Types of summative evaluation • Performance • Used mostly by government • Looks at the process in comparison to the output • Documentation of the results Russ-Eft & Preskill, 2001

  20. Final thoughts… • Based on the information presented and your previous thoughts, how has your definition of evaluation changed?

More Related