1 / 16

Evaluation Basics & Objectives Oriented Models

Evaluation Basics & Objectives Oriented Models. Understand Purpose of the Evaluation Request. Who needs to know? Who will have access to results? What needs to be known (scope)? Why? How will the evaluation results be used? What is the political climate &/or context?. Audiences & Uses.

drake
Download Presentation

Evaluation Basics & Objectives Oriented Models

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation Basics &Objectives Oriented Models

  2. Understand Purpose of the Evaluation Request • Who needs to know? • Who will have access to results? • What needs to be known (scope)? • Why? • How will the evaluation results be used? • What is the political climate &/or context?

  3. Audiences & Uses • Formative • For program personnel • Feedback for Improvement • Summative • All key stakeholders • Decisions about continuation, termination, expansion, adoption or replication

  4. Objectives-Oriented Model • Identify goals & objectives • Define objectives in behavioral terms • Find situations where behavior can be observed • Select measurement techniques • Collect data • Compare data against behavioral objectives • Correct deficiencies & repeat process Tyler

  5. Focus on extent to which pre-determined purposes or objectives were achieved • Roots in pre-test – post-test measurement model

  6. Discrepancy Model • Focus on why outcomes occurred • Examine discrepancies between program logic model and observed outcomes • Seek convincing explanations for difference

  7. Discrepancy Model Needs Assessment 1. Design Stage Planned Program Elements (Logic Model) Installation 2. Formative Stages Process Product 3. Summative Stages Cost Benefit Provus, 1971

  8. Logic Model or Program Theory • Plausible & sensible model of how the program will work under certain environmental conditions to solve identified problems Bickman, 1987 as cited in Wholey, Hatry & Newcomer, 2004

  9. Logic Model Elements • Resources • Activities • Outputs • Short-term outcomes • Intermediate-term outcomes • Long-term outcomes Wholey, Hatry & Newcomer, 2004

  10. Basic Logic Model or Program Theory How Why Long-term Outcomes (problem) Short-term Outcomes Intermediate Outcomes Resources Activities Outputs Customers Program Delivered Results from Program • Wholey, Hatry & Newcomer, 2004

  11. Logic Model or Program Theory • May be used while developing program to predict outcomes • May be used during or after implementation to help explain observed behavior changes • Alwaysdevelopedcollaboratively with program managers & staff Wholey, Hatry & Newcomer, 2004

  12. Examine Objectives Before Accepting • Objectives should be based on justifiable needs • Intended & unintended consequences should be considered • Objectives should be legal & ethical

  13. Developing Logic Model or Program Theory • Iterative process changing as program evolves • Begin conceptualization by defining problem to be solved • Doesn’t ignore context (external conditions or extraneous variables)

  14. Strengths of Objectives Oriented Approach • Simplicity • Face validity – program is accountable for what designers said it would accomplish

  15. Criticisms • Measurement of objectives does not address Merit & Worth • May not address Importance of discrepancies • Neglects context • Ignores outcomes outside stated objectives • Promotes linear thinking

  16. To Be Defensible Must Address: • Who determines goals & objectives? • Do key stakeholders agree with stated objectives? • Who determines criterion levels? • What is acceptable evidence of success?

More Related