1 / 14

Types of Effectiveness Evaluations

Types of Effectiveness Evaluations. The Variable Space/Time Continuum. Response to Brian’s Draft Agenda – August/02. survey-type projects to evaluate short-term results research projects that test assumptions (process studies; long-term studies, etc.)

cmoreno
Download Presentation

Types of Effectiveness Evaluations

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Types of Effectiveness Evaluations

  2. The Variable Space/Time Continuum

  3. Response to Brian’s Draft Agenda – August/02 • survey-type projects to evaluate short-term results • research projects that test assumptions (process studies; long-term studies, etc.) • adaptive management projects where evaluation is integral and ongoing

  4. “Effectiveness Monitoring …in a reliable, adaptive management framework” (Curran /Maynard) • Implementation monitoring (compliance monitoring) • Effectiveness monitoring (do activities achieve desired goal) • Validation monitoring (are predictive assumptions and models correct?)

  5. Effectiveness Monitoring(What’s Happening) • Uncontrolled • Retrospective • Compare to standards/results • Snapshot • Potential for assessing change if monitoring plots established

  6. Validation Monitoring(Why/Why not?) • Controlled • Test assumptions underlying policy • Potential for assessing long-term relationships, processes, change, cumulative effects • Examples: LTSP; Carnation Creek

  7. For Best Effect, Use Together • Effectiveness monitoring answers the question: Is it working? • Validation monitoring answers the question: Why/why not?

  8. Adaptive Management “Adaptive management is a systematic process for continually improving management policies and practices by learning from the outcomes of operational programs.

  9. Adaptive Management cont. Its most effective form–"active" adaptive management–employs management programs that are designed to experimentally compare selected policies or practices, by evaluating alternative hypotheses about the system being managed.”

  10. Adaptive Management Cycle

  11. Adaptive Management • Controlled • Potential for evaluating short- and long-term relationships, cumulative effects • Conducted in an operational environment • Built-in “extension” or application

  12. Summary • Effectiveness evaluation framework should characterize what’s happening, and why • Need to understand relationships at different scales • To do this requires both observation (effectiveness monitoring) and informed analysis (validation monitoring)

  13. Summary • Adaptive Management seems well-suited to evaluating policy, standards and alternatives.

  14. Questions ?

More Related