140 likes | 150 Views
Explore different types of effectiveness evaluations including effectiveness monitoring, validation monitoring, and adaptive management. Learn how these evaluations can assess short- and long-term results, track compliance, and validate assumptions.
E N D
Response to Brian’s Draft Agenda – August/02 • survey-type projects to evaluate short-term results • research projects that test assumptions (process studies; long-term studies, etc.) • adaptive management projects where evaluation is integral and ongoing
“Effectiveness Monitoring …in a reliable, adaptive management framework” (Curran /Maynard) • Implementation monitoring (compliance monitoring) • Effectiveness monitoring (do activities achieve desired goal) • Validation monitoring (are predictive assumptions and models correct?)
Effectiveness Monitoring(What’s Happening) • Uncontrolled • Retrospective • Compare to standards/results • Snapshot • Potential for assessing change if monitoring plots established
Validation Monitoring(Why/Why not?) • Controlled • Test assumptions underlying policy • Potential for assessing long-term relationships, processes, change, cumulative effects • Examples: LTSP; Carnation Creek
For Best Effect, Use Together • Effectiveness monitoring answers the question: Is it working? • Validation monitoring answers the question: Why/why not?
Adaptive Management “Adaptive management is a systematic process for continually improving management policies and practices by learning from the outcomes of operational programs.
Adaptive Management cont. Its most effective form–"active" adaptive management–employs management programs that are designed to experimentally compare selected policies or practices, by evaluating alternative hypotheses about the system being managed.”
Adaptive Management • Controlled • Potential for evaluating short- and long-term relationships, cumulative effects • Conducted in an operational environment • Built-in “extension” or application
Summary • Effectiveness evaluation framework should characterize what’s happening, and why • Need to understand relationships at different scales • To do this requires both observation (effectiveness monitoring) and informed analysis (validation monitoring)
Summary • Adaptive Management seems well-suited to evaluating policy, standards and alternatives.