Download
1 / 33
580 likes | 1.64k Views
Evaluation Theory & Program Theory. By K.S. Calbick, B. Tech., MRM. Prepared for REM 356 Management Institutions, September 27, 2004. Goals. 1. Review Evaluation Theory 2. Develop Program Theory 3. Discuss Evaluation Research. Key Points. Evaluation Definition Evaluation Components
E N D
Evaluation Theory&Program Theory By K.S. Calbick, B. Tech., MRM.Prepared for REM 356 Management Institutions,September 27, 2004 Evaluation Theory & Program Theory
Goals 1. Review Evaluation Theory 2. Develop Program Theory 3. Discuss Evaluation Research Evaluation Theory & Program Theory
Key Points • Evaluation Definition • Evaluation Components • Evaluation Types • Program Theory • Evaluation Research • Case Studies • Program Theory Application Evaluation Theory & Program Theory
What is Evaluation ? • The utilization of scientific research methods and techniques (Suchman 1967: 7) • Assists sensemaking about policies and programs through the conduct of systematic inquiry that describes and explains the policies’ and programs’ operations, effects, justifications, and social implications (Mark et al. 2000: 3) Evaluation Theory & Program Theory
What is Evaluation ? • Program evaluation is the use of social research procedures to systematically investigate the effectiveness of social intervention programs that is (sic) adapted to their political and organizational environments and designed to inform social action in ways to improve social conditions (Rossi et al. 1999: 20) • Evaluation is the systematic assessment of the operation and/or the outcomes of program or policy, compared to a set of explicit or implicit standards, as a means of contributing to the improvement of the program or policy(Weiss 1998: 4) Evaluation Theory & Program Theory
Components of Evaluation Source: Calbick 2003 Evaluation Theory & Program Theory
Types of Evaluations Source: Calbick 2003 Evaluation Theory & Program Theory
Components of Program Theory Source: Rossi et al. 1999 Evaluation Theory & Program Theory
Overview of Program Theory Source: Rossi et al. 1999 Evaluation Theory & Program Theory
Evaluation Plan Evaluation Theory & Program Theory
Bay Conservation & Development Commission Evaluation Theory & Program Theory
Bay Conservation & Development Commission • Created in 1965 with the McAteer-Petris Act • First coastal management agency in the U.S. • In 1968, commission adopted the First San Francisco Bay Plan • The executive director participated in this study Evaluation Theory & Program Theory
Fraser Basin Council Evaluation Theory & Program Theory
Fraser Basin Council • Established in 1997, the council is a not-for-profit, charitable organization • FBC’s vision, principles and goals are articulated in their Charter for Sustainability • FBC provides a forum for stakeholders to develop consensus-based plans • The executive director and a project coordinator participated in this study Evaluation Theory & Program Theory
Land Conservation & Development Commission Evaluation Theory & Program Theory
Land Conservation & Development Commission • In 1973, Senate Bill 100 established a statewide program for land use planning • A citizen’s board, LCDC, was created with an administrative arm, Department of Land Conservation and Development • LCDC ensures all Oregonian cities and counties have a comprehensive land use plan • A senior planner assigned by the executive director participated in the study Evaluation Theory & Program Theory
Puget Sound Water Quality Action Team Evaluation Theory & Program Theory
Puget Sound Water Quality Action Team • In 1985, the Puget Sound Water Quality Authority was created • In 1987, the Authority developed the first Puget Sound Water Quality Management Plan • In 1996, the Authority was transformed into the Action Team • An ambitious program of public participation and stakeholder involvement • The policy director participated in this study Evaluation Theory & Program Theory
U.S.D.A. Forest Service Evaluation Theory & Program Theory
U.S.D.A. Forest Service • In 1905, Congress established the forest service • The forest service is responsible for managing 192-million acres in 42 states, the Virgin Islands, and Puerto Rico • This land is composed of 155 national forests and 20 national grasslands • Natural resources are managed from an ideology of stewardship and public service • The director of strategic planning and resource assessment participated in this study Evaluation Theory & Program Theory
FBC’s Program Characterization Evaluation Theory & Program Theory
Impact Theory for PSWQAT Source: Calbick 2003 Evaluation Theory & Program Theory
Impact Theory for FBC Source: Calbick 2003 Evaluation Theory & Program Theory
Forest Service’s Organizational Plan Source: Calbick 2003 Evaluation Theory & Program Theory
A Service Utilization Plan Source: Following Rossi et al. 1999 Evaluation Theory & Program Theory
Questions Evaluation Theory & Program Theory
BCDC’s Impact Theory Source: Calbick 2003 Evaluation Theory & Program Theory
BCDC’s Organizational Plan Source: Calbick 2003 Evaluation Theory & Program Theory
FBC’s Organizational Plan Source: Calbick 2003 Evaluation Theory & Program Theory
LCDC’s Impact Theory Source: Calbick 2003 Evaluation Theory & Program Theory
LCDC’s Organizational Plan Source: Calbick 2003 Evaluation Theory & Program Theory
Forest Service’s Impact Theory Source: Calbick 2003 Evaluation Theory & Program Theory
PSWQAT’s Organizational Plan Source: Calbick 2003 Evaluation Theory & Program Theory
