210 likes | 215 Views
This keynote speech by Elliot Stern at the Fifth European Conference on Evaluation of the Structural Funds explores the rationale and challenges of evaluating public policies. It covers the maturity, sophistication, effectiveness, and modesty of evaluation, as well as common tendencies in public management, development, and evaluation. The speech also discusses the learning process, accountability, and various challenges such as complexity, capacity development, evaluation quality, and generative development.
E N D
The Rationale & Challenges for Evaluation of Public Policies Elliot Stern Keynote Speech to the Fifth European Conference on Evaluation of the Structural Funds Budapest, June 2003
Rationale & Challenges of Evaluation Where we are • Maturity • Sophistication • Effectiveness • Modesty Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Maturity • From externally imposed to internally driven • From bolt-on to integrated • From dissemination to use • From contract administration to knowledge management Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Sophistication • Multi-methods • Awareness of theory • Interdisciplinary work • Pluralistic • Values & criteria Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Effectiveness • Ex ante evaluations that feed into programmes • Better Targeting of resources • Diffusion of good practice • International exchange Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Modesty Decline of omnipotent claims! Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Rationales for Evaluation • Procedural -‘its in the Regulations’ • Methodological - ‘our tools are so contemporary’ • Substantive - ‘to make a difference’ Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Common Tendencies in Public Management, Development & Evaluation • Decentralisation • Local leadership and responsibilities • Integrated • Partnership & dialogue • Evidence-based • Capacity development • Participative Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Not all is Consensus! Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Yet evaluation is dynamic! Theory Policy Evaluation Methodology Institution Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Learning - Who Learns? Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Learning at Different Levels Organisational : Knowledge management Practice : Transfer of good practice Stakeholders : Mutual understanding Policy : Strengthening evidence base System : Network building Societal : Cultural change Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Accountability & Learning Learning to be accountable or Accountable for learning Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Challenges • Complexity • Capacity development • Evaluation quality • Generative development Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Complexity • Transversal themes • Overlapping programmes • Multi-funding • Uncertain implementation chains • Extended time-scales Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Capacity Development • Aligning internal & external • Aligning supply & demand through • Professional networking • Systematic training Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Evaluation Quality • Quality as usability • Quality as timeliness • Quality as process • Quality as de facto standards Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation Generative Development • Moving targets • Emergent goals • Mid-course corrections • Unintended consequences Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
Rationale & Challenges of Evaluation As the world is not perfect….. Build capacity over time Balance the desirable with the possible Elliot Stern: Evaluation of the Structural Funds,Budapest, June 2003
The Rationale & Challenges for Evaluation of Public Policies