80 likes | 231 Views
The curious case of transition evaluation?. European Environmental Evaluators Network Forum 09-10.02.2012 Presentation by Matthias Bussels. Introduction. Role of evaluation crucial, yet not analysed systematically => Subject of new 4-year research project Initial objectives:
E N D
The curious case of transition evaluation? European Environmental Evaluators Network Forum 09-10.02.2012 Presentation by Matthias Bussels
Introduction • Role of evaluation crucial, yet not analysed systematically => Subject of new 4-year research project • Initial objectives: • Exploring congruity of evaluation literature to transition context • Generating questions for discussion Matthias Bussels
The singularity of transitions • Goal: change of societal systems towards sustainability • Process: iterative ‘rounds’ propelled by learning • Transition processes are not confined to the public sector • Participation & consensus-building define goals & process Matthias Bussels
The singularity of evaluatingtransitions • uncertainty: unstructured character <= evaluation = learning • ‘Everyone evaluates’? • Evaluating timing • Evaluation complexity reflects system complexity: • Levels, actors, time frames, sectors, … • Holistic approach of sustainable development Matthias Bussels
Policy evaluation vs. transition evaluation? • Transition process is not ‘policy’ sensu strictu => some established concerns change content: • Lock-in by policy styles • ‘Evaluator’ vs. ‘evaluation user’? • Environmental evaluation vs. other policy domains And, other issues remain… Matthias Bussels
Aspects of proceduralevaluation = most addressedbyliteratureonpolicyevaluation & transitions • Meta-evaluation: methods & self-evaluation • Roles: • Government? • Evaluator & ‘neutrality’? • Experimental character: evaluation criteria ? • ‘Results’ & ‘progress’? Matthias Bussels
Aspects of substantiveevaluation • Objective: systemicchangetowardssustainability • ‘system’ • ‘sustainability’ Matthias Bussels
Questionsfordiscussion • Contribution of research to evaluation literature: evaluation of system change? • Only apparent constant = goal: all efforts of evaluation based on this? • Who evaluates? • Is there a demarcated role for an ‘evaluator’? • Is the participation of an evaluator to the process problematic or essential? • Applicability of evaluation literature uncontested? • Consequences of uncertainty renders positivist paradigm inadequate: no ‘planning’ possible? Matthias Bussels