70 likes | 84 Views
Explore 2014+ pilot findings in Hungary, Italy, Poland, Spain, Sweden, France, Netherlands, Slovakia. Learn about new approaches, indicator efficacy, impact evaluation methods, and the evolution of performance assessment.
E N D
Results Indicators 2014+ Findings of the Pilots Veronica Gaffey Evaluation Unit, DG for Regional Policy
Location of Pilots • Hungary (Central) • Italy (Sardegna, Marche) • Poland (Pomorskie) • Spain (Galicia) • Sweden (South) • France (Aquitaine, Rhône-Alpes, Martinique) • Netherlands (West) • Slovakia (Regional OP and Competitiveness & Economic Growth)
Questions for the Pilots • What change to you wish to achieve with this priority? • What indicator can capture this change? • Do you know the baseline for 2007 or now? • Will your output indicators contribute to change in the result indicator? How? • Could you evaluate it? How?
Learning • New approach feasible, but not without significant change in mindsets & practice • No pilot region uses the new approach • Indicators mostly do not reflect the intended effects of the priorities • Results focus must be part of programme design • Concentration a pre-condition • Decisions on what to fund and what not to fund – political choice
Learning • With concentration – fewer indicators • Result indicators – close to policy • Statistics often will not be appropriate; explore administrative data, specific surveys, benchmarks; use ex ante evaluations • Baselines and Targets essential – they can be qualitative or quantitative • Reflect when change can be expected – intermediate results
Learning • Reflect on how to evaluate: counterfactual, theory based, before and after studies • Reflect on “other factors” contributing to results • A final point: Indicators do not tell us everything. Evolution of result indicator should prompt debate – not the last word on performance of the policy.