100 likes | 231 Views
VIII Konferencja Ewaluacyjna Methodological Developments and Challenges in UK Policy Evaluation Daniel Fujiwara. VIII Evaluation Conference ‘ Methodological Developments and Challenges in UK Policy Evaluation ’ . Daniel Fujiwara Senior Economist Cabinet Office & London School of Economics
E N D
VIII Konferencja Ewaluacyjna Methodological Developments and Challenges in UK Policy Evaluation Daniel Fujiwara
VIII Evaluation Conference‘Methodological Developments and Challenges in UK Policy Evaluation’ Daniel Fujiwara Senior Economist Cabinet Office & London School of Economics Warsaw, November 2012.
Policy evaluation in the UK • Analysts in government have a long history and tradition of policy evaluation.
The Magenta Book • Assessing whether the policy had a causal impact on the outcomes of interest.
The Green Book • Cost-benefit analysis is the key tool for policy assessment. CBA enters at the Appraisal stage • Appraise policy interventions in terms of their social costs and benefits. • Further supported through the Social Value Act(2012)
Challenges to policy evaluation • Some constraints on use of impact evaluation findings: • Are the impact and valuation estimates robust? • Have we acknowledged and included all possible impacts? • Are there some things that are considered separately – eg, merit goods, distribution (of income, health etc).
Challenges to policy evaluation: Impact measurement (1) • Identifying and measuring the counterfactual • Many public sector organisations moving to the Maryland Evaluation scale. • ‘What Works’ institutes like Washington State Institute for Public Policy. • Scale ranks how well counterfactuals have been measured in the analysis.
Challenges to policy evaluation: Impact measurement (2) • Level 5 study designs are being increasingly used for public policy interventions. • RCTs used in tax policy, environment policy and labour market interventions.
Challenges to policy evaluation: Valuation • Supplementary Green Book guidance provides guidelines on how to valuesocial impacts • Preference methods or Wellbeing Valuation ? • Different methods are increasingly allowing us to value and include a broad range of impacts
Challenges to policy evaluation: Summary • These developments and new guidelines for policy evaluation help us to understand the impacts of a policy better and to continuously improve the success of policy interventions. • Policy interventions are enhanced during this process through the use of evidence from behavioural science.