110 likes | 228 Views
Closing session Few final considerations. Giovanni Anania University of Calabria (Italy) & Spera. 122 nd European Association of Agricultural Economists Seminar Evidence-Based Agricultural and Rural Policy Making Methodological and Empirical Challenges of Policy Evaluation
E N D
Closingsession Fewfinalconsiderations Giovanni Anania University of Calabria (Italy) & Spera 122nd European Association of Agricultural Economists Seminar Evidence-Based Agricultural and Rural Policy Making Methodological and Empirical Challenges of Policy Evaluation February 17th – 18th, 2011, Ancona (Italy) Centro Studi Sulle Politiche Economiche, Rurali e Ambientali associazioneAlessandroBartolastudi e ricerche di economia e di politica agraria Università Politecnica delle Marche
Two days, 6 plenary and 76 (…actually 21) selected contributed papers later, what did we learn? …in 9 minutes …Iamsorry: MISSION IMPOSSIBLE! a verypartial,highlysubjective (stronglybiased) briefrecapofwhat I amgoing home withfrom Ancona
Evidence-based agricultural and rural policy development - a view from the UK on linking research and policyLouise Shaxson Methodological and empirical progress and challenges in integrated assessment of agricultural systems and policiesMartin K. van Ittersum, Thomas Heckelei, Alfons G.J.M Oude Lansink, Joost Wolf, Argyris Kanellopoulos, Wolfgang Britz Modelling the EU agriculture and policy: departing from the best worldAlexandre Gohin The impact of Pillar I support on farm choices and behaviour: conceptual and methodological challengesDaniele Moro, Paolo Sckokai Towards an enhanced evaluation of rural development policy: insights from EU and US approaches.Janet Dwyer, David Blandford Evaluating agricultural and rural policies: an EU Commission PerspectiveTassos Haniotis
The CAP and the “evidence” (4)Decoupling and SFP (4)Trade policy (4)Rural development policy (II, 8)LEADER progr. and quality of life in rural areas (5)Special poster session: The evaluation of RDPs in ItalyEnvironment and public goods (III, 12)Farmers' behaviour and choices (II, 8)Multisectoral approaches (5)Distributional issues (5)Data collection and issues (5) Markets, food chains and consumers (4) Efficiency, technological change and productivity (4)Treatment effects and counterfactual cases (4)Country-level evidence (4)
plenarypaperswere diverse and allstimulating, each in itsown way I foundselectedcontributedpaperofhigher-than-usualquality, and manyofthose in the sessions I attendedwereverygood
main lesson I learned relates to errors to avoid when making policy evaluations (there are a lot of them which are common, and several I did myself) in policy evaluationsfarmers’ individualresponsematter (policy changesaffectnotonlytheirdecisions, buthowtheymakedecisionsaswell) quantitative-onlyassessmentsmay miss a relevant part of the policy impact (…notonly in the case of RD policies) oftenevaluating the process and the pathisasimportantasassessing the finaloutcome
think in GE terms even when using a PE model do notforget the implicationsof the assumptionsyoumade (and accuratelylisted) on how the world works (which are usuallyquitedifferentfromhowitactuallyworks) whendiscussing the policy implicationsofyouresults generate and provideyourresultsas a stochastic, ratherthencertain, event manyissues are wicked, are ourmodelsrepresenting a simplified world, or are theysimplynaive?
we are good, but we are humans, the right model and the needed data cannot be generated by tomorrow morning making a goodmodelwhichtookfewyearsto put togetherbecome obsolete becauseoflackofmaintananceis a wasteof (often public) resources ifyou care about the social usefulness/impact ofyour work, get the finalusersofyour policy assessmentexerciseinvolvedduring the process, as a “training” activity (forbothsides!) models are notneededfor ex-post policy evaluations (?)
…unfortunately this is a bad thing as well, but I prefer to stay on the optimistic side the goodthingisthatoneof the conclusions I amgoing home withisthat, althoughwe do a better job withrespectto 10-15 years ago, a lot can and needstobedone in the area of policy evaluation
Wassomethingneeded in largerquantities? methodology of evaluation and evaluation processgap in data needswhat can we do to make needed models and data available when policy makers and stakeholders want us to have them available and running “by tomorrow morning”?
A good seminar! MANY THANKS toAndrea, Antonello, Beatrice, Emilio, Valentina, … …and Roberto e Franco!