150 likes | 268 Views
Workshop on Innovations in Governance Measurement. April 26, 2013 in Washington, DC Jesper Johnsøn, U4/CMI. A. Some projects. Focus on the missing middle ( outcomes ). Theories of change Cost-effectiveness /- benefit analysis framework for AC ( mainstreaming )
E N D
Workshop on Innovations in Governance Measurement April 26, 2013 in Washington, DC Jesper Johnsøn, U4/CMI
A. Someprojects Focusonthemissingmiddle (outcomes) • Theoriesofchange • Cost-effectiveness/-benefitanalysisframework for AC (mainstreaming) • Proxy indicators, in baskets • Adaptingevaluationmethods to GAC
Theoriesofchange in anti-corruptionwork • Theory-basedevaluationtradition, goingbeyondlogframes and resultchains, focusonpreconditions, interdependencies and complexity • Supports indicatordevelopment, data collection • 5-step tailoredmethodology
Cost-effectiveness/benefitanalysisframework • CEA = compares costs to an overall effectiveness measure, outcome level • # bribes, integrity scores, “missing” expenditures, recovered assets, student scores, maternal health • Main challenge = identifying same single quantifiable effectiveness measure • Opportunity = AC impactdoes not have to be measured via corruptionlevels (mainstreaming)
Work plan A. Build up body ofknowledge from pastwork: • Mapexistingacademicliteratureusing CEA/CBA methods (done) • Reconstruct CEA/CBA ratios (resource intensive) B. Applymethodology to programmes under design • Formative, operationalresearch • Benefit from piloting, sequencing, and randomisation
B. Response to questions • Q1-4: Beginwith problem analysis/informationneedsdefinedesiredoutcomes (hard)/questions developindicators. • Indicatorsoftentheeasy part (unlessyouwantone for everything) • Skipping straight to standardisedindicatorscould be prescriptive • Q1: Actionableindicators = reform indicators? • Different levelofresults – overall performance vs. specific reform • Overall performanceindicatorscan be widelystandardised, specific reforms cannot . Proxy indicator baskets, LSMS? • Q3: Cannotprovide reliable, comprehensive data onthecheap • Alreadymuchinnovation (BEEPS, PETS, QSDS, PAPI, GCB, Afrobarometer, GI/Indaba). • Relyonproxies for non-quantifiablesocialphenomena. • Combine different types ofindicators (includingproxies) in country-specific baskets, a la LSMS (poverty) • Need indicators at different levels of results