Sebastian Martinez Human Development Network World Bank

1. Institutionalizing Impact Evaluation in Human DevelopmentTheSpanish Impact Evaluation Fund (SIEF) Sebastian Martinez Human Development Network World Bank

2. Impact Evaluation Portfolio in Human Development • 67% of IEs at the WB are in HD • Total of 125 IEs in HD • 98 IEs are considered ‘ongoing’ – have an evaluation designed or data collected • By Sector: • Education (42%) • Health (28%) • Social Protection (25%) • Cross-cutting (5%)

3. Regional Distribution of HD IEs

4. Spanish Impact Evaluation Fund (SIEF) • Gov. of Spain and World Bank: • Shard interest in Results Agenda • TF Managed by HD Network: • Build global knowledge about what works • Build capacity to conduct and consume IE • Disseminate knowledge and improve effectiveness of social policy • 11M Euros between 2007-2010 • Largest TF for IE at WB • But many others supporting and promoting IE

5. SIEF Priorities: • Gov. of Spain sets priority areas & countries • Evaluation of interventions that improve HD Outcomes • 11 broad areas • 66 countries • Policy relevance is key criteria • Test innovative approaches/new questions • Large programs • Favor prospective evaluations with robust methodolgies • Experimental & Quasi-experimental • Control Groups

6. SIEF: Building Global Knowledge About What Works • Three windows of IE funding: • Quick wins: $1.5 million • IEs giving results in 1-2 years • Cluster Fund: $6.0 million • Funding programs of evaluation • Innovation Fund: $1.5 million • Funding stand-alone, highly innovative evaluations

7. SIEF: Cluster Fund ($6m) • First call for Proposals: • Large demand for IE funding • $42 million in requests • 34 Proposed clusters (16 of > 3 proposals) • 163 Individual proposals • Short listed 7 clusters with $10M of requested funding

8. SIEF Funded Clusters • Youth to Work Transition/Active Labor Markets • Conditional Cash Transfers (second generation) • Basic Education Accountability • Health Contracting / Performance • HIV/AIDS • Malaria Control

9. Cluster Approach • Improve coordination and quality of evaluation activities: • Generate “body of knowledge” • Meta-analyses • Communities of Practice: • Common measurement tools • Cross-fertilization between evaluation teams • Quality: • External peer review to access funds • Cluster leaders provide TA

10. SIEF: Capacity Development in IE • 5 field-based regional evaluation workshops per year in partnership with region • 150-200 participants: government, development partners, NGOs, academic • 10-20 IE experts & moderators • Organized around project teams • Technical/policy tracks • Lectures followed by hands on application to projects • Teams develop their own IE concept note • Presentations and feedback from colleagues

11. Dissemination Activities • Publication costs • Spanish translation costs • SIEF website and public use databases • Global/regional conferences

12. www.worldbank.org/sief