1 st M&E Network Forum 07 to 08 November 2011 Manila

1. Evaluation of sector programmes and budget support operations in the context of EU development cooperation 1st M&E Network Forum 07 to 08 November 2011 Manila

2. Outline • Background • Evaluation in the context of EU Development Cooperation - General Principles • EU Health Sector Programme and Support in the Philippines • Overview • Evaluation Methodology • Outlook • Evaluation of Budget Support

3. Evaluation – General Principles • Definition: An evaluation is a judgement of interventions according to their results, impacts and needs they aim to satisfy - European Commission, 2000 • Role: • Lesson learning • Improving quality and the design of future interventions • Accountability • Ex-ante, mid-term, ex-post • Independent, external, balanced • Identifying performance-related questions, information needs and indicators

4. IDEA EXAMPLE IMPACT (demand driven) Wider effects Consequences of outcomes Infection rates OUTCOME/ RESULT Focus Results at the level of beneficiaries (supply meets demand) Vaccination rates OUTPUT (supply driven) Concrete consequences of resources or measures taken Vaccines provided INPUT/PROCESS (supply driven) Money or measures taken Funds Budgeted/spent, laws passed Evaluation – General Principles

5. Impacts Outcomes NeedsChallenges Objectives Inputs Outputs Efficiency Coherence Effectiveness, sustainability impact, EC value added Effectiveness, sustainability impact Evaluation – General Principles Relevance

6. EU Health Sector Support • Health as focal sector of EU support Assistance to Health is core activity of Delegation • 3 ongoing programmes • Health Sector Policy Support Programme I(2006 -2011; € 33 M) • In support of FOURmulaOne for Health • Support to central/national level (DoH, DBM) & provincial/local level (16 convergence provinces) • Sector Budget Support, WB trust fund & EU TA for DoH and provinces

7. EU Health Sector Support Mindanao Health Sector Policy Support Programme(2007-2012; € 12 M) Support to 13 out of 21 roll-out provinces WB trust fund & EU TA for LGUs Health Sector Policy Support ProgrammeHSPSP II (2011-2014; € 36 m) In support of Aquino Health Agenda to achieve Universal Health Care Sector Budget Support 2 more in the pipeline Addressing Maternal Neonatal Child Health and Nutrition (MNCHN) Needs of ICCs/IPs in Mindanao (€ 7 m) HSPSP III (€ 35 m)

8. EvaluationEU Health Sector Support Objective • to provide the DoH, the European Commission and other stakeholders with sufficient information to make an informed judgment about the past performance of the programme, particularly its contribution to the implementation and performance of the Health Sector Reforms with particular attention to performance against the established targets and indicators, and to provide lessons learnt and practical recommendations for ongoing and future interventions. • Ex-post • Ex-ante

9. EvaluationEU Health Sector Support • Focus on HSPSP I • But also take into account MHSPSP and HSPSP II • External evaluation team • Evaluation criteria based on OECD DAC criteria • Adherence to aid effectiveness principles • Partnership approach under government leadership • As much as possible jointly with other development partners within the Joint Assessment and Planning Initiative (JAPI) • Use of country systems

10. EvaluationEU Health Sector Support Key issues to be looked at: • Achievements in Health Sector Reforms • Sector perspective at national as well as LGU level • Contribution of EU support • Technical component • Financial component • Role and value added of technical assistance

11. Output Clusters Results (Outcomes) Specific Impacts Intermediate Impacts Global Impacts Health Financing Reform Improved Health Insurance coverage and financial protection Better and sustained financing for health Social Development Reduction in Mortality Regulatory Reforms Enhanced Service and Drugs Availability & Quality Quality and affordability of health goods and services MDG 4 Poverty Reduction MDG 5 MDG 8 MDG 6 MDG 1 Service Delivery Reforms Access to and utilisation of essential and basic health packages Reduction in Morbidity & Disability Economic Growth Improved financial management and procurement Governance Improve the performance of the health system Improved planning, monitoring and reporting

12. Evaluation of Budget Support • EC has developed a new methodology • Role • The results of an evaluation are expected to feed into (i) the implementation of future budget support operations; (ii) possible changes in policy, approach, and/or methods; and (iii) to support decisions on the circumstances when/where budget support is an appropriate and relevant instrument. • Basis for disbursement of budget support

13. Evaluation of Budget Support • Results are difficult to evaluate • Very heavy, time-consuming and costly exercise • 2 main categories of effects: • “flow-of-funds” • policy or institutional effects • Emphasis on access to services and use of quality services

14. Evaluation of Budget Support STEP 1 STEP 2 STEP 3

15. Questions • Role and involvement of NEDA and other gov agencies, civil society, other development partners in evaluation? • Link with other development partners assistance? • How to strengthen policy dialogue? • Moving towards a sector reform contract in the future

16. Salamat Po! Thank you!