1 / 34

26 June 2014 Geneva

Evaluation Office Annual Evaluation Report 2014. 26 June 2014 Geneva. A reminder: the purpose of evaluation at UNFPA is three-fold. Corporate Evaluations. Programme-level Evaluations. THEMATIC EVALUATIONS Conducted by the Evaluation Office. Corporate Evaluations (2012-2013).

tiger-vaughan
Download Presentation

26 June 2014 Geneva

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation Office Annual Evaluation Report 2014 26 June 2014 Geneva

  2. A reminder: the purpose of evaluation at UNFPA is three-fold Corporate Evaluations Programme-level Evaluations

  3. THEMATIC EVALUATIONS Conducted by the Evaluation Office

  4. Corporate Evaluations (2012-2013) • Country Case Studies: Burkina Faso, Cambodia, DRC, Ethiopia, Ghana, Kenya, Lao PDR, Madagascar, Sudan, Zambia

  5. JOINT EVALUATIONS Conducted by the Evaluation Office

  6. Joint Evaluations (2012-2013) Country Case Studies: Burkina Faso, Kenya, Senegal, Sudan (FGM/C) Country Case Studies: Albania, Kenya, Liberia, Nicaragua, State of Palestine (JGE)

  7. INDEPENDENT COUNTRY PROGRAMME EVALUATIONS Conducted by the Evaluation Office

  8. Independent CPEs covering the UNFPA Regions LACRO - 2011 WCARO - 2011 ESARO – 2012 ASRO: Lebanon (2013 – under finalization in 2014)

  9. PROGRAMME-LEVEL EVALUATIONS Conducted by regional and country offices

  10. Country Programme Evaluations 2012 and 2013 Countries Region

  11. Quality: Programme-Level Evaluations Evaluation Office quality assessment: 27 final reports of programme-level evaluations conducted by country and regional offices 5 (19%) reports rated as good 22(81 %) reports rated poor or unsatisfactory Improvementin quality compared to 2010-2011 (91% rated poor or unsatisfactory) Some specific areas of improvement: 67% of reports meeting needs stated in terms of reference 44% of reports had a good/very good methodology 81% of reports had poor/unsatisfactory findings, analysis, conclusions

  12. Conditions for good quality and credible evaluation Management Adequate results frameworks Results oriented monitoring system in place Access to documentation Access to key informants Participation in reference groups     Evaluators Evaluation function Clear evaluation governance mechanisms Clear evaluation standards Skilled and experienced evaluation managers Adequate planning Adequate budget Adequate procurement system Quality assurance system in place Availability of skilled and experienced evaluators Affordability of skilled and experienced evaluators    ?   ?    Good quality evaluation reports

  13. EVALUATION CAPACITY, USE AND LEARNING

  14. Human Resources UNFPA Country Offices 38 % dedicated monitoring and evaluation officers 62 % focal point for monitoring and evaluation Significant variation between regions WCARO 61%/ ESARO 64%country offices = dedicated M&E staff EECARO 0%/LACRO 24% country offices = dedicated M&E staff Largely reflective of structure and size of the country programmes Regional Office 6 Regional M&E Advisers Evaluation Office 7 approved posts

  15. Building evaluation capacity in UNFPA Skilled monitoring and evaluation staff is a key element to ensure the quality, credibility and use of evaluation To note the key role of Regional Office M&E Advisors Key Activities 2012-14: Seven webinars focused on the preparation, use and quality control of programme-level evaluations Evaluation quality assurance mechanisms established - terms of reference; pre-qualification of evaluators; assessment of the quality of final evaluation reports Handbook on How to Design and Conduct a Country Programme Evaluation at UNFPA Four evaluation training workshops for 134 M&E staff

  16. Key Activities: Handbook on How to Design and Conduct a Country Programme Evaluation at UNFPA PART 2 Conducting the Evaluation PART 1 Designing the Evaluation PART 3 Tools & Resources Toolkit Glossary Outlines Elements of Theory Templates www.unfpa.org/public/home/about/ Evaluation/Methodology

  17. Key Activities: EO Methodology Training Workshops

  18. UNFPA evaluation capacity

  19. Evaluation on the UNFPA Website

  20. The Evaluation Database

  21. Evaluation follow up and use

  22. UNFPA EVALUATION PARTNERSHIPS

  23. UNFPA evaluation partnerships Working with national partners Emphasis on improving the capacity of partners to use evaluation results Key role in evaluation governance (participation in evaluation reference groups) United Nations Evaluation Group Contribution to the task forces of the group and to organisation of the 2013 Evaluation Practice Exchange seminar United Nations system-wide action plan for gender equality Participation in piloting the system-wide action plan on gender equality and the empowerment of women in UNFPA in 2013

  24. EVALUATION FUNCTION IN TRANSITION

  25. UNFPA 2013 Evaluation Policy Creation of an independentEvaluation Office reporting directly to the Executive Board Evaluation Office is independent from: operational, management and decision-making functions = impartial = objective UNFPA Evaluation Plan and Budget 2014-15 Key support role of the Regional Office M&E Advisers Programme Division: Follow-up of recommendations and methodological guidance on results-oriented monitoring (ROM) =

  26. THE ROLE OF THE EVALUATION OFFICE

  27. Where is the EO within UNFPA? UNFPA Executive Board Executive Director Ethics Office (EO) Office of the Executive Director (OED) Evaluation Office (EO) Information and External Relations Division (IERD) Division for Oversight Services (DOS) Deputy Executive Director (Programme) Deputy Executive Director (Management) Office of the Security Coordinator (OSC) Programme Division (PD) Western/ Central Africa Regional Office (WESARO) Eastern/ Southern Africa Sub-Regional Office (ESARO) Asia/ Pacific Regional Office (APRO) Arab States Regional Office (ASRO) Eastern Europe/ Central Asia Reg. Office (EECARO) Latin America/ Caribbean Reg. Office (LACRO) Technical Division (TD) Division for Management Services (DMS) Procurement Services (PSB) CountryOffices Country Offices Pacific Sub-Regional Office Country Offices Central Asia Sub-Regional Office Caribbean Sub-Regional Office Management Information Systems (MIS) Division for Human Resources (DHR) Southern/ Western Asia Sub-Regional Office Country Offices Country Offices Country Offices

  28. Role of the Evaluation Office The custodian of the evaluation function at UNFPA. Key functions: Contribute to accountability for results and, through high-quality evaluations, to generate learning to help UNFPA improve its strategies and programmes, including delivery of the new Strategic Plan Conduct corporate evaluations (thematic evaluations and independent country programme evaluations) Ensure the quality and utilization focus of UNFPA evaluations

  29. Role of the Evaluation Office (cont.) • Actively contribute to knowledge sharing on evaluation results and lessons learned • Lead capacity development and professionalization of the evaluation function at UNFPA • Prepare the UNFPA budgeted evaluationplan and report to the Executive Board • Contribute to the evaluation practice within the UN, including capacity development of partners

  30. LOOKING FORWARDS: CHALLENGES AND PROSPECTS 2014-2015

  31. Looking forwards: programmeof work Evaluation Office: UNFPA support to adolescents and youth, 2008-2014 Evaluation of UNFPA support to population and housing census data to inform decision-making and policy formulation, 2005-2014 UNFPA support to the availability of quality family planning services, 2008-2013 UNFPA country programme in Turkey, 2011-2015 UNFPA country programme in Bangladesh, 2012-2016

  32. Country Programme Evaluations 2014 and 2015 Geographical Coverage 4 March 2014

  33. Looking forwards: areas for attention Continued efforts to improve quality and credibility of all UNFPA evaluations Increased coordination between the Evaluation Office and Regional Office M&E Advisers to better support Country Offices Capacity development and professionalization of the evaluation function Enhancing evaluation follow-up and use

More Related