50 likes | 171 Views
Comparative study on evaluation policies and practices. ODI Report to the AFD. Overview of project (1). Origin of the study AFD launched a reflection then a reform of its evaluation function Implementation
E N D
Comparative study on evaluation policies and practices ODI Report to the AFD
Overview of project (1) • Origin of the study • AFD launched a reflection then a reform of its evaluation function • Implementation • The study has been carried out biy an ODI team, directed by Marta Foresti and with the participation of Christina Archer, Tammie O’Neil and Richard Longhurst • Scope and Objectives • To compare evaluation policies and practices in key agencies from the analysis of Evaluation Unit policies and practices • key features of evaluation function in organisation (e.g. management, position, roles etc. ) • main aspects of evaluation systems, processes and tools • practices involved in commissioning, managing and supporting evaluation processes
Overview of project (2) • Activities • Desk Case Studies: DANIDA, EU, OXFAM, IMF (Evaluation Units) • Full Case Studies: DFID, SIDA, WB, AfDB, KFW (Evaluation Units) • + Key Informants Interviews • Outputs • Case Study Reports • Final Comparative Report • Workshops: Mid Term (AFD Internal), Dissemination: AFD internal + ODI lunchtime meeting (Feb 08) + DAC network (Feb 08) • Topics addressed • Evaluation policy, strategy and mandate • Independence, integration and isolation of evaluation • Types of evaluation and other activities • Evaluation methodologies • Roles, responsibilities and capacity of staff of EUs • Communication, dissemination and use
Emerging trends … • A lot of organisational change and reform processes • Away from projects, towards strategic, policy and joint evaluations. A ‘good thing’ but some concerns about loosing connection with field/programmes • Diversification of activities: KM, ratings and quality control, management follow up, dissemination and outreach. Focus on learning and use • Professionalisation, skills and career development of EU staff a concern: is it possible to have a career in evaluation? Incentives? • Harmonisation and joint evaluation: advantages but several constraints
….and some concluding remarks • Common ‘paradigms’, similar mandates and challenges, increased complexity. Yet, a lot of diversification of practice. Differences between lending agencies, multilaterals and bilaterals • A function in search of identity…..and not getting that close! • Disconnect between rhetoric (on strategic importance of development evaluation) and practice in EUs • An ‘institutional gap’? Need to invest in institutional role of evaluation, at different levels. Quality and use both key factors • Demand for development evaluation: is it enough?