Monitoring & Evaluation in World Bank Agriculture and Rural Development Operations

1. Monitoring & Evaluation in World Bank Agriculture and Rural Development Operations SASAR Monitoring & Evaluation Workshop New Delhi; June 20, 2006

2. Purposes of M&E • Improve design or implementation during project • Planning and allocating resources • Measure and demonstrate results • Inform future decision-making and project designs

3. What Is M&E? There is a difference between M and E! Monitoring: The gathering of evidence to show what progress has been made in the implementation of programs. Focuses on inputs and outputs. Evaluation: Measuring changes in outcomes and evaluating the impact of specific interventions on those outcomes.

4. Monitoring Routine collection of information Tracking implementation progress Measuring efficiency “Is the project doing things right ?” Evaluation Analyzing information Ex-post assessment of effectiveness and impact Confirming project expectations Measuring impacts “Is the project doing the right things?” Complementary Roles for Monitoring and Evaluation

5. Steps to Design a M&E System • Plan for M&E • Developing the Results Framework • Determine information sources and design • Plan to analyze and use results • Complete and test the system • Annual self-assessments and periodic external evaluation

6. The M&E Plan • What? • Type of information and data to be consolidated • How? • Procedures and approaches including methods for data collection and analysis • Why? • How the collected data will support monitoring and project management

7. The M&E Plan • When? • Frequency of data collection and reporting • Who? • Focal points and resource persons. Responsibilities and capacities.

8. Institutional and Human Capacity Requirements • Establishing an M&E Unit • Centralized/project specific • Collaboration across co-implementing institutions • Institutionalizing and Harmonizing M&E systems • Facilitates sector wide planning, development of policies and knowledge sharing • Allocate sufficient time and resources

9. Data Collection & Analysis • Prior to project start • Baseline data: at an absolute minimum baseline data are required on each outcome indicator and results indicator. • During the course of the project • Data on implementation, physical and financial progress. • At critical junctures and project completion • Data for assessing achievements and impacts.

10. Some Data Collection Methods • Formal Surveys • Household Surveys • Core Welfare Indicators Questionnaire (CWIQ) • Client Satisfaction (or Service Delivery) Surveys • Citizen Report Cards • Participatory Methods • Participatory M&E • Public Expenditure Tracking Surveys • Remote Sensing

11. Project Management Information System What is it? • System for collection, analysis, storing and dissemination of project information • Supports management in making timely and effective decisions for planning, monitoring and managing a project/program • Generally consists of accounting software and a database management system

12. M&E in the Project Cycle • Preparation • M&E planning, Results Framework, baseline survey, resource allocation, reporting formats, capacity assessment • Appraisal • Development of detailed M&E plan, manual of procedures, preparation of ToRs, M&E training program, agree on Results Framework

13. M&E in the Project Cycle • Between end-of-negotiations and project effectiveness • M&E unit established • Baseline completed • Implementation & Supervision • ISR • Mid-term Review • Implementation and Completion • ICR • Sustainability of M&E systems

14. Necessities for Successful M&E • M&E must have strong ownership and support from leaders • M&E requires expert support • M&E needs broad stakeholder consultation in defining and setting target indicators • M&E training is essential for success • M&E systems have to be user-friendly