2nd Results- Based M&E Workshop

1. 2nd Results- Based M&E Workshop Overview in Institutionalizing M&E System in Cambodia By Rebecca V Polestico, PhD 19-20 May 2011 2nd Results-Based M&E Workshop Salon II Raffles Le Royal Hotel Phnom Penh, Cambodia Institutionalizing M&E System in Cambodia

2. 2nd Results- Based M&E Workshop Discussion Points Objectives Principles of Monitoring and Evaluation -Results-Chain Roles of Monitoring and Evaluation Monitoring and Evaluation System Description Attributes Public Sector Management Components Attributes Results-Based Assessing Capacity Development Skills Institutionalizing M&E System in Cambodia

3. 2nd Results- Based M&E Workshop Objective (s) To differentiate Monitoring from Evaluation To examine the generic components, features and functions of M&E System To identify the capacity skills needed in developing M&E System To adopt the processes in institutionalizing M&E System in RDMs Institutionalizing M&E System in Cambodia

4. Monitoring is the continuous assessment of project implementation vis-à-vis schedules and of the use of inputs and services by beneficiaries Provides managers and stakeholders with continuous feedback on implementation Identifies actual or potential successes and problems early to facilitate timely adjustments Evaluationis the periodic assessment of a project’s relevance, performance, efficiency and impact Managers undertake interim evaluations during implementation as a review of progress and a prognosis of likely effects. Necessary adjustments to project design may be identified. Mid-terms reviews have become popular for the same reason Terminal evaluations are conducted at the end and include an assessment of a project’s effects and their potential sustainability Definitions

5. Monitoring Evaluation Clarifies programme objectives Analyses why intended results were or were not achieved Links activities and their resources to objectives Assesses specific causal contributions of activities to results Translates objectives into performance indicators and set targets Examines implementation process Routinely collects data on these indicators, compares actual results with targets Explores unintended results Reports progress to managers and alerts them to problems Provides lessons, highlights significant accomplishment or program potential, and offers recommendations for improvement Complementary Roles of Results-Based Monitoring and Evaluation 2nd Results- Based M&E Workshop Institutionalizing M&E System in Cambodia

6. With reference to APCOP MfDR Framework Attributes of Results-Based Monitoring and Evaluation Monitoring Evaluation Indicators from planning Methodology formulated or designed Institutional responsibilities defined Institutional responsibilities defined Data Management Systems specified (Data encoding, programming, processing and reporting) Results dessiminated or shared Stakeholders engagement Analysis and reporting specified 2nd Results- Based M&E Workshop Institutionalizing M&E System in Cambodia

7. M&E System Defined A paper or computer-based tracking mechanism which is indicator-driven, outcome-led and impact-based derived from developed results of any specified intervention strategy, capturing changes contributing to the effectiveness and efficiency of any program development initiatives and setting.

8. Consists of eight components with stakeholders involvement and beneficiary-centred Focused on the planning, management, budgeting and resources availability within a timeframe It’s the process of getting the results developed (RBM) and managing for developed results (MfDR) M&E System: Description

9. Eight Components of M&E System Design • Review of Project Goals and Objectives • 2. Clear statements of measurable project performance objectives for which indicators can be defined • 3.Structured set of indicators, covering outputs and their impacts on beneficiaries using the Results-Based Management Logframe • 4.Consensus development of evaluation tools for structured and non-structured data gathering techniques • 5. Provisions of collecting data and managing project records so that data required for indicators are compatible with existing statistics and available at reasonable cost • 6.Reporting and Feedbacking on the data quality assessment, validation and process checks • 7. Institutional arrangements on the Formative and or Summative Evaluation (Interim) • 8.Information Exchange on the M&E findings for feed back into decision making 9 Institutionalizing M&E System in Cambodia

10. 3. Results-Based Management Logframe 2. Indicators Or Performance Measures 4. Development of tools and forms Results 1. Project Goals, Purposes, Objectives, and Specific Objectives 5. Data Management : Data Collection, Encoding and Programming Information Processing and Analysis 8. Information Sharing and Exchange or Feedback Mechanism 6. Institutional Arrangement 7. Interim Evaluation: Formative or Summative M&E System and Capacity Building Framework M&E System

11. Level of Results MfDR in Rural Development Workshop 6/7 December 2010 11

12. Cambodia Millennium Development Goal (MDG) To reduce poverty…… Institutionalizing M&E System in Cambodia

13. 13 Institutionalizing M&E System in Cambodia

14. Brief Look at the Rectangular Strategy SDP Framework Programs Projects Activities 14

15. Government Documents 15 Institutionalizing M&E System in Cambodia

16. NSDP:Key Indicators for Agriculture, Fisheries, and Forestry

17. MAFF M&E System and Indicators 17 • MAFF has 5 programs • Enhancement of Agricultural Productivity and Diversification • Enhancement of Market access for Agricultural Production • Strengthen Institutions, Legal, HRD • Sustainable Fisheries Resource Management • Sustainable Fisheries Resource Management • Each program is broken down into sub-programs – e.g for P1, S1 = soil improvement, S2 = increasing crop production, etc. • Each sub-program broken down into activities – e.g. for S1, A1 = dissemination of compost fertiliser; A2 = crop zoning in communes.

18. MAFF M&E Information System

19. Session 3 - Outline of MAFF M&E System and Indicators MfDR in Rural Development Workshop 6/7 December 2010 19 Form P1 – Form P1 - Ministry Programme Budget Summary.doc Form P2 – Form P2 - Programme Profile.doc Form P3 – Form P3 - Sub-Programme Profile.doc Form P4 – Form P4 - Activity Profile.doc Form M1 – Form M1 - Quarterly Monitoring Report.doc Form M2 – Form M2 - Annual Monitoring Report.doc Form M3 – Form M3 - Site Visit Report.doc Form E1 – Form E1 - Sub-Programme Evaluation.doc Form E2 – Form E2 - Programme Evaluation Summary.doc

20. 20

21. Indicator Trackingand Results-Chain PBMIE I N D I C A T O R Impact Outcome Input Activities Output Target or Timeframe Agencies: MAFF, MRD, MOWRAM, MEF, MOP, MOE, MOL Institutionalizing M&E System in Cambodia

22. Indicator Tracking Target: By 2015 Crop production improved by 20% (Planned-Budgeted-Implementation-Monitoring-Evaluation) Indicator At least 20 acres of land Irriga-ted Impact Improved crop harvest Outcome Irrigated lands increased 10% annually Activities Purchase of Equipment Output 48 Tractors purchased InputAcquisition of farm 48 tractors Questions: Indicator linked to planning? Resource allocated? Implemented? By who? Systems used to track results Established ? Evaluated? Feedback mechanism? Level of Results Implementing Agency : MAFF, MRD, MOWRAM, MEF, MOP, MOE, MOL Institutionalizing M&E System in Cambodia

23. Core Attribute 1: What to consider 23 Institutionalizing M&E System in Cambodia

24. Core Attribute 2: What to consider in keeping relevant information? 24 Institutionalizing M&E System in Cambodia

25. Panel Surveys Key informantinterviews Conversationwith concernedindividuals Focus Group Interviews One-Time Survey Participant Observation Direct observation Community Interviews Census Reviews of official records (MIS and admin data) Fieldexperiments Fieldvisits Questionnaires Informal/Less Structured Methods More Structured/Formal Methods Data Collection Methods

26. Core Attribute 3: What to consider in managing information? 26 Institutionalizing M&E System in Cambodia

27. Core Attribute 4: What to consider in strengthening ownership? 27 Institutionalizing M&E System in Cambodia

28. Opening Session:Introduction I 28 Institutionalizing M&E System in Cambodia

29. Plan Budget Evaluate Results-Based PublicSector Management Implement Monitor Plan Plan Core Results Attributes Budget Budget Evaluate Evaluate Focus on Common Results Results Inter-dependent PSM components Implement Implement Monitor Monitor Horizontal and Vertical Integration Continuous Learning Informed Decisions

30. Core Results Attributes: RDMs

31. Country Setting Results-Based Management • PLAN FOR RESULTS • President’s Guidepost (16 areas for transformative leadership) • PDP • RM • PIP • BUDGET FOR RESULTS • MTEF • OPIF • GAA-NEP • ABM • ICC Programming- only FAPs consistent with plan are approved • EVALUATE RESULTS • SER • MDG Reports Results • MONITOR RESULTS • ODA Review • BPAR • RM/ OPIF Monitoring • OPES • COA Audit Reports • IMPLEMENT FOR RESULTS • Agency PAPs • ICC Reevaluation

32. 32 Institutionalizing M&E System in Cambodia

33. Results-Oriented M&E Workshop Results-Based M&E has two handles: One of Fear and the other is Opportunity Institutionalizing M&E System in Cambodia