190 likes | 366 Views
Step 4: Monitoring and Evaluation. Tracking UNDAF Results. 2. Mandatory Steps. 1. Road Map. 3. Strategic Planning. Monitoring and Evaluation are distinct and required. 3. 1. Road Map. Monitoring Tracks progress towards results agreed in matrix
E N D
Step 4: Monitoring and Evaluation Tracking UNDAF Results
2 Mandatory Steps 1. Road Map 3. Strategic Planning
Monitoring and Evaluation are distinct and required 3 1. Road Map • Monitoring • Tracks progress towards results agreed in matrix • Checks if assumptions & risks are still valid • Helps UNCT & partners to make mid-course corrections • Integral part of programme management • Evaluation • Determines whether results made worthwhile contribution to national development priorities • Makes essential contribution to managing for results • Is an external function separate from programme management • Helps UNCT & partners to make mid-course corrections
M&E Plan 4 4. M&E 1. Road Map • Designed at the same time with & based on results matrix • Provides operational detail about inter-agency mechanism and processes for monitoring UNDAF performance and reporting • Data for the results indicators drawn from national systems. If data not available, baseline studies can be supported • The M&E Plan may be reflected in a table or in the narrative of the UNDAF document
Elementsof M&E 5 4. M&E 1. Road Map • Develop the mandatory M&E Plan • Conduct the mandatory UNDAF annual review process with Government • Produce a single UNDAF progress report per cycle • Conduct evaluation of the UNDAF
Background Essential for assessing progress along the results chain Ability to demonstrate, report on and communicate results important for attracting financial resources How well one is able to monitor and evaluate UNDAF is a function of how well it is designed, the availability of human and institutional capacity in-country and the availability of adequate tools and systems
M&E in Results-Chain effectiveness efficiency Inputs Activities Outputs Outcomes Impact Indicators Assumptions/Risks
Capacity Issues In house – is there sufficient dedicated capacity Government capacity – national systems Capacity development
Tools UNDAF Info Agency/UN/Government m&e systems Survey instruments Research and evaluation agenda UNDAF evaluation Survey instruments Key performance indicators
Systems Annual Reviews M&E task forces Systems for field reporting Reviews of progress in operations
UNDAF Annual Review 11 4. M&E 1. Road Map • Required annually & has to be documented • Aligned with national reviews as far as possible • Provides evidence from monitoring mechanisms • Provides lessons learned and good practices • Identifies possible constraints & challenges • Provides opportunities for government & stakeholders to lead the process
UNDAF Progress Report 12 4. M&E 1. Road Map • Required once per cycle • Reports how outputs produced by UN contribute towards progress in achieving outcomes in UNDAF Results Matrix • Detailed guidance, template and examples available in Standard Operational Format & Guidance for Reporting Progress on the UNDAF www.undg.org/undaf
UNDAF Evaluation 13 4. M&E 1. Road Map • Determines whether results made a worthwhile contribution to national development priorities • 3 key questions: • Did the UNDAF make the best use of the UNCT’s comparative advantages in the country? • Did the UNDAF generate a coherent UNCT response to national priorities? • Did the UNDAF help achieve the selected priorities in the national development framework?
PERFORMANCE INDICATORS Impact • Performance indicators: • are measures that show results relative to what was planned at each level of the "results chain". Outcome Output • are tools for performance-based decisions about programme strategies and activities. • can also be used later as an input to evaluating project/programme success. Process Input
INDICATORS: TYPES Indicators exist in many different forms: • Direct indicators correspond precisely to results at any performance level. • Indirect or "proxy" indicators demonstrate the change or results if direct measures are not feasible. Direct Indirect / proxy • Indicators are usually quantitative measures, expressed as percentage or share, as a rate, as a ratio. • Indicators may also be qualitative observations. Qualitative Quantitative Global / standardised • Standardised global indicators are comparable in all settings. • Other indicators tend to be context specific and must be developed locally. Locally developed
PERFORMANCE INDICATORS Impact Impact Measure the quality and quantity of long-term results generated by programme outputs. Measure the intermediate results generated by programme outputs. They often correspond to any change in people’s behaviour as a result of programme. Outcome Outcome Measure the quantity, quality and timeliness of the products — goods or services — that are the result of an activity/project/programme. Output Output Measure the progress of activities in a programme/project and the way these are carried out . Process Process Input Input Measure the quantity, quality and timeliness of resources provided for an activity/project/programme.
EXAMPLE Impact Impact Reduction in morbidity and mortality Proportion of target population who meet prescribed standards of behaviour Outcome Outcome Number whose behaviour change Output Output Number whose opinions change Number who learn the facts Number who read the literature Process Process Number of people who receive the literature Input Input Amount of literature distributed Number of pieces of literature available for distribution
Issues to keep in mind Validity – does it measure the result Reliability – is it a consistent measure and will data be available over time Sensitivity – When a change occurs will it be captured by the indicator Simplicity – will it be easy to collect the information Affordability – can we afford to collect the necessary information