M&E Basics Miguel Aragon Lopez, MD, MPH. UNAIDS M&E Senior Adviser 12 th May 2009

1. M&E BasicsMiguel Aragon Lopez, MD, MPH.UNAIDS M&E Senior Adviser12th May 2009

2. Why Standardized M&E Terminology? • A common understanding of M&E terminology is critical for: • maintaining clear communication • taking a common approach UNCT 26th February 2009

3. M&E Definitions: Why Standardized M&E Terminology? • Monitoring—routine tracking and reporting of priority information about a plan / program / project, its inputs and intended outputs, outcomes and impacts • Measurement of progress toward achieving program/project objectives; most often involves counting what we are doing. UNCT 26th February 2009

4. M&E Definitions: Why Standardized M&E Terminology? Evaluation—the rigorous, scientifically-based collection of information about plan / program / intervention activities, characteristics, and outcomes that determine the merit or worth of the program/intervention

5. The Purpose of M&E Program Improvement Data Sharing with Partners Reporting/ Accountability

6. M&E Definitions: Results – RBM approach • UNDAF and agency programmes in terms of a hierarchy of SMART results which has five levels: • MDG related national priority/ goal (equated with impact) • UNDAF outcome, know in Moz also as pillars • Outcome of one or more agencies working together • Output usually of one agency, but possibly of more than one working together • Activity Result

7. M&E Definitions: Results – RBM approach

8. The chain of results: causal sequence for an intervention to achieve desired objective ACTIVITIES OUTPUTS OUTCOMES IMPACT INPUTS Quality of life Conditions: . Human . Economic . Civic . Environment MDGs: . Poverty . Morbidity . Mortality . HIV prevalence . Education . Employment . Gender equality . Services - Access - Quality . Awareness . Knowledge . Attitude . Capacities . Competency . Opinion . Aspiration . Motivation . Behaviors . Practices . Decision . Utilization of services .Infrastructure . Human . Finance . Equipment . Technology . Policy . Time . Volunteers . Partners . Management . Training . Counseling . Logistic management . Operation research . BCC . Conference . Facilitation . etc. UNCT 26th February 2009 Measure process Measure impact

9. What & how well we are doing? Outcomes Planning Implementation -Formative Evaluation (Planning and Assessment) -Input/Output Monitoring -Process Evaluation -Outcome Monitoring -Outcome Evaluation -Impact Monitoring -Impact Evaluation

10. Baselines, targets and performance Commitment Performance Current level of achievement Baseline Target Achievement

11. WFP Emergency Operation M&E Framework RESULTS ImpactIncreased consumption especially W, Ch & V Ind. Input (Resources) Output Targeted women receiving full family ration OutcomesIncreased household food supply Activities ( Interventions, Services) X kg maize, X kg oil X Kg other Distribution of Family ration to Women # of family ration recipients disaggregated by gender % of target house Hold with adequate Food supply Average # of Meals per day by gender and age Population-based Survey Program-based Data Measure process Measure impact

12. HIV/AIDS M&E Framework Impact(Long-termEffects) Input (Resources) Assessment & Planning Output (Immediate Effects) Outcomes(Intermediate Effects) Activities ( Interventions, Services) Situation Analysis Response Analysis Stakeholder Needs Resource Analysis Collaboration plans Staff Funds Materials Facilities Supplies Trainings Services Education Treatments Interventions # Staff Trained # Condoms Provided # Clients Served # Tests Conducted Provider Behavior Risk Behavior Service Use Clinical Outcomes Quality of Life Social Norms HIV prevalence STI Incidence AIDS Morbidity AIDS Mortality Economic Impact Program Development Data Population-based Biological, Behavioral & Social Data Program-based Data Measure process Measure impact

13. M&E Definitions: Indicators An Indicator is…. a variable that measures oneaspect of a program/project and useful to measure changes Indicators are measures used to monitor progress made towards theachievement of intended RESULTS, considering as the output, outcome or impact of a development intervention.

14. M&E Definitions: SMART Indicators Specific: indicators need to measure what they claim to measure Measurable: can be quantified and measured by some scale Achievable: can data on the indicator actually be colleted? Relevant: does it provide information that is relevant to the programme decision makers? Time-bound: when is change expected?

15. Strategic Planning for M&E: Setting Realistic Expectations All Most Some Few* Number of Projects Input/ Output Monitoring Process Evaluation Outcome Monitoring / Evaluation Impact Monitoring / Evaluation Levels of Monitoring & Evaluation Effort 15

16. Key messages: • The main purpose of M&E is programme/project improvement. • M&E is not only about INDICATORS. • M&E is an essential management tool and it is present along programme/project implementation. • M&E starts with the planning process.

17. THANK YOU