INTRODUCTION TO MONITORING AND EVALUATION Monitoring and Evaluation

1. INTRODUCTION TO MONITORING AND EVALUATIONMonitoring and Evaluation The National Democratic Institute

2. Introductions/Ground rules • Introductions • Ground Rules • Ice Breaker Exercise

3. Introduction to Monitoring and Evaluation Objectives • To understand the importance of monitoring and evaluation, key concepts and frameworks • To consider how gender can be incorporated into M&E

4. Topics • What is M&E? • Why engage in M&E? • Gender and M&E • Logical framework approach • Project lifecycle • Data collection and analysis • Evaluation design

5. Key Terms • Goal • Target • Baseline • Impact • Gender • Indicator • Input • Output • Intermediate result • Outcome • Objective

6. Exercise: What is Monitoring and Evaluation (M&E)? Image: www.pixabay.com

7. Monitoring • Continuous internal management activity • Ensures that project is on track • Measures progress towards objectives • Identifies problems

8. evaluation • Assessing whether a project is achieving its intended objectives • Conducted periodically • Internal or external • Focuses on outcomes and impacts

9. Why is M&E important? • Tracking resources • Feedback on progress • Improving project effectiveness • Informing decisions • Promoting accountability • Demonstrating impact • Identifying lessons learned

10. Gender and M&E • Gendered priorities, constraints and impact • Failure to address gender leads to inefficient and unsustainable results and exacerbates inequities

11. Gender analysis • Can be undertaken at any stage but most effective if included in design • Systematic way of analyzing different roles and impacts • Asks the “who” questions • How this will affect women and men?

12. Measuring women’s participation and impact • Lack of reliable data on basic facts • Keeps us from getting the most out of investments • “What gets measured gets done” • Not enough invested in collecting data nor in quantifying how equality yields benefits Photo: Getty Images

13. EXAMPLE: Measuring impact • Women’s representation/leadership on Indian local councils: • Better access to drinking water and immunizations • Higher career aspirations and educational attainment for girls Photo: Keith Bedford, International Herald Tribune

14. Logical Framework Goal Strategic Objectives Intermediate Results Outputs Activities

15. Logical Framework

16. Logical Framework Example IF THEN IF THEN IF THEN IF THEN IF

17. EXERCISE: LOGFRAME RACE Put the logframe components in the right order Photo: David Mark, www.pixabay.com

18. Indicators • Outcome versus process indicators • Qualitative versus quantitative • SMART • Specific • Measurable • Achievable • Relevant • Time-bound Photo: www.pixabay.com

19. Baselines and Benchmarks • Baseline • Situation before project • Demonstrates change over time • Benchmarks • What you hope to achieve by the end • Targets • Intermediate benchmarks Photo: www.pixabay.com

20. Sex-Disaggregated Indicators • Sex-disaggregated indicator measures change for men and women separately • Gender indicator measures gender-related changes

21. Gender and the Logframe Goal Evaluation Objective Intermediate results Activities Monitoring Inputs

22. Project life cycle

23. Gender Mainstreaming and the Project Life Cycle Knowledge sharing 1. Design Gender-sensitive M&E Gender analysis/needs assessment Gender expertise Adequate resources 2. Start-up 4. M&E Gender planning Gender-specific action/capacity building 3. Implementation

24. Gender Mainstreaming Strategies/Tools • Involve women and men in consultations • Include sex-disaggregated data • Strive for gender balance in staff/experts • Enable women and men to participate and benefit equally

25. Project Design Questions • Goals and objectives gender-sensitive? • Input from men and women? • Baseline incorporates gender analysis? • Consultations on targets? • Activities reflect gender sensitivity?

26. Project implementation Questions • Gender and sex-disaggregated data? • Comparing data to baseline? • M&E data used to adjust project? • Women’s groups monitoring progress? • Findings disseminated? • References to gender in reports? • Women involved in activities? • Women accessing services?

27. Project EVALUATION Questions • Differences in access? Why? • Differences in impact? Why? • How can differentials be addressed? • How do results compare to targets? • How did beneficiaries respond? • Are results sustainable? Photo: Sanja Gjenero, RGBstock.com

28. Data collection and Analysis • Forms and procedures for data collection • Data collection plan by indicator • Trained staff with clear roles and responsibilities • Database • Regular reflection sessions

29. Secondary data Sources • Regional or country MDG reports • UNDP Human Development reports • State Department Human Rights reports • World Bank reports • World Economic Forum • Donor and NGO reports

30. EXERCISE: INTEGRATING GENDER • Are the indicators gender aware? • Are they input, output, outcome or impact indicators? • Are they quantitative or qualitative? • How would you make them more gender-aware? • Identify 3 additional indicators and how data would be collected. Photo: World Bank

31. Evaluation Design • Identify research questions • Identify methods for data collection • Develop and test data collection instruments and protocols

32. Evaluation Criteria • Relevance • Effectiveness • Efficiency • Impact • Sustainability Photo: Sanja Gjenero, RGBstock.com

33. INTRO TO M&E REVIEW • Improve project effectiveness, demonstrate impact, and identify lessons learned • Must address and mainstream gender • Logframe with sex-disaggregated and/or gender-specific indicators • System for data collection and analysis • Evaluate relevance, effectiveness, efficiency, impact, and sustainability