Monitoring & Evaluation (M&E) For Livelihoods

1. Monitoring & Evaluation (M&E) For Livelihoods Presented by PMER Coordinator-IFRC (Mununuri Musori) for Livelihoods Cluster meeting

2. M&E Overview (key concepts)

3. Evaluation Periodic assessment of project performance (achievements or value). Answers why something happened or what difference it made. So what? Is the project reaching its goals? What is the impact? What is “M” & “E”? Monitoring Ongoing collecting information for project management. Answers “what happened”? Trained 200 community facilitators Handed out 2000 booklets

4. Evaluation Making judgments based on that data. Periodical: annual, midterm, and final evaluations. What is the difference between Monitoring and Evaluation? Monitoring Collection of data. Ongoing: daily, monthly, or quarterly reporting.

5. 4 key phases of RBM: Initial Assessment Planning: project/ program design. Implementation & Monitoring Evaluation What are the 4 phases of the project cycle?

6. Initial Assessment • Planning • 1. Logframes • 2. M&E Plan • Monitoring • 3. Indicator Tracking Table (IIT) • 4. Stakeholder Complaints & Feedback Mechanism • 5. Project Report • Evaluation • 6. Evaluation Framework M&E and the Project Cycle

7. What are key questions to answer so we can better manage our projects/programs? Are activities being implemented on schedule, in a cost-effective, efficient manner? Is the project achieving the desired results? Are the results likely to be sustainable? Is the project having the desired impact on the target group? Are there any unintended, negative impacts from the project? Is the project still relevant to target group/s? What are the perspectives of the beneficiaries and other stakeholders? Is the project team behaving

8. Is the intended outcome being achieved? Outcome What is causing delays or unexpected results? Is there anything happening that should lead management to modify the operation’s implementation plan? Are Activities leading to expected outputs? Are activities being implemented on schedule and within budget? Activities Are finance, personnel and materials available on time & in the right quantities & quality? Inputs Monitoring Questions Measuring changes at Goal level requires a longer time frame, and is therefore dealt with by evaluation and not monitoring Goal Are outputs leading to achievement of related outcome? Outputs

10. Types of Monitoring Activity (process) monitoring: focuses on quantity, quality and timeliness of inputs and activities. Results (performance) monitoring: focuses on achievement of planned results, especially outputs and outcomes. Compliance monitoring: focuses on compliance with established standards, procedures, etc (but not audit). Beneficiary monitoring: focuses on the beneficiary perception of the intervention (non-beneficiaries too). Context monitoring: focuses on the project context/environment, especially critical assumptions that can affect the implementation and progress of the project. Financial monitoring: accounts for costs by input and activity within predefined categories of expenditure. Often conducted in conjunction with compliance and process monitoring.

11. ActivityMonitoring Community consultation and participatory design. • Funds • Staff • Buildings • Equipment Increase in livelihoods capitals Vocational Students employed Students earning an income above PDL Goal Activities Outputs Outcome Inputs

12. Input and ActivityMonitoring indicator examples Inputs Indicators for VE: • Number of staff with the right skills hired • Quantity of material available • Availability of budget lines for all activities and procurements Process\Activity Indicators for VE: • Number of training institutions identified • Number of students enrolled • Number of students attending class • Number of students on attachment\placement

13. Results Monitoring Community consultation and participatory design. Students earning an income above PDL Increase in livelihoods capitals • Funds • Staff • Buildings • Equipment Vocational Students employed Activities Outputs Outcome Inputs Goal

14. ResultsMonitoring indicator examples Output Indicators for VE: • Number of former students employed • Number of former students self employed • Number of jobs created Outcome Indicators for VE: • Income realized from enterprise • Income from employment

15. M&E Standards and Ethics • Why are standards and ethics important for M&E? • Collecting, analyzing, and communicating information about people should have particular regard for the welfare of those involved in and affected by this!

16. What are good M&E Standards and Ethics? • M&E should uphold international principles and standards • M&E should respect the customs, culture, and dignity of human subjects. • M&E practices should uphold the principle of “do no harm.” • When feasible and appropriate, M&E should be participatory. • An M&E system should ensure that stakeholders can provide comment and voice any complaints.

18. Attention to gender and vulnerable groups Why is it important in M&E to give particular attention to gender and vulnerable groups? • To ensure equity in the provision of service, based on need alone (Principle 2 of the Code of Conduct). What are some examples of vulnerable groups? • Inequalities in society related to gender, race, age, sexual orientation, physical or intellectual ability, religion, or socioeconomic status.

19. What can be done to address balanced representation of potentially vulnerable groups? • Do not just collect data from the dominant voices, but also seek out those that are marginalized. • Collect and analyze data so that it can be disaggregated by sex, age, and any other social distinctions.

20. Addressing bias & error Accuracy • Data measure what they are intended to measure. Precision • Data measurement can be repeated accurately and consistently over time and by different people. Bias • When accuracy and precision of a measurement is threatened by: • The experience, perceptions and assumptions of the researcher • The tools and methods used for measurement and analysis

21. M&E Benefits? • Uphold accountability and transparency. • Demonstrates our work is completed as agreed and in compliance with established standards. • Allow stakeholders to have a voice to express their opinion, grievances, etc. • Demonstrates we are open to critical feedback, and willing to learn from experiences and change. • Promote work and celebrate our work. • Reliable M&E used for resource mobilization and advocacy and not perceived as a pure marketing. • Demonstrates the returns we get from investment of resources.