290 likes | 473 Views
MONITORING & EVALUATION for HUMAN RIGHTS and GOOD GOVERNANCE NGOs. Training Course DAY 4 NGO Development Center Ramallah, 28, 29 November 2, 3 and 4 December 2012 Trainer: Laura Maritano, PhD. REVIEW DAY 3 PLAN FOR TODAY - Designing an Evaluation process - Introducing M&E in your work.
E N D
MONITORING & EVALUATION for HUMAN RIGHTS and GOOD GOVERNANCE NGOs Training Course DAY 4 NGO Development Center Ramallah, 28, 29 November 2, 3 and 4 December 2012 Trainer: Laura Maritano, PhD
REVIEW DAY 3PLAN FOR TODAY- Designing an Evaluation process- Introducing M&E in your work
PART 7 DESIGNING AN EVALUATION PROCESS
Internal Evaluations • Also called Internal Reviews • Useful for HR-GG NGOs with issues of confidentiality • Focus on Learning • Do them frequently
Proceed as follows: • Organize participatory workshops with all the staff - involve beneficiaries if possible • Review the Theory of Change - focus on how and why - based on evidence from your work • Review the Log Frame - especially Results, Objectives and their Indicators
External Evaluation Principles • Impartiality and Independence • Credibility • Participation of stakeholders • Usefulness but first of all, DO NO HARM!
Questions for preparing Evaluation ToR • Why? Whom for? What target audience? • What do we want to know? • Methodology? How stakeholders are going to be involved in the Evaluation process? • How? By when? Budget?
Evaluation ToR 1. Background to the assignment 2. Evaluation Objectives 3. Issues to be studied: Evaluation questions (OECD criteria etc.) 4. Methodology 5. Dissemination 6. Expertise required 7. Reporting requirements 8. Workplan and timetable 9. (Budget)
Evaluation questions(from Max Pederby - INTRAC) • Analyse Activties and Results: Did we do what we said we would do? Effectiveness and Efficiency (OECD-DAC) In practice: review Activties and Results > say if Activties implemented and Results achieved in a timely (Action Plan) and cost effective (Means and Costs) manner > suggest changes in Activties where necessary Most of M&E reports focus 100% on this – in reality the analysis of Activities and Results is just a part of a M&E report
Analyse Outcomes (and Impacts): Have we made any change? • Effectiveness (and Impact) (OECD-DAC) In practice: review achievement of Specific (and Overall Objective) and their Indicators > say if achieved as formulated
Analyse overall Theory of Change/Intervention Logic: Are we doing the right thing? Relevance, Effectiveness and Sustainability (OECD_DAC) In practice: review Theory of Change > identifiy fallacies > suggest improved Intervention Logic / Theory of Change
A good evaluation report • It answers the main Evaluation questions (5 OECD-DAC Evaluation Criteria) and reviews the Theory of Change and it is structured according to them • It fulfils the ToR: in format and length (max 40 pages + Appednixes); Issues examined; Drafting and dissemination • Report is digestible: structure; language (not academic; depending on end users); recommendations (not too many otherwise not implemntable) • Facilitates learning and change and enables decision making
In groups: Design the Evaluation ToR for your project/programme
Buzz - in groups • How will you use your learning to increase the M&E capacity of your organization?
Some suggestions… • Review what you have learnt and select essential notes and materials so that they can be shared with others • Communicate what you have laernt by organizing a meeting with your bosses and a training workshop with your colleagues • Create alliances • Propose a pilot for introducing /modifiying the M&E system of some projects/ programmes • Propose a M&E policy
REMEMBER THAT… …. a good HR-GG NGO is an organization that is good in learning and adapting its tactics and strategies to changes in the environment.
WRAP-UP DAY 4 To the class: • What is good M&E?
Good M&E for HR work (so far) Day 1 • M&E incorporated in all project cycle • M&E for learning and accountability • Flexibility and adaptability of M&E frameworks • LF vs Composite Logic Models and ToC Day 2 • Clarification of Intervention Logic through Theory of Change • Identification of Stakeholders, Types of Change (Intermediate / Long Term), Assumptions and alternative strategies, Activities
Day 3 Indicators for HR • Anchored to HR legislation • According to Duty Bearers (Structural and Process) and Right Holders (Outcome - Awareness and Empowerment) • Not only Quantitative, also Qualititative Means of Verifications - Quantitative and Qualitative Day 4 • Plan participatory Internal Reviews during which you review ToC and LF • Plan well your External Evalutation by preparing Evaluation ToR • Introduce a M&E system in your organization
INDIVIDUAL FEEDBACKPLANNING- group discussions today- individual sessions tomorrow
Please fill the • Training Evaluation Questionnaire
ACKNOWLEDGEMENTS • EuropeAid, 2004, PCM Guidelines • INTRAC, 2011, Advanced M&E Handbook (Max Pederby)