660 likes | 1.05k Views
MONITORING AND EVALUATION TOOLS Monitoring and Evaluation. The National Democratic Institute. Introductions/ Ground rules. Introductions Ground Rules Ice Breaker Exercise. Photo: Sanja Gjenero, RGBstock.com. Monitoring and Evaluation (M&E) Tools Objectives.
E N D
MONITORING AND EVALUATION TOOLSMonitoring and Evaluation The National Democratic Institute
Introductions/Ground rules • Introductions • Ground Rules • Ice Breaker Exercise Photo: Sanja Gjenero, RGBstock.com
Monitoring and Evaluation (M&E) Tools Objectives • To become familiar with and practice using a range of M&E tools • To consider when and how the tools can be employed during the project life cycle
M&E Tools Topics • What is M&E? • Gender analysis • Project lifecycle • Data collection • Program design tools • Evaluations • Other tools Image: www.pixabay.com
Key Terms • Goal • Target • Baseline • Impact • Gender • Stakeholder • Indicator • Input • Output • Intermediate result • Outcome • Objective
M&E Defined • Monitoring • Continuous • Ensures project on track • Identifies problems • Evaluation • Assesses whether project is achieving objectives • Periodic • Focuses on outcomes and impacts
Gender and M&E • Gendered priorities, constraints and impact • Failure to address gender leads to inefficient and unsustainable results and exacerbates inequities
Data collection Tools • Quantitative methods • Household surveys • Public opinion polls/surveys • Qualitative methods • In-depth interviews • Focus groups • Direct observation • Document review • Participatory assessments
Exercise: Which tools? When? • Multi-workshop training program for women political activists • Objective: Improve the capacity of women to run for elected office • Which data collection tools? When? Photo: Amy Hamelin, NDI
Example: Which tools? When? • Workshops • Pre-and post questionnaires • Evaluation forms • In between events • Direct observation • End of project • Focus groups • In-depth interviews • Election results Photo: Amy Hamelin, NDI
Program design tools • Gender, context and stakeholder analysis • Problem and objective analysis • Activity plan • Indicators • Critical assumptions • Risk analysis and management • Resource plan • Results framework Image: www.pixabay.com
Gender analysis • Can be undertaken at any stage but most effective if included in design • Systematic way of analyzing different roles and impacts • Asks the “who” questions • How this will affect women and men?
Context analysis • Institutions or vehicles that have positive or negative impact? • Key actors or factors that help or hinder? • Socio-cultural, political and economic environment?
stakeholder analysis • All people who have a stake • Participants • Implementers • Decision-makers • Donors • Who are they? • What is their interest? Influence? Power? • Relations with other stakeholders
stakeholder analysis High • Survey all people who have a stake INFLUENCE Low High Low POWER
Exercise: stakeholder analysis • Program to enhance the capacity of the Liberian legislature to represent citizen’s interests • Identify stakeholders • Plot them on chart Photo: NDI
Exercise: problem Tree • Problem: Low level of women in elected bodies • Identify root causes • Identify effects • Link root causes to their effects Photo: www.pixabay.com
objective analysis • Links problem analysis to program design • Provides visual map • Defines scope of program • Maps out pathway of change • Identifies what will be monitored and evaluated • Facilitates planning and management
objective analysis • Core problem reframed as objective • Root causes reframed as intermediate results
Indicators • Qualitative versus quantitative • SMART • Specific • Measurable • Achievable • Relevant • Time-bound • Negative effects reframed become indicators Photo: www.pixabay.com
Critical assumptions • Factors outside our control • Conditions under which program logic will hold true • Conditions likely to affect achievement of results • Identify at each level of framework
Risk analysis and management • Every program entails risk • Identify risks and contingency plans/mitigation measures for each level of framework Image: www.pixabay.com
RESOURCE PLAN • What resources are needed for: • Staff time and materials for setting up an M&E system • Evaluation activities
Results framework • Links evaluation strategy to problem analysis • Helps identify indicators • Aids in M&E • Clarifies logic of project • Provides roadmap for planning and management
Program Evaluation • Types of evaluations: • Baseline • Mid-term • Final • Impact • Internal versus external
Example: assessments Win with Women Political Party Assessment Tool
Program Evaluation • Steps • Determine evaluability • Select research questions • Identify methods for data collection • Develop and test data collection instruments and protocols Photo: Sanja Gjenero, RGBstock.com
Event Evaluations • Verbal feedback • Evaluation forms • Pre- and post-workshop questionnaires
Public opinion research • Qualitative • Focus groups/in-depth interviews • Quantitative • Surveys/polls • Combination of both
In-depth Interviews • Key informant/one-on-one interviews • Explore thoughts on deeper level • More flexible • Avoid influence of group dynamics Photo: NDI
Focus groups • Why and how strongly people hold opinions • Can’t project results to wider population • Groups formed around common characteristics • Six to ten people and moderator • Open-ended questions
Surveys • Identical set of close-ended questions • Representative sample of population • Results projected to larger population • Predict future behaviors and trends
Example: Public opinion research in Ukraine • Nearly 50% thought women underrepresented • More likely to vote for party with outreach to women • Perceive women as better managers Photo: NDI
M&E TOOLS REVIEW • Monitoring: continuous activity to ensure project is on track • Evaluation: assesses impact • M&E must address gender • Wide range of qualitative and quantitative data collection tools that can be used throughout project life cycle