130 likes | 294 Views
Monitoring, Evaluation and (Experimental) Impact Evaluation. Nicholas Menzies World Bank. Monitoring. Inputs Number of awareness days/people reached Number of cases handled/advice given Outputs Satisfaction of legal aid clients Increases in public/client knowledge Number of cases ‘won’
E N D
Monitoring, Evaluation and (Experimental) Impact Evaluation Nicholas Menzies World Bank
Monitoring • Inputs • Number of awareness days/people reached • Number of cases handled/advice given • Outputs • Satisfaction of legal aid clients • Increases in public/client knowledge • Number of cases ‘won’ • Outcomes/Impacts • Changes in justice seeking behavior • Changes in client status – e.g. more child support
‘Typical’ Evaluation • Whom? • Often by independent third party – e.g. consultant paid for by donor. • When? • After a program has been completed – or often at ‘mid-term’. • What? • Whether monitoring indicators have gone up (if data exists). • How? • Asks stakeholders what they think of the program.
(Experimental) Impact Evaluation - I • January 2013 - training
Impact Evaluation - 2 • Jan 13: Training, but also: • New law on child support
Impact Evaluation - 3 • ? • Experiment! • Training? • Training and new law
Impact Evaluation - 4 • 1/2 lawyers trained • Jan 14: training for ½ lawyers
Impact Evaluation - 5 • ½ trained • ½ not trained • Jan 14: Training
Impact Evaluation - 6 • 1/2 training • 1/2 coaching • Training versus on-the-job coaching
(Experimental) Impact Evaluation • Whom? • Often by management of organization (often with outside technical support). • When? • Needs to be designed before a program begins. • What? • Whether one activity is more effective than another (or no activity). • How? • Tracks monitoring indicators; sets up comparison groups.
Impact Evaluation - 7 • 1/2 stipend • 1/2 coaching • Training versus travel stipend