120 likes | 243 Views
Achieving and measuring results of PSD interventions Seminar 1: Impact logics, indicators and methods. 10 Febuary 2012 Marieke de Ruyter de Wildt. Who’s here. DGIS, DEC, EL&I, IOB Agentschap NL, CBI, FMO, PUM, Agriterra , Utz
E N D
Achieving and measuring results of PSD interventions Seminar 1: Impact logics, indicators and methods 10 Febuary2012 Marieke de Ruyter de Wildt
Who’s here • DGIS, DEC, EL&I, IOB • AgentschapNL, CBI, FMO, PUM, Agriterra, Utz • ISS, PRC, 3ie, consultant, CDI and LEI Shared interest to improve result measurement
Seminar series • 1of 3 Seminars. Other seminars will evolve from today • Other DGIS activities to enhance result measurement Objective • General: to gain knowledge on how to measure results • Specific: to inform Evaluation Plans of PSD platform
Workinggroup on ResultMeasurement • March 2011: ‘Managing forResult System developedandapprovedby DDE and IOB’ • 7 meetings sincetovisualiseexisting systems andwherepossibleharmonise • GuidedbyMfDR (MGDs: eg alignprogramming and M&E withresults) & DCED (PSD: resultchainsand indicators) • Oct 2011: Protocol
Evaluation Protocol for PSD Platform • Resultchains • Relationtoother PSD programs • Indicators at output, outcomeandifpossible impact level • Responsibility of PSD organisation • Independent externaljudgementand transparant validation • Baseline andcontrol group... or othercounterfactual • Respresentative sample • Costsfor PSD organisationproportional Allneedto have Evalutation Plan by May 2012
Elements of Evaluation Plans • Result Chain of organisations/instruments • Essentialandmeasurable indicators • Measurementmethodology Wherepossibleapply DCED standard
PSD Platform Result Chain = DCED Strong interest from members to learn and share with Platform. If possible harmonise indicators Low complexity of measuring attribution. Indicators are organisation specific
CurrentState Evaluation Plans? • PUM • CBI • FMO • Agentschap NL
Common challenges = Agenda today • How to make good result chains? • What key questions: to report, learn or steer, or all? • What indicators to use? • Immediate results = proof and improve (‘downward accountability’) • Ultimate results = proof and report (‘upward accountability’) • Intermediate Outcomes = middlefield (‘research for impact’) • What are lean methods for ‘open systems’: how to attribute?
Some basics • Measurement = Evaluation < ---> Monitoring • Impact logic = theory of change = new log frame • Key elements of measurement • Impact logics • Questions • Indicators at various levels • Lean methods
Open Floor What are your most pressing bottlenecks toprogress on resultmeasurement • Technical issues - blue • Rules of the game - yellow • Internalprocesses - white