1 / 23

Complexity and Outcome Harvesting

Complexity and Outcome Harvesting. Most recently. In June the World Bank published 10 case studies and a toolkit for using Outcome Harvesting. http://www.outcomemapping.ca/resource/resource.php?id=452. http://wbi.worldbank.org/wbi/document/cases-outcome-harvesting. e Harvesting. Origins.

wjoseph
Download Presentation

Complexity and Outcome Harvesting

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Complexity and Outcome Harvesting

  2. Most recently • In June the World Bank published 10 case studies • and a toolkit for using Outcome Harvesting http://www.outcomemapping.ca/resource/resource.php?id=452 http://wbi.worldbank.org/wbi/document/cases-outcome-harvesting

  3. e Harvesting Origins

  4. e Harvesting Inspired and informed by the Outcome Mapping methodology. A tool for practitioners operating in dynamic, uncertain situations to monitor and evaluate the social change results they are achieving.

  5. Outcome Harvesting Six steps: • Design the harvest — users => uses => evaluation questions => data to be collected • Review documentation and draft outcomes => intervention’s contribution • Engage with informants — generally within the intervention • Substantiate with independent but knowledgeable third parties • Analyse, interpret — What? + So What? but not Now What? • Support use of findings TRIANGULATION

  6. International social change networks GLOBAL PARTNERSHIP FOR THE PREVENTION OF ARMED CONFLICT

  7. International development funders

  8. What did all of these organisations have in common? COMPLEXITY!

  9. Relationships of cause and effect are KNOWN Simple

  10. M&E of a simple intervention Vision IMPACT OUTCOMES Annual polio vaccination campaign OUTPUTS ACTIVITIES INPUTS Plan Time Inspired by Jeff Conklin, cognexus.org

  11. Relationships of cause and effect are UNKNOWN Complex

  12. M&E of a complex intervention Vision OUTPUT OUTPUT OUTPUT Strengthening nonviolent responses to communal conflict in the Horn of Africa ACTIVITY OUTPUT ACTIVITY OUTCOME OUTCOME OUTCOME OUTCOME OUTCOME OUTCOME INPUTS ACTIVITY Plan OUTPUT Time INPUTS ACTIVITY INPUTS INPUTS

  13. NOT EITHER OR OUTPUT Dimensions in which the relationships of cause and effect are known SIMPLE OUTCOME OUTCOME OUTPUT OUTCOME OUTCOME ACTIVITY OUTPUT OUTPUT ACTIVITY OUTCOME INPUTS OUTCOME ACTIVITY OUTPUT INPUTS ACTIVITY Time INPUTS INPUTS

  14. NOT EITHER OR OUTPUT COMPLEX OUTCOME • Unknown relations of cause and effect dominate. OUTCOME OUTPUT OUTCOME OUTCOME ACTIVITY OUTPUT OUTPUT • Results are substantially unforeseeable. ACTIVITY OUTCOME INPUTS OUTCOME ACTIVITY OUTPUT INPUTS ACTIVITY Time INPUTS INPUTS

  15. Outcome Harvesting andcomplexity High • The greater the: • 1. Disagreementabout what is the development challenge • 2.Disagreement about what is its solution • 3. Uncertainty about what will be the results of your actions to solve the development challenge • The more Outcome Harvesting may be useful COMPLEXIMETER Low

  16. Developmental Evaluation is not, however, the same as evaluation of development. Formative evaluation Developmental evaluation Summative evaluation

  17. When do you evaluate? Developmental Formative Summative Progress of intervention Time

  18. Long-term Goal (Impact) RESULTS BASED M&E INTENTIONAL DESIGN Objectives or Outcomes Indicators Indicators STEP1: Vision STEP2: Mission Outputs STEP 3: Boundary Partners STEP 4: Outcome Challenges Activities STEP 5: Progress Markers Inputs STEP 6: Strategy Maps

  19. Long-term Goal (Impact) Objectives or Outcomes STEP1: Vision STEP2: Mission Indicators Outputs STEP 3: Boundary Partners STEP 4: Outcome Challenges Indicators Activities GLOBAL PARTNERSHIP FOR THE PREVENTION OF ARMED CONFLICT STEP 5: Progress Markers Inputs STEP 6: Strategy Maps

  20. Long-term Goal (Impact) • ICT4D in Asia PAN and Africa ACACIA • Nigeria Evidence‐based Health System Initiative • EcoHealth Fieldbuilding Leadership Initiative • Consorcio por la Salud, Ambiente y Desarrollo Objectives or Outcomes STEP1: Vision STEP2: Mission Indicators Outputs STEP 3: Boundary Partners STEP 4: Outcome Challenges Indicators Activities STEP 5: Progress Markers Regional Peacebuilding Programme in the Horn of Africa Inputs STEP 6: Strategy Maps

  21. Long-term Goal (Impact) Art and Culture Programme in Central America Objectives or Outcomes STEP1: Vision STEP2: Mission Indicators Outputs STEP 3: Boundary Partners STEP 4: Outcome Challenges Indicators Activities STEP 5: Progress Markers Inputs STEP 6: Strategy Maps

  22. In sum • Outcome Harvesting is “an evaluation approach that does not measure progress towards predetermined outcomes, but rather collects evidence of what has been achieved, and works backward to determine whether and how the project or intervention contributed to the change.” - UNDP https://undp.unteamworks.org/node/370238

  23. Discussion • Have any of you found other ways to apply the principles of Outcome Mapping to evaluate projects, programmes or organisations when the elements of intentional design have been missing?

More Related