1 / 25

Multi-stakeholder partnerships & SDGs Analytical approaches for evaluation

This presentation explores impact evaluations and the need for special treatment in multi-stakeholder processes. It discusses actor and strategy models for evaluating partnerships and provides examples of different analytical approaches. Presented by Leon Hermans from Delft University of Technology, the Netherlands. NEC2017, Istanbul, October 20, 2017.

schuller
Download Presentation

Multi-stakeholder partnerships & SDGs Analytical approaches for evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Multi-stakeholder partnerships & SDGs Analytical approaches for evaluation Leon Hermans Delft University of Technology The Netherlands NEC2017, Istanbul 20 October 2017

  2. This presentation • Impact evaluations and multi-stakeholder partnerships • When do multi-stakeholder processes require special treatment in evaluations? • A (partial) response: actor & strategy models • Conclusions

  3. 1. Impact evaluation and stakeholders

  4. Impact evaluation in its simplest form Then things happen…. At time T+1 At time T Outcomes Inputs OTHER Outcomes NO Inputs

  5. Impact evaluation in its simplest form At time T Then things happen…. At time T+1 Partnerships started SDGs closer! Less (or no) SDG progress NO Partnership

  6. Unpacking the links between inputs and impacts: A school example • Stakeholders included: • Ministry of Education • High school teachers • Municipalities • Teacher trainers • Students (& Future employees) Source: Gertler et al., Impact Evaluation in Practice. World Bank, 2010

  7. Explaining results: what happened? • And what if we don’t see results? • What if our results chain fails already in the first steps? • And what if stakeholders may have something to do with this? Source: Gertler et al., 2010, p.17

  8. “ALWAYS!” “But really?” 2. When do multi-stakeholder processes require special treatment in evaluations?

  9. Actor complexity increases with: • More actors • Interdependence • Actors make autonomous decisions • Actors control resources needed for realization of joint goals • Repeated interactions • Over a longer period

  10. Types of interventions and IE

  11. Multi-Stakeholder Partnerships and Actor Complexity • Multi-stakeholder partnerships are themselves interventions that involve multiple stakeholders – how do we learn about their success? • Multi-stakeholder partnerships are vehicles to support actual interventions on the ground – which often involve multi-actor complexity in implementation

  12. Another school example Core competencies for all students (remedial teaching) Send all children to school

  13. Another school example Core competencies for all students (remedial teaching) Send all children to school Invest the limited resources in promising students

  14. Another school example Core competencies for all students Send all children to school Invest in promising students Core competencies for all students Send only brightest child to school (longer) Invest in promising students ?

  15. Another school example Core competencies for all students All children to school Invest in promising students Social Dilemma Core competencies for all students Only brightest child to school Invest in promising students ?

  16. Dealing with multi-actor complexity: methods and models • Mixed-methods: participatory approaches, interviews, group discussions, content analysis, etc • Take implementers serious, engage with them to get them engaged in an evaluation • But also: • Models that help explain/understand actor behavior, to guide and add rigor to qualitative analysis methods • Models provide lenses rooted in theory, but ‘operationalized’

  17. Source: Hermans, Cunningham et al. (2018)

  18. 3. Different models, different insights: Some examples.

  19. For instance: what actors value and can do – cooperative games • Identify values and critical assumptions of actors in games they played (agenda for monitoring and evaluation)

  20. Game theory for coastal management in the Netherlands – why the policy worked in one province and failed in another Coastline preservation Nature Regional development

  21. Social network analysis: how network structure influences implementation Source: Wieriks, Water governance and policy networks in Indonesia: The challenges of a decade of water sector reformation. TU Delft, 2011

  22. Comparative cognitive mapping: Using interdependencies for M&E design

  23. Conclusions • Actor complexity increases with more actors, more interdependencies, and interactions over longer periods; • SDG multi-stakeholder platforms outcomes are better explained with use of actor models; • There are various actor and strategy models that help to add rigor – reviewed some examples of models for social dilemmas and interdependencies.

  24. Thank you! Questions, comments or more info? Please contact me by email: Leon Hermans l.m.hermans@tudelft.nl

More Related