310 likes | 356 Views
Outcome Mapping. Reflecting and learning from applications in eastern Africa. A webinar on the book’s content and some feedback. Julius Nyangaga. Edward Ontita. Charles Muchunguzi. Janet Nyaoro. INTERNATIONAL INSTITUTE OF RURAL RECONSTRUCTION. Contents. Introduction.
E N D
Outcome Mapping Reflecting and learning from applications in eastern Africa A webinar on the book’s content and some feedback Julius Nyangaga Edward Ontita Charles Muchunguzi Janet Nyaoro INTERNATIONAL INSTITUTE OF RURAL RECONSTRUCTION
Contents Introduction The OM book process: survey, cases, cross-case analysis Key issues/messages Advantages reported; Demand for OM in the region? Challenges to learning and application Way forward Panelists’ comments on IIRR, the write-shop Process and some feedback on content
Introduction IIRR Book: … Produced at the close of a four year period during which IIRR led a series of training workshops – The Evaluation Hub Project … Contains some info from a survey on the understanding and use of OM and a review of a few selected application experiences in the region
Introduction Outcome Mapping : a project management design, implementation, monitoring and evaluation focusing on the outcomes of intended results. Outcomes = defined as the immediate, intermediate effects of a program’s on society (behavioral changes in individuals, communities, organizations, and institutions). Interest in Outcome Mapping by R & D processes because it provides a system for more effective support to outcomes that enhance the possibility of intended impacts
IIRR and the OM Write Shop International Institute of Rural Reconstruction (IIRR) aim: … improving the quality of lives of the rural poor in through sustainable integrated, people-centered development through capacity development and practical field applications. In 2011 and at closure of the 4-year evaluation capacity project, with focus on Outcome Mapping, IIRR, ILRI and Measure Africa facilitated a write shop process for Outcome Mapping experiences in eastern Africa
The OM book process: survey, cases, cross-case analysis Started with survey of OM users and applications in the region … 99 participants of past OM training sessions by IIRR, ILRI and Measure Africa OM Case selection and write-ups In book there is a Cross-Application Analysis The book is not a manual or a demonstration of perfect application experiences but a presentation of key lessons from the cases and a brief analytical observation on challenges and successes of OM use in the region. Target readers:Project Managers and M & E Professionals
Key issues/messages from OM application in the region OM Advantage(s) …. attracting a demand for Capacity Observations on WORKING WITH PARTNERS from the write-shop discussions: “Outcome mapping ‘enhanced’ project implementation ..” “… By identifying and involving Boundary Partners in project activities, ownership of the process was cultivated …” “ … during evaluation ….selected Boundary Partners developed their own performance indicators and (assessed) their own performance.”
Key issues/messages from OM application in the region OM Advantage(s) …. attracting a demand for Capacity Survey findings: “… Several respondents used the concept of “Boundary Partners” to serve various objectives.. ..in advocacy,… “the project uses Focus Group Discussions among the Boundary Partners to enable people to define their own destiny.” “In … stakeholder analysis at the inception of projects, key Boundary Partners are identified and involved in priority setting, identification of key constraints and possible strategies. (They) agree on the roles, work plans and methodologies.”
Key issues/messages from OM application in the region Training opportunities, … observation via on-line feedback Is there is demand for OM Capacity …? How can OM training may be scaled out in Eastern Africa? How can more actors be reached with more training and more effectively?
Key issues/messages from OM application in the region Understanding and using OM concepts and terminology … use of more easily understandable terms
Key issues/messages from OM application in the region Understanding and using OM concepts and terminology On-line discussion on understanding OM concepts, language What are the most appropriate ways for agreeing on more acceptable, local (Kiswahili?) equivalents of OM concepts? - Is there value in translations of the OM concepts or the entire OM manual? - Who should be involved? Why?
Key issues/messages from OM application in the region Understanding and using OM concepts and terminology Use of Organizational Practices This is the least used of OM practices “… only four of 24 survey respondents. In write-shop discussions, the trainers … “present OM organizational practices in their training”, but … there is a lack of follow-up application. One participant comment at the write-shop “ignoring organizational practices can lead to paternalism - you are only focused on influencing others, not considering that you need to (be sensitive to demands), grow and develop yourself.”
Key issues/messages from OM application in the region Integrating OM with other M & E approaches Book content, participants finding it necessary to integrate 38% of the survey respondent indicated that they had adapted Outcome Mapping to their contexts 50% have integrated OM with other monitoring and evaluation frameworks. 17% combined OM with Logical Framework Analysis (LFA), 13% users integrated it with Result Based Management, and 4% integrate it with a Theory-of-Change method. One (survey) respondent said, “Logical Framework Analysis still remains the main design & monitoring tool, but results and indicators are formulated in different ways.” .. Including Outcome Mapping.
Key issues/messages from OM application in the region Integrating OM with other M & E approaches … Views on integration: … Respondents tried to balance between their own needs and donor requirements. For example, a project may have used the Outcome Mapping approach for data gathering and developed reports using the LFA approach. In the Napier grass diseases case, Outcome Mapping was specifically brought in to understand and track interim changes in behavior that affected the control of diseased grass, … while the scientific investigation into a disease resistant variety (the desired impact in the project’s log frame) was the subject of continued scientific investigation.
Key issues/messages from OM application in the region Integrating OM with LFA; Napier case example
Key issues/messages from OM application in the region Integrating OM with other M & E approaches; Napier case
Key issues/messages from OM application in the region Integrating OM with other M & E approaches; Napier case Integrating OM with other M & E approaches Lessons: - By integrating, it is possible to demonstrate how desired changes in behavior and relationships … facilitate solutions to challenges and better demonstrate progress (impact). Should we integrate OM principles and information in other operational project frameworks? Do we have adequate capacity to integrate? Describe such integration. What models?
Key issues/messages from OM application in the region Institutional alignment to OM: accepting and utilizing … From book, survey … “(OM) is a relatively recent approach, it has been difficult to convince colleagues, donors, partners, and community on its value” One respondent said, “I have a challenge of getting colleagues to change and see Outcome Mapping as an option.” Another stated that “the challenge is reaching out to policy makers and donors to explain the value of Outcome Mapping and getting them put aside resources … or allow a budget for sharing information or tracking change.” One added that they had to combine Outcome Mapping with other methods because of “stakeholders’ resistance.”
Key issues/messages from OM application in the region Institutional alignment to OM: accepting and utilizing OM Integrating OM with other M & E approaches How do we support organizational and institutional acceptance of Outcome Mapping as a Program Design, and useful M & E System?
Key issues/messages from OM application in the region Use of Outcome Mapping Journals Adaptation example: The Climate Variability Project in Uganda
Key issues/messages from OM application in the region Use of Outcome Mapping Journals From book, survey The Climate Variability Project …
Key issues/messages from OM application in the region Use of Outcome Mapping Journals “ … other projects found collecting info from boundary partners cumbersome or difficult … so project staff gathered what was required during face to face meetings)”
Key issues/messages from OM application in the region Use of Outcome Mapping Journals How do we support monitoring processes in Outcome Mapping? Which Systems, Structures and Tools would work? Any useful adaptations?
Way forward Suggestions from survey respondents, from write shop • Further training • “.. 63% of survey respondents • Technical follow-up with focus should be on how to select Progress Markers and facilitate the collection of information. • Local and national partners further afield should also be trained so that all project members are on the same level while implementing Outcome Mapping.” • Follow up support • .. “17% of survey respondents. • An Outcome Mapping expert(s) to visit and give advice, encouragement and facilitate sharing of ideas, challenges, lessons and best practices.”
Way forward • Reading materials • “ …8% of survey respondents: … inadequacy of available reading material with actual examples and success (application) stories. • Request for templates that can be used during monitoring and evaluation, and “friendlier” methods for those who cannot write to make them feel more engaged in the monitoring and evaluation.”
Way forward What are YOUR (other) views on the way forward?
End, … asantesana For a copy of the IIRR Om book, write an email to admin@iirr.org, or publication@iirr.org