1 / 15

BER Analysis Simplifying Evaluation Challenges in Global Campaigns

This evaluation presents the BER solution for assessing the value for money of international campaigns like Oxfam GB’s Global Climate Change Campaign. It simplifies the complex assessment of multi-unit programs by offering a framework that compares units based on their impact versus resources. The theoretical foundations include matrix analysis frameworks and modeling techniques. Input and output variables are key in conducting a BER analysis, with examples like influencing policies. Visualization and interpretation are essential in understanding and discussing performance, though caution should be taken to not oversimplify results. Limitations include the risk of misinterpretation if not properly analyzed.

custodio
Download Presentation

BER Analysis Simplifying Evaluation Challenges in Global Campaigns

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Where BER Started • Evaluation of Oxfam GB’s Global Climate Change Campaign • Solution to evaluation challenge of considering value for money of a complex, multi-unit, international campaign

  2. Evaluation challenges • Simplifying complex multi-unit programs • Many evaluations are about ROI, but ROI is difficult to assess in social contexts • Nothing is good or bad, except in comparison to something else

  3. The BER Solution • Provide a simple framework for evaluating complex multi-component programs, campaigns, or activities • Build on the basic concepts of SROI to evaluate unit's impact compared to their resources • Offers a relative perspective on performance where units of analysis are judged in comparison to their peer units, operating under similar conditions

  4. Theoretical Foundations: Matrix analysis frameworks • Boston Consulting Group • General Electric Grid • Customer satisfaction quadrant analysis by Andreasen • Bloc modeling techniques used by social network analysts • Multi dimensional scaling • SROI

  5. BER Variables • input constitutes a program’s resources which may be measured by its budget, number of staff, pool of talent, social capital, or any measure of capacity, concrete or abstract. Output measures a program’s impact, and will vary according to a program's purpose – may include behaviour change; public awareness; policy change; reduced inequality; improved environmental health… or any other measure depending on a program's goals

  6. Conducting a BER Analysis The example in following section is fictional and for illustrative purposes.

  7. 1. Selecting units of analysis For example: Coalition/partnership building; intra organisational coordination; lobbying and advocacy; media relations; online engagment; public mobilization; research...

  8. 2. Data types • Quantitative input data may include budgets, number of staff, or combined multi-dimensional resource measure • Quantitative output data may include process evaluation measures such as the number of people engaged by a campaign or media hits • Qualitative measures can include perceived program investments and perceived output achieved

  9. 3. Measurement tools Organisation X has influenced policies or legislation because of the following activities:

  10. 4. Visualization approaches High Low High Low

  11. 4. Visualization approaches

  12. 4. Visualization approaches

  13. Case Study: Oxfam GB’s Global Climate Change Campaign High Perceived impact Low Low High Perceived resourcing

  14. 5. Interpretation • Use BER is as a starting point for deeper discussions into the performance of intervention units, their challenges, opportunities, and operating environment • Understand the units of analysis and the informants who shared their perceptions • Not all units within a program operate under the same conditions • Some units contribute indirect effects, by empowering other units

  15. Limitations and Risks • It is easy to draw conclusions from the simple visualizations that would never stand in the face of a deeper understanding of the reality behind charts • Kotler et al. (2005) noted, reliance on matrix approaches prompted a number of companies to sell off strategic assets and plunge into businesses that they lacked the experience to manage

More Related