Economic impact r esearch Survey of international i nnovations and best p ractices

1. Economic impact research Survey of international innovations and best practices

2. Economic impact 101 • Focus: The full effects of a spending action on the commercial activity of a given area • Eg. For each dollar invested in youth sport Ontario, how many dollars of knock-on economic activity are generated? • Scope: Not just direct impact, but also follow-through (effects on suppliers and consumers) • Limitations:Economic impact is NOT social impact; Economic Impact Analysis (EIA) does not measure effectiveness and is only one half of the value-for-money equation

3. Priority questions • How can OTF measure the economic impact of its community investments? • How can OTF demonstrate the economic impact of the Not-for-profit (NFP) sector in Ontario? • How can OTF provide leadership and vision to facilitate development-oriented commissioning and evaluation throughout the Ontario NFP sector?

4. Where EIA fits in the big picture Evaluation Application What is that change worth?

5. 1. Economic Impact Analysis: tools, options, and best practices

6. The economic impact equation

7. 1a. Measuring the Economic Impact of Goods with Market Prices

8. Goods with market prices

9. Goods with market prices Return on Investment Analysis Measures profits as a percentage of total costs –Eg. $50 revenue on $25 investment = 100% ROI Many firms set ROI threshold ranges for making investment decisions –Eg. 0%>10% = “No”, 10%>25% = “Maybe”, 25< = “Yes” Static indicator / snapshot of one moment in time One Stakeholder: only values benefits to investor ROI is a good starting point for evaluating the monetary impact of a single investment to one stakeholder at one point in time

10. Goods with market prices Aggregated Spend Analysis (current OTF practice) Measuresexpenditure information for comparable agencies to discern direct economic impacts PRO: Simple, low-cost approach Low compliance costs, highly flexible CON: Non-standardized, unreliable, limited in scope Some stakeholders: measures benefit to investor and agency, touches on some benefits to some suppliers • Aggregate Spend analysis is an easy, inexpensive way for OTF to approximate the direct (1st order) impacts of its spending

11. Goods with market prices Input Output Modelling (IO) (Ministry of Finance standard) Comprehensive analysis of how shocks to one sector of the economy affect all other sectors Pro: Standardized, comprehensive approach –Rigorous, reliable, and highly instructive Con: Compliance enforcement –Requires accurate, uniform expenditure and production info All Stakeholders: IO modeling accounts for all value added to all stakeholders, directly and indirectly IO Modelling is the international governmental standard for Economic Impact Analysis, multiplier calculation, FTE equivalency

12. Goods with market prices Goods / services bought & used Goods / services made & sold Source: Input-Output Economics, 2nd Ed., By WassilyLeontieff(Oxford, 1986) Basic Input Output Model What one sector makes, another sector uses to make something else When goods are discounted or given away, their true value is not reflected in these tables; Most NFP sector output DISAPPEARS!

13. 1b. Valuing the Economic Impact of Goods with no market price

14. Goods with no market price We know that good health and clean water have high intrinsic value, but how can we measure this value when they are seldom bought or sold?

15. Market v. non Market valuation Market valuation • Can only be applied to goods bought and sold at equilibrium rates • Value determined by price (revealed preference) • Tells only half of the story (ie. Value of commoditised goods only) Non-market valuation • Can be applied to goods bartered, discounted, or given away • Value determined by possession or deprivation • Tells only other half of the story (ie. Value of non-commoditisable goods only) In absence of price, how do we determine value? Value Determined by Willingness to pay, as reflected in price

16. Market v. non Market Valuation Market valuation • Q: What’s it worth to you? • A: Revealed preference (the price you paid) Simple Economic Value • Q: What’s it worth to the economy? • A: Net added value of outputs over inputs Non-market valuation • Q: What’s it worth to you? • A: Contingent Valuation (eg. replacement cost) Blended Economic Value • Q: What’s it worth to society? (mkt + non-mkt) • A: Net value of all desirable outcomes over all inputs for all stakeholders

17. Valuing Social Goods Social Return on Investment (SROI) • We live in societies, not just economies (Profit, People, Planet) • Social goods have intrinsic value – ALL value is measurable • Social goods carry different value to different people • Social goods like volunteer time are not only outcomes of community investments, they are also inputs • SROI is a robust methodology used by governments (eg. UK), and respected by Nobel Prize-winning economists In commerce, value = price; SROI values stakeholder inputs and outcomes by deducing price information without transactions

18. Valuing Social Goods Social Return on Investment (SROI) – How to • Identify all stakeholders • Determine what each stakeholder puts into a project, and what they get out of it • Determine what inputs and outputs are worth to each stakeholder (“Contingent Valuation”: replacement value, willingness to pay, proxy value, substitution premium, etc.) • Determine degree of change you can take credit for • Calculate net benefit (degree of positive change) • Calculate SROI (apply values to net benefit) SROI is an international standard for measuring the intrinsic value of social goods, which are valuable but not commoditised

19. Valuing social goods Some examples of Contingent Valuation (CV) • Are there any market-priced goods that can serve as accurate proxies for the value of social goods? • What is the replacement cost of a social good? • How much would you pay to continue enjoying the benefits of a given thing? • What would you pay to avoid giving something up? • At what rate do you value your time? In 1993, Nobel-winning economists Robert Solow and Kenneth Arrow used a primitive CV approach to estimate the cost of the 1988 Exxon Valdez oil spill. Using a Willingness to Pay framework, they valued the costs of the spill between $2.8 - $4.2 billion, based on the price the average American was willing to pay towards programs that would prevent a future spill. Current methods are far more sophisticated.

20. Sample SROI Analysis: I Source: A Guide to Social Return on Investment, (2012) The SROI Network: http://www.thesroinetwork.org/publications/doc_details/241-a-guide-to-social-return-on-investment-2012

21. Sample SROI Analysis: II Source: A Guide to Social Return on Investment, (2012) The SROI Network: http://www.thesroinetwork.org/publications/doc_details/241-a-guide-to-social-return-on-investment-2012

22. Blended valuation = Value of commoditised goods+ Value of social goods

23. Blended valuation For all stakeholders / sectors

24. 2. Social and Economic Indicators of vibrant and resilient communities

25. Why resilience? Resilience = The capacity to recover quickly from difficulties, challenges, and unexpected changes of circumstance • Resilience-oriented community developers commission projects that remediate specific areas of vulnerability so that communities become empowered to take care of themselves, come what may • Resilience analysis is at the cutting-edge of needs-based commissioning, providing focus, detail, performance targets and measurement indicators for effective community development

26. Recipe for resilience Warning system Assets (vulnerabilities)

27. Relating wellbeing to resilience Is absolute level of wellbeing high? No Yes Can community adapt / respond / rebound? Is this level stable/ sustainable? Yes Yes Resilient Community No No Vulnerable to shocks Vulnerable to shocks Develop resilience capacity

28. Choosing indicators Top-Down (theoretical model) Bottom-Up (empirical model) • Identify people reporting highest levels of life satisfaction • Isolate objective and subjective indicators of wellbeing with strongest statistical correlation to life satisfaction • Identify local threats to wellbeing and local assets that could mitigate effects of unexpected shocks • Commission projects that bolster existing defences or build new ones • Ask people what the most important characteristics of wellbeing are • Develop indicator set that suitably captures these characteristics and is capable of accurately tracking them over time • Identify areas which perform well against the set and those that don’t, broken down by indicator • Commission projects to address poor indicator outcomes Example: Wellbeing and Resilience Measure (WARM) – Young Foundation, UK Example: Canadian Index of Wellbeing – University of Waterloo, Ontario

29. Top-Down approaches Regression / Sensitivity Analysis (Discern which indicators have highest impact on life satisfaction)

30. Bottom-Up approaches Find / develop indicators for tracking priorities

31. Sample indicators: objective • Living Standards: Income differential, wages vs. cost of living, number of vacancies, number of workless households, incidence of persons with low income, etc. • Health: Life expectancy, infant mortality, percent obese / smokers, physicians/10,000 people, etc. • Community: Crime rate, volunteerism, proximity to relatives, commuting distance, proximity to leisure, etc. • Governance: Voter turnout, ration of registered to eligible voters, newspaper subscription, number of public consultations, etc. NB: Some indicators are positive (as they increase, so too does wellbeing) while others are negative (as they increase, wellbeing declines)

32. Sample indicators: subjective • Living Standards: Feeling of economic security, job satisfaction, empowerment, inflation expectations, marital status, caring for disabled, etc. • Health: Ability to perform regular tasks, self confidence, incidence of depression or anxiety, perceived availability of care or assistance, etc. • Community: Perceived safety, amount of contact with neighbours, degree of social integration, gentrification, volunteerism, etc. • Governance: Responsiveness, representativeness, opportunities for input, etc.

33. Bottom-up tracking Community Vitality Indicator Canadian Index of Wellbeing (composite) Source: Canadian Index of Wellbeing, Community Vitality Indicator http://ciw.ca/_images/other/community_headline_indicators_EN.png Source: Canadian Index of Wellbeing, Composite Index, http://ciw.ca/en/CanadianIndexOfWellbeing/CompositeIndex.html

34. Top-down tracking Wellbeing and Resilience Measure Source: Taking the Temperature of Local Communities, The wellbeing and resilience measure, Authors Nina Mguni and Nicola Bacon, The Young Foundation, (2010 )http://www.youngfoundation.org/publications/reports/taking-temperature-local-communities

35. Resilience mandala

36. Analyzing wellbeing Overall wellbeing of whole population Focus on one area of wellbeing / aspect of life experience for whole population Measures wellbeing of specific groups and sub-groups within an area or population

37. International Variations