150 likes | 247 Views
Human Development Network – The World Bank Approaches to evaluating impact. Tris Lumley. 31 March 2010. About NPC : helping charities and funders to do good, better. Our purpose is to help charities and funders achieve greater impact Part think tank, part consultancy
E N D
Human Development Network – The World BankApproaches to evaluating impact Tris Lumley 31 March 2010
About NPC : helping charities and funders to do good, better • Our purpose is to help charities and funders achieve greater impact • Part think tank, part consultancy • Founded in 2001, ~30 people today
Individual giving has not kept pace with GDP 1986/1987=100
NPC designed to test hypotheses • Effective donors need independent analysis to target their giving • The availability of independent analysis will catalyse more and better giving • But rhetoric far exceeds reality: • NGOs lack capacity to measure/analyse • Donors not yet driven by effectiveness/impact
The problems:So why aren’t charities measuring? Money Incentives Complexity Culture Attitudes Skills Capacity Tools The challenge of measurement Incentives: current evaluation paradigm driven by foundations, focused on programs not organisations, rarely leads to action or increased public knowledge
The problems:The case for measuring impact Internal allows charities to make strategic and operational decisions based on what works Externalallows charities to communicate their impact to peers, donors, and funders, thereby spreading best practice and attracting funding
Solutions:How can we move forward? • Align incentives for NGOs to develop their own impact measurement capacity • Standard organisational reporting • Resource to train & recruit analysts • Specialised outcome measurement tools • Networks & support to develop analysts • This will lead to better data to use externally, with donors, governments, partners • This will lead internally to continuous improvement and competition on the basis of social impact
Outcome measurement tools:Measuring children’s well-being • We have designed a rigorous and robust questionnaire for 11 to 16 year olds to provide information about seven domains of subjective well-being: Self: 1) Self-esteem 2) Resilience 3) Emotional well-being Relationships: 4) Friends 5) Family Environment: 6) Home community 7) School • This will help charities measure and demonstrate their impact, improve their work, and attract funding • We are developing a market-ready technology solution for NGOs, schools in UK, and exploring international growth
The problems:What do donors want to see? 300 million people in India are struggling to survive on less than US$1 a day 300 million people in India are struggling to survive on less than US$1 a day Donors are moved to give by people rather than facts
The problems:So why don’t donors follow impact? Real motivations Philanthropy advice Culture Attitudes Info Analysis The donor challenge Motivations for giving: include rational considerations (need, impact) but overwhelmingly driven by emotional/personal (choice/control, relationships, recognition, trust)
Solutions:How can we move forward? • Incorporate impact into existing donor motivations • Harness relationships • Build trust on independent analysis/impact • Reshape sector – demand and supply side • Donor education • Strategic philanthropy can be ‘open sourced’ • Coordination role for major development funders • This will drive greater incorporation of impact into less strategic segments of donor marketplace
The future:How can leading funders drive change? • Real-time evaluation (vs program evaluation) • e.g. building outcomes management information • e.g. well-being tools • e.g. outcomes measurement networks & courses • Collaborative evaluation (in real-time) • e.g. evaluating system change – Strive (Cincinnati) • Accessible platforms for philanthropy • e.g. supporting donor advice market • e.g. open platforms for range of donor data • From randomised control trials to video • Programs explicitly designed for open partnership
www.philanthropycapital.org Tris Lumley Head of Strategy tlumley@philanthropycapital.org Skype# tris.lumley Twitter# trisml +44 (207) 785 6326