Success!! – Improving progress measurement

1. Success!! – Improving progress measurement Carol Candler (NRF) Andrew Ball – Depaul Trust)

2. Welcome & Housekeeping Thank you for joining us today.

4. What this is about Today is all about celebrating success • Why we need to capture progress • Ways of doing it • How to use the learning from it

5. Exercise - Introductions • In 2’s • Not someone you work with or know well • Who they are, what they do, what they like about their job

6. What this is about Why we ask you to monitor and evaluate • To learn from what you do and the people you work with (what works) • To show what you’ve delivered and why it’s important (funders) • To celebrate what you’ve achieved with • The people you work with • Your organisation • To share ‘the magic’

7. Agenda • Introduction to Progress Measures (soft outcomes) • Some tools you can use • Introduction to the Depaul Trust approach • Q&A • Lunch & learning

8. What you are trying to achieve Not a simple cause and effect • Simple problem: following a recipe • Complicated problem: sending a rocket to the moon • Complex problem: raising a child

9. Evaluation • Evaluation is • a way to get at what works – and what doesn’t. • a way to help us understand and solve problems more effectively as time goes on – to improve our work and provide better services and support. • a way to get at the ‘so what’ and celebrate success • Evaluation is not an event…but is an ongoing process

11. Outcomes evaluation Why ‘soft outcomes’ measures? • ‘Complex problem’ – not a straight line • Not just numbers / Measuring changes and progress • Capturing evidence of ‘success’ for individuals / with individuals

12. Why it is important to use a soft outcomes / progress tool • As a way of working with individuals • So the individuals you work with can see their progress • You can see what difference you are making and what is making the difference • You can demonstrate progress to stakeholders / funders

13. Harrington/Young Research and Tools Aims of the work • to map what tools are available • To assess their pros and cons • To develop free / easy to use tools • To pilot them with real organisations and real people

14. Research Findings – Benefits To Young People / Individual • Able to set own targets • Able to access own information • Owning development tools and decision making • Help to recognise own progress and achievements • Empowering and reflective process • Learn about planning and taking responsibility

15. Research Findings - Benefits To Practitioners • Measuring progress central to work with young people / individuals • Supports initial engagement and helps workers describe what they do • Enables workers to develop their own skills • Form basis of clear delivery plans for workers • Able to see progress of individuals as a result of their work / change approach where necessary • Can exchange info with other workers (shared language) • Useful planning and evaluation tool

16. Research Findings - Benefits To the Project / Organisation • Evidence for funders / support for applications • Professionalisation of project (influence perceptions) • Easy way to demonstrate progress • Using the same system provides continuity for individuals if worker changes • Measure impact and whether project is achieving it’s goals

17. Research Findings – Challenges / Problems • Differing definitions – ‘outcomes’, achievements vs progress • Formality / rigidity (need to maintain focus on individuals needs and ‘reverses’) • Time • Workers understanding and skills • Laptop vs paper • Detached vs centre based

18. Developing the Outcomes Tools Feedback - Tools need to: • Identify individual’s starting point and provide evidence of changes / benefits as a result of work • Be easy to use / understand • Be useful to individual’s as own evidence of progress and development • Encourage both worker and individual to reflect / evaluate • Provide a mechanism for the organisation to demonstrate it’s impact (accountability)

19. Approaches / tools The Harrington/Young tools for NRF • Personal Profiles • Personal Development Record • Radar Chart Others • Success star (Phoenix) / Outcomes tool (Depaul) • Outcomes Stars (Triangle) • Wellbeing frameworks (Lodex / NPC)

20. Outcomes Stars 16 current stars including: • Older Person’s Star • Mental Health Recovery • Alcohol Recovery • Domestic Violence • Children • Teen star Triangle Consulting http://www.outcomesstar.org.uk

21. Outcomes Stars (MHR)

22. Harrington Young Tools • Personal Profile • Personal Development Record • Radar Chart • Blank versions / research report available on NRF website • Can be adapted www.nr-foundation.org.uk/resources/tools

23. PERSONAL PROFILE Name: Date:

24. PERSONAL DEVELOPMENT RECORD Name: What do I want to achieve? What goals or targets do I want to set for myself?

25. Radar Chart

26. Break

27. Depaul outcomes tool

28. Any questions?

29. Sources of support / information • Our website (‘Tools’ section in Resource centre) • Outcomes Stars (Triangle Consulting) • Charities Evaluation Service • New Philanthropy Capital • Kellog, Rockerfeller Foundations (US) • And many more ……….

30. Thank You • Lunch • Opportunity to discuss your thoughts / experiences or ask any questions you still have • Feedback forms