Developing our Return on Investment in Education and Training

1. Developing our Return on Investment in Education and Training Jonathan Evans Regional Director, Skills for Health October 5th 2010

2. A word from our sponsors • “Our staff are our most valuable resource”

3. A word from our sponsors • “Our staff are our most valuable resource” • “Money is our most valuable resource” Dilbert

4. Introduction • The context • Underlying issues • Why use ROI Analysis? • ROI methodology • What should we do about it?

5. The context The NHS must resist the indiscriminate tactics of the past for delivering savings and look to find true efficiencies that deliver improved quality, maintain patient safety and are sustainable in the long term. An indiscriminate approach to reducing services, staffing and education and training will alienate the public and staff and cause long term damage. Improving quality and productivity in the NHS whilst facing the financial pressures A joint statement from the Academy of Medical Royal Colleges, Healthcare Financial Management Association and the NHS Confederation, September 2010

6. Underlying issues • Training and development delivers skills • Skills drive performance outcomes • Performance outcomes deliver key business benefits – time , quality, costs etc • But when money is tight…….. • So “show me that it is so, Joe”

7. Show me! • How good are we at demonstrating the value of what we do? • We can’t demonstrate impact and value unless we have measurement systems in place • If we can’t report impact and value, we can’t demonstrate our contribution to the organisation’s well being • We can’t make choices about where and how to invest without the right data • So when money is tight…….

8. ROI Methodology A systematic approach to evaluation - generates six types of data: • Reaction to a project or program • Learning skills/knowledge • Application/Implementation progress • Business impact related to the project or program • Return on Investment • Intangible Benefits …..and includes isolating the effects of the program 8

9. Exercise … Of the following 6 types of evaluation which do we do most/ least frequently? Reaction to a project or program Learning skills/knowledge Application in the workplace Business impact Return on Investment Intangible Benefits 9

10. How frequently do major corporations go there?

11. Why Use Impact and ROI Analysis? • Discussion (5 minutes)

12. Why Use Impact and ROI Analysis? Presents training and development solutions as an investment, not a cost Ensures alignment of programmes to service and business needs Improves support for programmes from your sponsors Sells the benefits to your own organisation Gives credible measure of your value to your organisation It also Enhances the design and implementation process if you don’t design for Return on Investment, you probably won’t get it! 12

13. If you don’t design for Return on Investment, you probably won’t get it!

14. Defining the Return on Investment Monetary Benefits Programme Costs Benefits/Cost Ratio = Net Monetary Benefits Program Costs ROI = X 100 14

15. ROI Example Costs for project £80,000 Benefits from project £240,000 BCR = ROI = £240,000 x 100 = 300% £80,000 3.0 15

16. ROI Calculation: Exercise

17. Show me! • We all have some good case studies – but “we would say that wouldn’t we?” • We can’t persuasively demonstrate impact and value unless we have measurement systems in place • If we can’t report impact and value, we can’t demonstrate our contribution to the sector • THE QUALITY AND DESIGN OF EDUCATION AND TRAINING IS MISSION CRITICAL!!! • We can use ROI to improve education and training design

18. Designing for ROI • Needs based • Addresses competences required • Learning outcomes – based on application • Success criteria – based on improvement • Activities which force application in the workplace – not just learn about but do it • Costings to be accurately measured • Value of outcomes accurately measured • See the quick checklist!!

19. The Health PICKUP Model Final module assessment includes the following: “Does your project make an actual or potential contribution to improving workplace performance”. This will be assessed by your adviser and line manager

20. Exercise: So why not use ROI? 20

21. So why not use ROI? • Lack of knowledge: “It can’t be done”; “I don't understand it” • Lack of time • Fear: • An unsuccessful evaluation will reflect poorly on our performance. • The data will be misused • A negative ROI will damage our programme/ organisation. • Our budget won’t stretch to this • We are not asked to do it. 21

22. How should we move ahead? Ensure needs are mapped!!! Ensure mapping of provision to need Evaluate for application and impact and….. ROI? Insist on cost effectiveness at the design stage 22

23. Do you want to move forward with this? Contact Jonathan Evans , Skills for Health jonathan.evans@skillsforhealth.org.uk Tel 07968637015

24. Isolating the Effects of the Program • Use of control groups • Trend line analysis • Forecasting methods • Participant’s estimate • Management’s estimate of impact (percent) • Use of experts/previous studies • Calculate/Estimate the impact of other factors • Customer input 24

25. Converting Data to Money 25

26. Cost of a Sexual Harassment Complaints 10 Complaints Actual Costs from Records Additional Estimated Costs from Staff Legal Fees, Settlements, Losses, Material, Direct Expenses EEO/AA Staff Time, Management Time £300,000 Annually £300,000 10 Cost per complaint = £10,000 26