230 likes | 248 Views
Measuring (and Driving) the Value of Training. Bruce Winner, Los Rios CCD – Government Training Academy Bruce blogs to the training community at - www.GetResultsFromTraining.com. Objectives.
E N D
Measuring (and Driving) the Value of Training Bruce Winner, Los Rios CCD – Government Training Academy Bruce blogs to the training community at - www.GetResultsFromTraining.com
Objectives • Find out the difference between a simple evaluation and truly measuring the value of training at the five generally accepted levels. • Discover what measures are most important to management, and how to capture that information. • Stop guessing about the appropriate level of measurement and see what the experts and empirical evidence reveals is optimal. • Explore with your colleagues how to create the systems and practices necessary (before, during, and after training), to ensure that your hard efforts result in real value, measured at an appropriate level.
Is it Worth the Effort? What would being able to measure and prove the value of training --- do for YOU?
ROI Methodology vs Kirkpatrick Four Levels Not mutually exclusive Lots of overlap - ROI methodology built on the Kirkpatrick Model ROI methodology vs ROI (the ratio) I will use BOTH going forward, but…
ROI or Kirkpatrick Levels of Measurement Level Measurement Focus 0. Input Measures input such $ spent, people trained, $ per trainee 1. Reaction and Relevance Measures participant reaction to the program, did they find it relevant, and could capture planned action(s) 2. Learning Measures changes in knowledge, skills, and attitudes 3. Application & Implementation Measures what is applied on the job, changes in job behaviors (more of x, less of y) 4. Business Impact (Results) Captures changes in business impact measures (Q.C.O.T) 5. ROI Compares program benefits to program costs (simple ration or benefits minus cost / cost)
Intangible Benefits Adaptability Brand awareness Career minded Caring Collaboration Communication Conflicts Cooperation Corporate social responsibility Creativity Confidence (story) Culture Decisiveness Employee complaints Engagement Execution Image Innovation Job Satisfaction Leadership Networking Organizational climate Organizational commitment Partnering Reputation Resilience Stress Talent Teamwork
Level 5: 5-10% Level 4: 10-20% Level 3: 30% Level 2: 40-60% Level 1: 90-100% Evaluation Targets
Improving Level 1s Level 1-2 2 - 2.5 2 - 3 3 - 4 Moving up the ladder
The Alignment Process Start Here End Here ROI 5 ROI Objectives 5 Payoff Needs 4 Impact Objectives 4 Impact Business Needs Application 3 Application Objectives 3 Job Performance Needs Measurement and Evaluation Initial Analysis 2 Learning Objectives 2 Learning Learning Needs 1 Reaction Objectives 1 Reaction Preference Needs Project Business Alignment and Forecasting The ROI Process Model
Exercise Matching Evaluation Levels To Objectives Table exercise – Short exercise to reinforce differences in LEVELS of Objectives
Let’s look at five training objectives (below) and see if we can determine their “level” (level 1-5) Perceive the new work schedule system introduced during training as important to agency success. Level ____ Achieve a post-test score increase of 30% over pre-test. Level ____ Use acceptable coaching skills in 90% of situations where work habits are unacceptable. Level ____ Decrease the time from testing to hiring of new analysts from 40 days to 15 days. Level ____ Achieve a 50% return on investment with the new contact center training program for customer service representatives. Level ____
Now it’s your turn!Go to page 6 of your handout.Instructions: For each objective listed below, indicate the level of evaluation at which the objective is aimed. This is more fun as a table-top exercise. Work as a group and try to match an evaluation level to EACH objective in as short a time as possible…
--- Transfer of Training --- “ Making the Training Stick”
Some Transfer of Training Examples for an Upcoming Exercise The Transfer of Training MATRIX
Transfer of Training - Exercise Directions1) Do the exercise as a table group 2) Each Table has a number (1-9) that corresponds to one of nine squares on the T of T Matrix (see below)THEN – Use the oversized Post-IT Notes to: 3) Each table creates at least one “intervention” or “means to increase transfer of training” at a specific point in time (before, during, or after) with one specific group (participants, trainers, or supervisors) - Your number 1-9 is “your box”4) Then produce 1 or 2 additional interventions for ANY BOX in the matrix5) Post ONLY two to the wall chart (one required and one extra)
Thank you! Please call me if you have any questions or want to talk about “Measuring (or Driving) the Value of Training”. Bruce Winner 916.563.3232 winnerb@losrios.edu And please check out my blog… www.GetResultsFromTraining.com (An unread blog is a terrible thing!)