GWDC Return on Investment Initiative

1. GWDC Return on Investment Initiative GWDC Full Council Meeting February 11, 2010

2. Project Rationale and History Many public and non-profit workforce training programs use a variety of ROI methodologies. However, different methodologies make it inappropriate to compare various ROI results. In 2009, a law was passed that requires DEED to report on a set of accountability measures, one of which is return on investment (M.S. 116J.997). The GWDC, responsible for advising on performance standards and measures (M.S. 116L.665) convened the ROI Initiative to develop a standard ROI Measure.

3. Project Goal, Scope, and Audience To create through consensus a standard return on investment methodology for workforce and training programs. The focus is on programs administered or funded by DEED, but the idea is to create a model that will appeal to all workforce programs across the state. The intended audience consists of: Workforce and training programs who want to quantify their results Legislators interested in comparing costs and benefits Taxpayers who want to understand the impact of programs

4. ROI Methodology Criteria Manageable (easy to apply/administer; minimizes work and training for service providers to implement) Useful (relevant and timely; helps providers improve programs, helps legislators and others understand program impacts) Understandable (transparent; easily understood by experts, users, and the general public – assumptions and limitations defined, rules of use defined) Credible (trusted; measure is seen as accurate/credible by experts, users, and the general public – relies on verified data as much as practical, process integrity - ensures data and model integrity of applications), Adaptable (measure can be used by different programs/providers) Sensitive to change (collect and report data at a frequency that detects significant variations)

5. ROI Initiative Members • Cristine Leavitt (Project Manager), DEED • Bryan Lindsley (Sponsor), GWDC • Paul Anton, Wilder Foundation • Art Berman, Twin Cities Rise! • Mark Brinda, City of Minneapolis • Carol Dombek, DEED • Martha Hegewisch, DEED • Dick Joerger, MnSCU • Randy Johnson, Workforce Development, Inc. • Susan Lindoo, DEED • Nick Maryns, GWDC • Anne Olson, Minnesota Workforce Council Association • Brian Paulson, Greater Twin Cities United Way • Raymond Robertson, Macalester College • Mary Rothchild, MnSCU • Deb Serum, DEED • Todd Wagner, MN Department of Education • Luke Weisberg, Lukeworks, LLC

6. ROI Initiative Work Plan Phase I: Evaluate existing ROI models and develop a standard model Phase II: Pilot test, evaluate, and refine the model. Phase III: Make policy and implementation recommendations as part of the January 2011 GWDC Report to the Legislature. We’re roughly half-way through Phase I.

7. ROI Framework

8. Challenges (a small sampler) Applying one methodology to a wide variety of programs, with varied missions and target populations is a challenge. It is difficult to build a methodology that is helpful to program managers AND policy makers. There is tension between transparency/ simplicity on one hand and rigor/accuracy on the other.

9. Thank You! Questions?