290 likes | 444 Views
The Work Readiness Indicator Measuring Progress of WIA Youth. November 17-18, 2009 – Chicago, Illinois. Presenters. Charles Modiano, Division of Youth Services, Employment and Training Administration, DOL modiano.charles@dol.gov ; 202-693-2679 Jill Meseke, Bureau of Workforce Development
E N D
The Work Readiness Indicator Measuring Progress of WIA Youth November 17-18, 2009 – Chicago, Illinois
Presenters Charles Modiano,Division of Youth Services, Employment and Training Administration, DOLmodiano.charles@dol.gov; 202-693-2679 Jill Meseke,Bureau of Workforce Development Illinois Dept. of Commerce and Economic Opportunity Oana Amaria,Bureau of Workforce Development Illinois Dept. of Commerce and Economic Opportunity
Today’s Agenda The Work Readiness Indicator (WRI) A) What happened this summer? B) How did we measure work readiness? C) Examples of WRI Tools Used D) Where Do We Go From Here? E) Your Turn: Informing the System
RECAP: Defining Work Readiness The Work Readiness Skills Goal, as specified in TEGL No. 17-05 includes a measurable increase in work readiness skills including: World-of-work awareness, labor market knowledge, occupational information, career planning and decision making, and job search skills Independent living skills, positive work habits, attitudes and behaviors, showing initiative and reliability, and assuming the responsibilities involved in maintaining a job The definition of a Work Readiness Skills Goal, as specified in TEGL No. 17-05, Attachment B Definition of Key Terms found at http://wdr.doleta.gov/directives/attach/TEGL17-05_AttachB.pdf
RECAP: Work Readiness under ARRA • Any youth in summer employment funded by the Recovery Act were included in the work readiness indicator, even if a youth receives services beyond summer or before summer • The work readiness portion of the WIA skill attainment rate was the primary indicator used for youth who participate in “summer employment” only and are only being served with Recovery Act funds
Preliminary Work Readiness Data Unofficial Thru Sept. 2009 347,782 total youth served 306,466 in summer employment 71%* Summer Employment Completion Rate 63%* Work Readiness Attainment Rate(67 % median) *In this preliminary data some states report lag in data that accounts for lower rates than expected
Work Readiness Attainment RateUnofficial State Data thru Sept. 2009* State Range: High: 95%; Low: 3%* Over 90%: Florida, New Hampshire, & Rhode Island Over 80%: 12 states Over 60%: 30 states 40 - 60%: 11 states Under 40%: Nine states *In this preliminary data some states report lag in data that accounts for lower rates than expected
GAO Report Findings Work Readiness under ARRA Observational Success, But Difficult to Measure“While many program officials, employers, and participants we spoke with believe the summer youth activities have been successful, measuring actual outcomes has proven challenging and may reveal little about what the summer activities achieved.” More Consistency = More Comparability:“the methodologies used to measure work readiness varied widely, calling into question the comparability and the usefulness of the indicator when rolled up at the national level. Of the 10 states, only Illinois established a single approach to be used statewide in measuring work readiness gains.”
GAO Report Findings Work Readiness under ARRA Cited Local Example:“youth… were given a 20-question true-false survey that included questions such as “I understand the importance of demonstrating a positive attitude in the workplace.’” Outcomes Beyond Work Readiness Indicator:“Seven of our 10 states reported they plan to track long-term outcomes, such as job placement and employment retention, for at least some of the youth they served this summer”
The Department of Labor Response to the GAO Report DOL’s Future Plans: “The Department plans to further refine the work readiness indicator and determine a more effective way of measuring work readiness.” Further Guidance: “In the event that a significant number of local areas have Recovery Act funds available for summer employment in 2010, or if the Dept. receives funds for future summer employment activities…, the dept. will issue further guidance for measuring work readiness that allows for the reporting of more consistent and meaningful data.” Future Technical Assistance: “In either case, the Dept. will provide technical assistance to states and local areas on effective ways to measure work readiness based on the information learned this summer and further research on best practices.”
Future of the Work Readiness Indicator • More CONSISTENCY – while respecting diversity of program models WRI: Where do we go from here? • More RIGOR – while maintaining an efficient process • More MEANINGFUL– in measuring impact of summer program experience • – based on dual customer approach of employers and youth
What Employers Want Most from Young Workers Source: CommCorp
Work Readiness Indicators 2009Most Common Measurement Areas What We Measured How We Measured It 1) KNOWLEDGE & MINDSET • Pre/mid/post Assessments • Work Readiness Checklists 2) BEHAVIOR • Mostly Observational • Training Evaluations • Work Supervisor Evaluations 3) PORTFOLIO & TOOLS • Portfolio Assessments • Portfolio Checklists
1) Measuring KNOWLEDGE/MINDSET Mid-Assessment Post-Assessment Pre-Assessment Summer Work Experience Enrollment Mid-Point Completion
Measuring KNOWLEDGE/MINDSETIllinois Statewide Example • How can we best measure KNOWLEDGE/MINDSET? • What are some sample questions? • Paper or Computer? Example from Bureau of Workforce Development Illinois Dept. of Commerce and Economic Opportunity
2A) Measuring BEHAVIOR In Work Readiness Training • How can we best measure BEHAVIOR in training? • How can we make the subjective more objective? • Example can be used in work readiness training or work-site: Participants receive a supervisor evaluation following their work experience. Those with satisfactory/high rating are awarded a work readiness attainment. Example: The Learning Employability Profile (LEP) from Seattle King Countyis an example of a tool used by local providers to monitor work-readiness
2B) Measuring BEHAVIOR at the Work Site • Example: A youth’s Individual Service Strategy must include at least one specific skill goal from any of the three skill groups:(1) Career Readiness Skills, (2) Work Ethic and Professionalism, and (3) Communication and Interpersonal Skills. Example: The Massachusetts Work-based Learning Plan is a tool for assessing (1) Work Ethic and Professionalism, and (2) Communication and Interpersonal Skills, the MWBLP can be downloaded from: http://www.skillslibrary.com/wbl.htm
2B) Measuring BEHAVIOR Work-Site Evaluation Example (Handout)
3) PORTFOLIO & TOOLS • Prepares RESUME • Completion of Cover Letters • Completion of Sample Master Application • Sample Follow-up Letter • Employer Reference (s) • Informational Interviews with Employers • Opening of Bank account • Etc.
3) PORTFOLIO Building An Integrated Example • Work-readiness tool rates 12 different personal competency areas. Six are pre-employment tasks and six are job-specific • The State of Arizona requires 5 pre-employment goals be met • Employers assess youth at completion of work experience; Youth must receive a supervisor rating of at least 80% to be considered successful Example: The Skill Attainment Record - Work Readiness Attainment Skills at Tuscon Youth Development is a tool that measures portfolio along with other work competency areas.
Future of the Work Readiness Indicator • More CONSISTENCY – while respecting diversity of program models WRI: Where do we go from here? • More RIGOR – while maintaining an efficient process • More MEANINGFUL– in measuring impact of summer program experience • – based on dual customer approach of employers and youth
Future of Performance Outcomes • To Continued Employment TRANSITION RATE (Beyond Summer) • To Education (Secondary, Post-Sec., GED) • To Occupational Skills Training
Question and Answer Period • What kind of work-readiness assessment tool did you use? • What did you like and dislike? • What are your general thoughts or concerns about DOL providing guidance around a more consistent and rigorous work readiness indicator in the future? • What would you do if you were DOL?
Stay Informed, Get Connected! Workforce3 One: • Communities of practice • Live web-based events • Register for updates! • For more information about the workforce investment system: • Visitwww.careeronestop.org • Call 1-877-US2-JOBS