Performance Reporting Under WIA Title 1B

1. Performance Reporting Under WIA Title 1B Candice Graham-Young ETA Performance Accountability Team

2. WIA Performance Team Quarterly Report • performance information used for management purposes: budgeting and GPRA • includes information about statewide outcomes on the key indicators of performance and customer satisfaction • captures number of participants and exiters • due 45 days after the end of the quarter

3. WIA Performance Team Quarterly Reporting • Submission process… • submitted electronically from States • States responsible for verification and validation • Regions responsible for second validation

4. WIA Performance Team State Role • Verifying and validating data… • develop standard operating procedures for data collection and handling to ensure the quality and integrity of data • data verification equals checking accuracy • data validation equals checking reasonableness • examples of procedures for data collection are: • checking accuracy against original source • performing logical checks of the data • random call-backs to participants • having trained staff member evaluate data collection efforts

5. WIA Performance Team Regional Role • Validating reports… • ensure timeliness of reports • ensure number of quarters submitted conforms to Table A of the quarterly report instructions • note discrepancies in comment section • ensure reasonableness of data • become familiar with standard • operating procedures which States are • required to have in place

6. WIA Performance Team Changes to Quarterly Report Form • fields added to collect response rates • fields added to show period of time covered by data for each measure • performance is automatically calculated • additional edits added to for data validation purposes (e.g., can’t have more exiters than registrants)

7. WIA Performance Team Common Reporting Problems • reporting correct quarters • simple oversights, like entering numerators and denominators in wrong locations • minor programming errors in edit checks • entering performance outcomes that did not match the numerator divided by the denominator

8. WIA Performance Team Amount of Data Reported by States Third Quarter Report

9. WIA Performance Team Third Quarter Performance

10. WIA Performance Team

11. WIA Performance Team

12. WIA Performance Team Annual Report • basis for awarding incentives or applying sanctions • includes information about negotiated levels, state and local outcomes on the key indicators of performance, customer satisfaction and state measures • numerators and denominators allow for aggregation of data • submitted electronically

13. WIA Performance Team Required Items for the Annual Report • local performance • status of state evaluations • comparison of results of those who received training and those who did not • outcomes for special populations • other outcomes listed in the Act… • training-related employment • wages at entry into employment • cost of activities • cost relative to impact of activities • 12 month retention and earnings

14. WIA Performance Team Annual Report Format Varies Annual Report to Stakeholders What our customers have to say about us TAX PAYERS appreciate increased efficiency JOB SEEKERS reaping the benefits from newly integrated services EMPLOYERS obtaining qualified employees

15. WIA Performance Team Annual ReportState Flexibility • though certain information mandated by the legislation must be contained in the report, the approach the State uses to tell its story is up to the State • States are encouraged to design reports that make extensive use of graphics and other communication devices • States may want to include “success stories”

16. WIA Performance Team Annual Report • Required portions • Narrative Section • Tabular section • Designed to meet Sec. 136(d)

17. WIA Performance Team Annual Report • Optional portions (suggested) - Governor’s Comments - Financial (Narrative & Graphic) - Organizational Chart - Resources - Graphics - Success Stories

18. WIA Performance Team Annual ReportNarrative Section • Discuss the cost of workforce investment activities relative to the effect of the activities on the performance of participants • Sec. 136(D)(2)(C) • Describe the State’s evaluations of workforce investment activities, including: • The evaluation's methodology; and • The timing of feedback and deliverables. • Sec. 136(d)(1)

19. WIA Performance Team Annual Report--Tabular Section Financial Statement Example

20. WIA Performance Team Annual ReportTabular Section State performance measures Sec. 136(d)(1) • Numerator and denominator • Allows aggregation over states • Negotiated levels • Exclude: • Self-service & informational activities only • National Emergency Grants • Statewide activities excluded from performance • Source for determining incentives & sanctions

21. WIA Performance Team Annual ReportTabular Section • Comparison of results of those who received training and those who did not Sec. 136(d)(2)(E) • Outcomes for special populations 136(d)(2)(F) • Other outcomes listed in the legislation • Training-related employment 136(d)(2)(A) • Wages at entry to employment 136(d)(2)(B) • 12-month retention and earnings 136(d)(2)(D) • Cost of activities 136(d)(2)(C) • Local performance 136(d)(1)

22. WIA Performance Team Annual Report--Tabular SectionTable A - Workforce Investment Act Customer Satisfaction Results • # surveyed = # with completed interviews • Eligible for survey (the sample frame) = • Participants: program year exiters • Employers: service completed in program year • Sec. 136(d)(1)

23. WIA Performance Team Annual Report--Tabular Section 2Table B - Adult Program Results At-A-Glance Sec. 136(d)(1)

24. WIA Performance Team Annual Report--Tabular Section 3Table C - Outcomes for Adult Special Populations Sec. 136(d)(2)(F)

25. WIA Performance Team Annual Report--Tabular SectionTable D - Other Outcome Information for the Adult Program • Does not include individuals who received only • informational or self-service core activities • Sec. 136(d)(2)(E)

26. Table E - Dislocated Worker Program Results At-A-Glance Performance Measures 136(d)(1) Table F - Outcomes for Dislocated Worker Special Populations Performance Measures for: Veterans Displaced Homemakers Individuals With Disabilities Older Individuals Sec. 136(d)(2)(F) WIA Performance Team Annual ReportTabular Section

27. Table G - Other Outcome Information for the Dislocated Worker Program Performance Measures for Individuals Who Received Training Services Individuals Who Received Only Core and Intensive Services Sec. 136(d)(2)(E) WIA Performance Team Annual ReportTabular Section

28. Table H - Older Youth Results At-A-Glance Performance Measures 136(d)(1) Table I - Outcomes for Older Youth Special Populations Performance Measures for: Public Assistance Recipients Veterans Individuals With Disabilities Out-of-School Youth Sec. 136(d)(2)(F) WIA Performance Team Annual ReportTabular Section

29. Table J - Younger Youth Results At-A-Glance Performance Measures 136(d)(1) Table K - Outcomes for Younger Youth Special Population Performance Measures for: Public Assistance Recipients Individuals With Disabilities Out-of-School Youth Sec. 136(d)(2)(F) WIA Performance Team Annual ReportTabular Section

30. WIA Performance Team Annual Report--Tabular SectionTable L - Other Reported Information Sec. 136(d)(2)(A), 136(d)(2)(B), 136(d)(2)(D)

31. WIA Performance Team Annual Report--Tabular SectionTable M - Participation Levels

32. WIA Performance Team Annual Report--Tabular SectionTable N - Cost of Program Activities Supplements financial report

33. WIA Performance Team Annual Report--Tabular SectionTable O - Local Performance • A table for each local area • Sec. 136(d)(2)(C)

34. WIA Performance Team Annual Report--Time Periods • Time Periods to be Reported--Same as used for performance indicators: • Measures Based on Wage Records • Adults, DWs, older youth, younger youth retention • Exiters first quarter of PY and last 3 quarters of previous PY • ‘Real-time’ measures • Youth goal attainment, Youth diploma attainment, Customer satisfaction • Program Year

35. WIA Performance Team ETA Performance Team Phone Fax 202.693.3031 202.693.3229 Consultant services providedby… Mr. Rich Westrichard_west@spra.comSocial Policy Research Associates Mr. Bill Rabung, Team Leader wrabung@doleta.gov Ms. Jacqui Shoholmjshoholm@doleta.gov Mr. Bradley Sicklesbsickles@doleta.gov Ms. Candice Graham-Young cyoung@doleta.gov