560 likes | 711 Views
U.S. Department of Labor Employment and Training Administration. Reporting and Data Validation Updates Presenters: Wes Day Barbara Strother Greg Wilson ETA’s Office of Performance and Technology. Presentation Overview.
E N D
U.S. Department of LaborEmployment and Training Administration Reporting and Data Validation Updates Presenters: Wes Day Barbara Strother Greg Wilson ETA’s Office of Performance and Technology
Presentation Overview • Discuss WIA and Wagner-Peyser reporting requirements and due dates • Review ETA’s performance reporting system • Review ETA’s data validation initiative and new software
Required Reports • Annual Report required for WIA • 9091 • Quarterly reports are required for WIA and Wagner-Peyser/VETS • 9090 and 9002A-E, VETS 200A-C • Monthly WIA and Wagner-Peyser reports (ARRA) • 9147, 9148, 9149 • Workforce Investment Act Standardized Record Data (WIASRD)
Annual PY 2008 DRAFT Due Dates • Monday, August 17, 2009: Validated PY 2008 4th quarter 9002 and VETS 200 reports • Monday, August 17, 2009: Wagner-Peyser Report Validation and Data Element Validation summaries for PY 2008 4th quarter 9002 and VETS 200 report • Thursday, October 1, 2009: Validated PY 2008 WIA Annual Report • Thursday, October 1, 2009: WIA Report Validation summary • Thursday, October 15, 2009: PY 2008 WIASRD file • Tuesday, February 1, 2010: WIA Data Element Validation NOTE: All files must be submitted by 11:59 PM Eastern Daylight Time
Quarterly and Monthly Due Dates • Quarterly Reports are due 45 days after the end of the quarter. • Example: 1/1/09 - 3/31/09 report due 5/15/09 • Monthly Reports are due 15 days after the end of the month. • Example: 7/1/09 - 7/31/09 report due 8/17/09 • First report due July 15th
Grantee Reporting System - EBSS • States submit their reports to ETA using the Grantee Reporting System (aka EBSS) • EBSS – Enterprise Business Support System • http://www.etareports.doleta.gov
Grantee Reporting Log In Screen http://www.etareports.doleta.gov
Passwords • One for Wagner-Peyser Reporting • One for WIA Reporting • One for Wagner-Peyser Data Validation • One for WIA Data Validation For password assistance, contact: ebss.help@dol.gov
Monthly Reporting Guidance Training and Employment Guidance Letter No. 24-08 includes • Detailed descriptions of reports • Report specifications • Timelines Available at: http://doleta.gov/directives/
WIA Quarterly Reporting Guidance Workforce Investment Act Quarterly Report: General Reporting Instructions and ETA Form 9090 Available at: http://www.doleta.gov/performance/Reporting
Table O – Local Performance Table O contains information by Local Workforce Board • States should review to see if ETA has the most current listing of local areas and their ETA assigned numbers • States should send any updates to ETA no later than August 25 • send updates to ebss.help@dol.gov
WIA Annual Reporting Guidance Workforce Investment Act Annual Report: General Reporting Instructions and ETA Form 9091 Available at: http://www.doleta.gov/performance/Reporting
WIASRD - Intro Workforce Investment Act Standardized Record Data (WIASRD) • Individual records (not aggregate) • Very important for ad-hoc analysis • Type of training • Demographics • Outcomes
WIASRD - Updates Updates for 2008 • Adds valid values to Other Non-WIA Programs (WIASRD field 326) to allow states to code American Recovery and Reinvestment Act of 2009 co-enrollments • Designates WIASRD field 313c as a “Special Projects” field
WIASRD – Submission Tips • Uploading WIASRD files to EBSS can be very time consuming. • ETA processes WIASRD files overnight and provides the state with a status the following day. • Some tips to reduce WIASRD upload time include: • Zip your file • Remove unnecessary characters • Firefox is faster than IE
WIASRD – Tips Continued The slow way – 626 characters: "000000000","18810118","2","3","2","2","2","3","3","3","2","1","2","1","3","1","2","2","2","12","2","","2","2","1","1","4","1","00000","19020503","19021010","2","2","1","2","2","2","2","","2","","","","","","","","","","","","","","","","","","","","1","2","","","2","2","2","2","999999999","0","2","1","2","2","2","1","1","","","","1","1","2","1","","1","1","02001.00","","01712.00","","03112.00","03094.00","01182.00","00000.00","00000.00","5","","3","3","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","","“ The fast way – 283 characters: 000000000,18810118,2,3,2,2,2,1,2,2,3,3,3,2,1,2,1,3,1,2,2,2,12,2,,2,2,1,1,4,1,00000,19020503,19021010,2,2,1,2,2,2,2,,2,,,,,,,,,,,,,,,,,,,,1,2,,,2,2,2,2,999999999,0,2,1,2,2,2,1,1,,,,1,1,2,1,,1,1,2001,,1712,,3112,03094,1182,0,0,5,,3,3,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
WIASRD – The Future • Quarterly submissions beginning March 31, 2010. • Includes participants and exiters. • Now is the time to fix problems.
Don’t Forget Wagner-Peyser! • Monthly and Quarterly Reports • Submitted to ETA via EBSS • Quarterly Guidance: ETA 9002 and VETS 200 Data Preparation Handbook No. 406 • Monthly Guidance: Training and Employment Guidance Letter No. 24-08
Basic Reporting Review • Monthly WIA and Wagner-Peyser Reports • Quarterly WIA and Wagner-Peyser Reports • Annual WIA Report • WIASRD
Part 2: Data Validation ETA’s data informs the Legislative and Executive branches of government as well as media, researchers, and the public. Without Data Validation, ETA is not able to assess the accuracy of its data.
How Does Data Validation Work? Two separate processes are required to ensure that performance data is reliable: • Report Validation ensures that aggregate reports are calculated correctly. • Data Element Validation ensures that the data elements in the participant records used to calculate aggregate reports are accurate.
Data Validation Guidance • TEN 14-02: To inform the workforce investment system of the data validation initiative for employment and training programs. Issued May 28, 2003. • TEGL 3-03: Data Validation Policy for Employment and Training Programs. Issued August 20, 2003. • TEGL 3-03, Change 1. Issued August 20, 2004. • TEGL 3-03, Change 2. Issued October 20, 2004. • TEGL 3-03, Change 3. Issued July 15, 2005. • TEN 9-06: Program Year 2005/Fiscal Year 2006 Performance Reporting and Data Validation Timelines. Issued August 17, 2006. • TEN 19-07: Program Year 2006/Fiscal Year 2007 Performance Reporting and Data Validation Timelines. Issued December 11, 2007. • TEN 09-08: Program Year 2007/Fiscal Year 2008 Performance Reporting and Data Validation Timelines. Issued September 3, 2008
Data Reporting and Validation Software Data Reporting and Validation Software (DRVS) version 7.2 released May 6, 2009. • Use for PY2008 Annual Report and 2009 Quarterly reports • Adds valid values to Other Non-WIA Programs (WIASRD 326) to allow states to code American Recovery and Reinvestment Act of 2009 co-enrollments • Fully implements the Literacy/Numeracy calculation per TEGL 17-05, Change 2 • Designates WIASRD 313c as a “Special Projects” field
DRVS – Available Here! DRVS is available at: http://www.doleta.gov/performance/Reporting/tools_datavalidation.cfm
DRVS is Essential to Reporting • Processes the WIA Quarterly and Annual Reports, and the Wagner-Peyser/VETS quarterly performance reports • Provides all functions necessary for validation • Compares reports • Sampling and data accuracy analysis • Uploads performance reports and validation error reports to ETA
Reporting of Validation Results • DRVS produces: • Report validation summary • Data element validation summary and analytical reports • WIA and LX DRVS creates files with the annual report validation values for upload to ETA
DRVS Reporting Options Screen This reporting option screen is for the WIA annual report covering Program Year 2008.
Creating RV Extract Files for WIA • State IT staff produce extract file with participant records for all participants and exiters included on the appropriate report • Extract file format is based on the WIASRD (with extra fields added to help locate participant files in one-stops – sampling unit, WIB Name, Office Name, Case Manager, and User Field)
Loading Extract File into DRVS State staff import the extract file into the data validation software The software processes the file and builds performance outcome groups Multiple edit checks
Reload Files if Necessary • Review error and duplicate reports • Determine whether the extract file must be regenerated or reformatted based on whether the number of errors is significant • Load the entire modified extract file if necessary • DRVS will not import additional records into a file that has already been imported.
Uploading the WIA Annual Report to DRVS • To calculate the error rate, the software must have the state’s reported values • Import the item totals from the WIA Annual Report into the reported count input form • The validation software provides the capability to e-submit the report to ETA
Report Validation Summary • After reported values from the WIA Annual Report have been imported the software produces the report validation summary • Calculates the difference between the validation and reported values • Displays an error rate for each reported value • DRVS can e-submit the report to ETA
How Does Data Validation Work? (again) Two separate processes are required to ensure that performance data is reliable: • Report Validation ensures that aggregate reports are calculated correctly. • Data Element Validation ensures that the data elements in the participant records used to calculate aggregate reports are accurate.
Data Element Validation • Report will not be accurate if the data being used by the software are wrong • Requires checking data elements against source documentation to verify compliance with federal definitions • States identify state-specific source documentation • DRVS produces worksheets for state staff to enter source documentation review