910 likes | 1.14k Views
FY2007 Federal Performance for Staff . Overview and Discussion of Performance Measures for FY07. Objectives for the Day. Performance Measures At-A-Glance Performance Reporting Cohorts Key Definitions You Need to Know Performance Measures Methodologies Who’s In/Out of the Measure
E N D
FY2007 Federal Performancefor Staff Overview and Discussion of Performance Measures for FY07 FY 2007 Federal Performance for Staff
Objectives for the Day • Performance Measures At-A-Glance • Performance Reporting Cohorts • Key Definitions You Need to Know • Performance Measures Methodologies • Who’s In/Out of the Measure • How the Measures are Calculated • How does MOSES data entry affect performance? FY 2007 Federal Performance for Staff
FY2007 Performance Measures At-A-Glance FY 2007 Federal Performance for Staff
FY2007 LABOR EXCHANGE, VETERAN AND TITLE IPERFORMANCE MEASURES COHORTS FY 2007 Federal Performance for Staff
A Few Key Definitions Who is a Participant? What is a Program Exit? What is the Exit Quarter? What are the 1st, 2nd and 3rd Quarters After Exit? What is an Exclusionary Exit? What is Supplemental Employment Data? What is Wage Matching? – A Discussion FY2007 Performance Measures FY 2007 Federal Performance for Staff
A Few Key Definitions… • Participant - A participant is an individual who is determined eligible to participate in the program and receives a service funded by the program in either a physical location (One-Stop Career Center or affiliate site) or remotely through electronic technologies. • Self Service Participants For Labor Exchange, we will begin counting as self-service participants, those who receive only self-service or informational services whether through the virtual career center (i.e. MJQ) or at a physical career center. Labor Exchange self-service participants will be counted in performance calculations. FY 2007 Federal Performance for Staff
A Few Key Definitions… • Program Exit - The term “program exit” means a participant does not receive a service funded by the program or funded by a partner program for 90 consecutive calendar days and is not scheduled for future services. Operational Parameters: Title I participants will be reported as exiters according to the exit date entered by local staff on the Basic tab of MOSES. Local operators are responsible for assuring that participants that receive no service in 90 days are exited. Labor Exchange participants who receive no service for 90 days will be reported as exiters. To the extent possible, it is the responsibility of local staff to assure that a program exit is not entered until all services are completed (e.g. Labor Exchange, NEG, etc.). This will assure that the participant enters the exit cohort for all programs on a common exit date. FY 2007 Federal Performance for Staff
A Few Key Definitions… • Exit Quarter - Represents the calendar quarter in which the date of exit is recorded for the individual. FY 2007 Federal Performance for Staff
1st Quarter after exit 2nd Quarter after exit 3rd Quarter after exit Exit Quarter Example-Quarters A Few Key Definitions… • 1st, 2nd and 3rd Quarters After Exit FY 2007 Federal Performance for Staff
A Few Key Definitions… • Wage Matching Process • Massachusetts UI Wage Processing (from DOR) • WRIS (Wage Record Interchange System) • A nationwide system to exchange wage records • Importance of accurate Social Security Numbers • Incorrect Social Security Numbers • Pseudo • Supplemental Wage Information • MOSES “Employment Follow Up” Button FY 2007 Federal Performance for Staff
A Few Key Definitions… • Exclusionary Exit:A participant in any of the following categories either at the time of exit or during the three quarter measurement period following the exit quarter, will be excluded from all performance measures: • Institutionalized • Health/Family Medical Care • Deceased • Reservist Called to Active Duty • Youth Relocated to a Mandated Program • Invalid SSN FY 2007 Federal Performance for Staff
A Few Key Definitions… • Supplemental Employment Data:Grantees may use supplemental sources of data to document a participant’s entry and retention in employment for those participants not covered by wage records; e.g. self-employment, federal jobs, etc. Operational Parameters: Supplemental employment data is entered on MOSES via the Services/Employment Information tab. All supplemental data and methods must be documented and are subject to audit. FY 2007 Federal Performance for Staff
FY07 Adult Performance Measures(Labor Exchange, Veterans, Trade, Title I Adults, DW, NEG) • Entered Employment Rate • Employment Retention Rate • Average Earnings • Employment & Certificate Rate (Title I Adult and Disloc Worker) FY 2007 Federal Performance for Staff
Entered Employment Rate FY07 Adult Performance Measures… Of those who are not employed at the date of participation: # of adults who are employed in the first quarter after the exit quarter divided by # of adults who exit during the quarter FY 2007 Federal Performance for Staff
240 total exiters – 15* = 225 FY07 Adult Performance Measures… 180 adults employed 1st qtr. after exit – 15* = 165 = 73% *These 15 exiters were already employed at participation and are excluded from the entire calculation. [ADULT ENTERED EMPLOYMENT RATE] FY 2007 Federal Performance for Staff
MOSES Documentation…Employed At Participation Status From “Eligibility Criteria” FY 2007 Federal Performance for Staff
MOSES Documentation…Employed At Participation Status Full Tab FY 2007 Federal Performance for Staff
MOSES Documentation… Supplemental Employment Data Services/Employment Tab FY 2007 Federal Performance for Staff
MOSES Documentation…Supplemental Employment Data FY 2007 Federal Performance for Staff
MOSES Documentation…Supplemental Employment Data FY 2007 Federal Performance for Staff
MOSES Documentation…Supplemental Employment Data FY 2007 Federal Performance for Staff
FY07 AdultPerformance Measures… Of those who are employed in the firstquarter after the exit quarter: # of adults who are employed in both the second and third quarters after the exit quarter divided by # of adults who exit during the quarter Employment Retention Rate FY 2007 Federal Performance for Staff
180 adults exited during the quarter FY07 Adult Performance Measures… Of those who are employed in the 1st quarter after exit: 145adults employed in both 2nd and 3rd qtr after exit = 81% Exiters who were employed at time of participation are included [ADULT EMPLOYMENT RETENTION RATE] FY 2007 Federal Performance for Staff
FY07 AdultPerformance Measures… Of those adults who are employed in the first, second and third quarters* after the exit quarter: Total earnings in the second plus the total earnings in the third quarters after the exit quarter divided by # of adult participants who exit during the quarter Adult Average Earnings * via wage match only FY 2007 Federal Performance for Staff
77 exiters FY07 AdultPerformance Measures… Of those adults who are employed in the 1st, 2nd AND 3rd qtr after the exit quarter: Summed wages from quarters 2 and 3 after exit =$1,225,000 = $15,909 [ADULT AVERAGE EARNINGS] FY 2007 Federal Performance for Staff
Employment & Certificate Measure(Adults and Dislocated Workers) FY07 Adult PerformanceMeasures… Of those who receive training services: # of participants who were employed in the first quarter after the exit quarter and received a credential/certificate by the end of the third quarter after the exit quarter divided by # of participants who exit during the quarter FY 2007 Federal Performance for Staff
160 exiters during the quarter FY07 Adult PerformanceMeasures… Of the Adults and Dislocated Workers who receive training services, 110 wereemployed 1st qtr after exit – 12* = 98 = 61% *12 did not receive a certificate by the end of the 3rd quarter after exit. [ADULT EMPLOYMENT & CERTIFICATE RATE] FY 2007 Federal Performance for Staff
FY07 Adult PerformanceMeasures… Enrollment into a training course, indicates that a participant is/has receiving training services. Training Enrollment Detail FY 2007 Federal Performance for Staff
FY07 Adult PerformanceMeasures… Once the status of a course is “Completed Satisfactorily”, an enhancement service of “Attained …” should be posted if the course results in a degree, certificate or license. FY 2007 Federal Performance for Staff
FY07 Adult PerformanceMeasures… Information on the Additional Info tab will indicate if the course results in a Degree, License or Certificate. Training / Training Services / Additional Info FY 2007 Federal Performance for Staff
FY07 AdultPerformance Measures… Certificates can be earned up to 3 quarters after the exit quarter Services / General FY 2007 Federal Performance for Staff
Older Youth Earnings Change Negative Excluded FY07 Adult PerformanceMeasures…Entered Employment Rate Quiz Carmen's performance outcome for Entered Employment is positive because she was employed during the first quarter after exit, July-September. Remember Notice of Layoff or Military Separation means “unemployed” at participation. Carmen enrolled as a dislocated worker in September 2005. She was still working when she registered, but had received notice of layoff. She exited in June 2006. She starts a new job in September 2006. What is her performance outcome for Entered Employment? Positive FY 2007 Federal Performance for Staff
Older Youth Earnings Change Quiz FY07 Adult PerformanceMeasures…Empl/Credential Rate Quiz Ben completed an A+ Certification training and earned his certificate while enrolled in WIA. He exits with a job in April, but loses the job in June and does not find another until October. What is Ben’s performance outcome for the Employment and Credential measure? Ben's performance outcome for the Employment and Credential measure is negative because he was not employed during his first quarter after exit, July-September. Negative Positive Excluded FY 2007 Federal Performance for Staff
Older Youth Earnings Change FY07 Adult PerformanceMeasures…Employment Retention Quiz Julie isexcluded from theEmployment Retention Measurebecause she was not employed during her first quarter after exit, January-March. Julie is an adult. She exits in December and does not find work until April. She keeps the job through September. What is her performance outcome for Employment Retention? Negative Positive Excluded FY 2007 Federal Performance for Staff
Older Youth Earnings Change Negative Positive FY07 Adult PerformanceMeasures…Average Earnings Quiz John is a dislocated worker. He exits in March and finds a new job in July making about $38,000/year and keeps on working. What is John’s performance outcome for Average Earnings measure? John is excluded from the Average Earnings measure because he was not employed during his first quarter after exit.(April – June) Excluded FY 2007 Federal Performance for Staff
FY07 Youth Performance Measures(Older, Younger and All Youth) Older Youth (19-21 years old) • Entered Employment Rate • Employment Retention Rate • Earnings Change • Employment & Certificate/Education Rate FY 2007 Federal Performance for Staff
FY07 Older YouthPerformance Measures… Entered Employment Rate Of those Youth who are not employed at the date of participation and who are either not enrolled in post-secondary education or advanced training in the first quarter after the exit quarter or are employed in the first quarter after the exit quarter: # of youth who are employed in the first quarter after the exit quarter divided by # of youth who exit during the quarter FY 2007 Federal Performance for Staff
150 exiters – 4* - 7** = 139 FY07 Older Youth PerformanceMeasures… 105 youth employed 1st qtr. after exit – 4* – 7** = 94 = 68% *These 4 youth were excluded from the entire calculation because they were employed at registration. **These 7 youth are not employed and are enrolled in advanced training or post secondary education in the quarter after exit, they are excluded. [OLDER YOUTH ENTERED EMPLOYMENT RATE] FY 2007 Federal Performance for Staff
FY07 Older YouthPerformance Measures… Of those youth who are employed in the first quarter after the exit quarter and who are either not enrolled in post-secondary education or advanced training in the third quarter after the exit quarter or are employed in the third quarter after the exit quarter: # of youth who are employed in the third quarter after the exit quarter divided by # of participants who exit during the qtr Employment Retention Rate FY 2007 Federal Performance for Staff
99 youth employed in 1st qtr. after exit – 7* = 92 FY07 Older YouthPerformance Measures… Of those youth who are employed in the first quarter after the exit quarter and who are either not enrolled in post-secondary education or advanced training in the third quarter after the exit quarter or are employed in the third quarter after the exit quarter: 75youth employed in 3rd qtr. after exit = 82% *These 7 youth are excluded because they are enrolled in post secondary education or advanced training and not employed in 3rd quarter after exit. [OLDER YOUTH EMPLOYMENT RETENTION RATE] FY 2007 Federal Performance for Staff
Earnings Gain Measure FY07 Older YouthPerformance Measures… Of those youth who are employed in the first qtr after the exit quarter and who are either not enrolled in post-secondary education or advanced training in the third quarter after the exit quarter or are employed in the third quarter after the exit quarter: Post-Earnings in the [second + third qtrs] after the exit qtr minus Pre-Earnings in the [second + third qtrs] prior to the participation qtr divided by # of participants who exit during the quarter FY 2007 Federal Performance for Staff
240 exiters - 60 * - 12** = 168 FY07 Older YouthPerformance Measures… Of those youth who are employed in the first qtr after the exit quarter and who are either not enrolled in post-secondary education or advanced training in the third quarter after the exit quarter or are employed in the third quarter after the exit quarter: $950,000 - $550,000 = 400,000 = $2381 *These 60 customers were not employed in the 1st quarter after exit, so they are excluded. **Supplemental data was used to verify employment for these 12 customers, so they are excluded. [OLDER YOUTH EARNINGS GAIN MEASURE] FY 2007 Federal Performance for Staff
Employment/Education & Credential Measure FY07 Older YouthPerformance Measures… # of older youth participants who were either employed, in post-secondary education or in advanced training in the first qtr after the exit qtr and received a credential by the end of the third quarter after the exit quarter divided by # of older youth participants who exit during the quarter FY 2007 Federal Performance for Staff
120 w/credential by the 3rd quarter after exit - 25*= 95 150 exiters FY07 Older YouthPerformance Measures… = 63% *These 25 were not employed or enrolled in advanced training or post secondary education in the quarter after exit. [OLDER YOUTH EMPL/CREDENTIAL RATE] FY 2007 Federal Performance for Staff
FY07 Older YouthPerformance Measures… Certificates can be earned up to 3 quarters after the exit quarter Services / General FY 2007 Federal Performance for Staff
FY07 Older Youth PerformanceMeasures… Entered Employment Quiz Adam, an Older Youth, entered the WIA youth program last year without a job. He exited January 5th with a job. April 3rd he lost his job. What is Adam's outcome for the Entered Employment measure? Adam's outcome for the Entered Employment measure is positive because he was employed during his first quarter after exit, April-June. Negative Positive Excluded FY 2007 Federal Performance for Staff
Negative Positive FY07 Older Youth PerformanceMeasures… Employment Retention Quiz Miriam, an Older Youth, exits with a job on October 15. She leaves that job December 15, finds another one April 7, and keeps it through the following September. What is her outcome for Employment Retention? Miriam's outcome for Employment Retention is excluded because she was not employed during her first quarter after exit, January-March. Excluded FY 2007 Federal Performance for Staff
FY07 Older Youth PerformanceMeasures…Empl/Educ & Credential Quiz Tanya, an Older Youth, entered WIA and completed a GED. She exits in June and travels (jobless) through the summer before beginning classes for her Associate's Degree in October. What is her outcome for the Credential measure? Tanya's outcome for Credential is negative because she was not employed during her first quarter after exit, July-September. Negative Positive Excluded FY 2007 Federal Performance for Staff
FY07 Younger YouthPerformance Measures Younger Youth (14 - 18 years old) • Skill Attainment Rate • Diploma or Equivalent Attainment • Retention Rate FY 2007 Federal Performance for Staff
Skill Attainment Rate FY07 Younger YouthPerformance Measures… Of all in-school youth and any out-of-school youth assessed to be in need of basic skills, work readiness skills, and/or occupational skills: Total # of goals attained divided by Total # goals set FY 2007 Federal Performance for Staff