New York State Report Cards

1. New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability

2. Evaluated in TWO Methods NYS Benchmarks Quartile Ranked Educational Gain (Weighted) Post Test Rate Follow Up Outcomes • Educational Gain = 46% • Post Test Rate = 65% • Follow Up Outcomes = 69%

3. NYS Quartile Ranking • Quartile 1 0 - .99 Unacceptable • Quartile 2 1 – 1.99 Needs Improvement • Quartile 3 2 – 2.99 Proficient • Quartile 4 3 – 4.00 Highly Proficient

4. Quartile Rank • Unacceptable • Missed one or more benchmark & in the 1st quartile • Needs Improvement • Missed one or more benchmark & in the 2nd, 3rd, or 4th quartile • Proficient • Has met all the benchmarks (any quartile) • Highly Proficient • Has met all the benchmarks & in quartile 4

5. An overview of the program:

6. Data from Program Evaluation Report:

7. NYS Benchmark Summary: • NYS Benchmarks: • Education Gain = 46% • Post Test Rate = 65 % • Follow-up Outcomes = 69%

8. NYS Benchmark Summary: • NYS Benchmarks: • Education Gain = 46% • Post Test Rate = 65 % • Follow-up Outcomes = 69%

9. Post Test Rate: Post Test Rate is also Quartile Ranked

10. Post Test Rate:

11. NYS Benchmark Summary: • NYS Benchmarks: • Education Gain = 46% • Post Test Rate = 65 % • Follow-up Outcomes = 69%

12. Where have you seen them before:

13. # students achieving goal Raw numbers used to calculate Program Performance in Percent = 86.5% # students exiting with goal Follow Up Outcomes:

14. Weighted Academic Gain:

15. Goal Setting: 0 5 10

16. Response Rate: 0 10

17. Quartile Rank Summary: Note: Quartile Rank includes Weighted Educational Gain

18. Overall Performance: Quartiles Quartile 1 0 - .99 Unacceptable Quartile 2 1 – 1.99 Needs Improvement Quartile 3 2 – 2.99 Proficient Quartile 4 3 – 4.00 Highly Proficient

19. 0 1 2 3 4 Quartile 1 Quartile 2 Quartile 3 Quartile 4 Overall Performance: 1.35

20. Rubric for FY10/11: • Educational Gain (40%) • Follow Up Outcomes (20%) • Post Test Rate (20%) • Employment & GED Goal Setting (10%) • Response Rate (10%)

21. Total Score – Calculations for FY10/11 • Maximum rating points to be earned: • Weighted Academic Gain 40 • Follow-up Measures 20 • Post Test Rate 20 • Goal setting 10 • Response Rate 10 • Maximum Total 100

22. NRS Changes

23. Change Effective July 1, 2012 • OVAE has accepted major change to NRS Guidelines • All proposed changes begin July 1, 2012 • ASISTS will make changes in data system to begin July 1, 2012

24. 1st Major Change Employment Goals & Outcomes

25. Let’s compare July 1, 2012 Now Current System: Students are assessed at Intake Determination is made: Is student employed __yes __no Is student available for work? __yes __no If YES, then assign the goal of “Obtain Employment” (70% Target) If NO – then student status is coded as “Not in the workforce” Changes to System: Students are assessed at Intake Determination is made: Is student employed __yes __no Is student available for work? __yes __no If YES, then ASISTS will automatically assign the goal of “Obtain a Job” to all students in this cohort If NO – then student status is coded as “Not in the workforce”

26. Let’s compare Now July 1, 2012 Current System: Students are assessed at Intake Determination is made: Is student employed __yes __no If YES – is student enrolled in literacy to Retain his/her employment? If YES – code student with goal of “Retain Employment” Changes to System: Students are assessed at Intake Determination is made: Is student employed __yes __no If YES, then ASISTS will automatically assign the goal of “Retain Employment” to all students in this cohort. Program must conduct Follow Up Survey on each student 3 Quarters after student exits the program.

27. 2nd Major Change GED® Goal & Outcome

28. July 1, 2012 Now Current System: Students are assessed at Intake Determination is made: Does student have the goal of attaining a High School Equivalency Diploma __yes __no If YES, then assign the goal of “Obtain GED” Changes to System: Students are assessed at Intake Determination is made: Programs must report the total number of enrolled students who take all the GED tests during the year and the number who pass them to calculate a pass rate. All GED test data will now be recorded in ASISTS and a pass rate will be calculated for each program. Let’s compare

30. 3rd Major Change Enter Postsecondary Education or Training Goal & Outcome

31. Let’s compare Now July 1, 2012 Current System: Students are assessed at Intake Determination is made: Does student have the goal of attaining a High School Equivalency Diploma __yes __no If YES, then assign the goal of “Obtain GED” Second Question – Does the student also have the goal of entering Postsecondary Education or Training? If YES, assign goal (50% target) Changes to System: Students are assessed at Intake Determination is made: All learners who have a GED, a secondary credential, or are enrolled in a class specifically designed for transitioning to postsecondary education (e.g., bridge program, college readiness), as the cohort for which “Entry into Postsecondary Education” must be tracked. Students included in the cohort are those who passed the GED tests or earned a secondary credential while enrolled in adult education, enter with these credentials, or are enrolled in a class specifically designed for transitioning to postsecondary education.

32. Additional Change Entry into Postsecondary Education or Training can occur any time from the time of exit until the end of the following program year.

33. 2 Minor Changes Students’ Highest Educational Level or Degree Attained & Teacher Experience and Certification .

34. Contact Information: Rosemary Matt NYS Director of Accountability Email: Rosemary.Matt@cayuga-cc.edu