Scantron Measures, Metrics and Cut-Points for Alternative Education Campuses

1. Scantron Measures, Metrics and Cut-Points for Alternative Education Campuses Colorado Department of Education July 12, 2012

2. Agenda • Purpose • Selection of Measures Process & Considerations • Metrics and Cut-Points for Scantron Achievement Results • Metrics and Cut-Points for Scantron Growth Results • Timeline

3. Purpose • Discuss and propose methodologies to explore for calculating and reporting Scantron assessment results for accountability purposes on the AEC SPF report (metrics and cut-points). • Provide feedback on how CDE can support districts/schools in the calculation.

4. Selection of Measures Process • AECs submitted the Selection of Measures Form July 2. • http://www.cde.state.co.us/Accountability/Downloads/AECSelectionOfAccountabilityMeasures.xlsx • There are a set of state required AEC measures: • Achievement: CSAP/TCAP % proficient/advanced • Growth: CSAP/TCAP Median Growth Percentiles • Postsecondary: Completion rate, Dropout rate, ACT composite • Engagement: Average daily attendance, Truancy rate • Districts may select additional measures, subject to CDE approval.

5. Considerations for Measures • The three most recent years of data will be included. • AECs will receive indicator ratings similar to the traditional SPF: • Does not meet, approaching, meets, or exceeds AEC norms • Each indicator/sub-indicator: • Uses adjusted AEC cut-points relative to each other • Typically uses either normative cuts of 40th/60th/90th percentile or head counts of 40%/60%/90% • Where there are common measures across districts, common metrics and cut-points will be used.

6. Considerations for Overall Results • Based on the indicator ratings, AECs receive an overall point total and plan type. • AECs engage in the same UIP process as all other schools, and have the same consequences for performance. • Note: There is a modified UIP template for AECs to reflect the modified performance indicators.

7. Scantron Achievement Results • Reading, Language Arts, Math, Science

8. Scantron Growth results • Reading, Language Arts, Math, Science

9. Calculating Growth Targets for Scantron Ideally, Scantron growth targets would be: • Student level • Take into consideration the student’s starting scale score • Appropriate for students attending AECs • Account for the length of time the student was receiving instruction • Indicate whether the student is on-track in terms of observed and expected growth

10. Calculating Growth Targets for Scantron Questions for AECs • How are AECs currently assigning growth targets? • Targets provided by Scantron? Or • Targets calculated from the AEC’s prior results? • Are the targets specific to AECs or for traditional schools? • Are the growth targets student level? • Do the targets vary by starting grade equivalent? • How do we know the growth targets are appropriate for this student population?

11. Calculating Growth Targets for Scantron • How can AECs giving Scantron come up with meaningful growth targets? • What support can CDE provide in this process?

12. Completing Selection of Measures Form • Fill in your AEC’s aggregated percentage of students meeting their target growth • Fill in your AEC’s total number of students with pre- and post-test records (denominator)

13. Assigning a Growth Rating • CDE will assign a rating to your AEC’s reported Scantron growth. • This calculation is done separately for each of the three subject areas by comparing the percentage of students meeting their target growth against the following state cut-points:

14. Process/Timeline July 25: Scantron Results to CDE

15. Resources • Alyssa Pearson, Executive Director • pearson_a@cde.state.co.us , 303-866-6855 • Marie Huchton • huchton_m@cde.state.co.us , 303-866-6203 • Donna Morganstern • morganstern_d@cde.state.co.us , 303-866-6209 • Somoh Supharukchinda • supharukchinda_s@cde.state.co.us , 303-866-6778 • http://www.cde.state.co.us/Accountability/StateAccountabilityAECs.asp