1 / 38

TETN Session #18318 | August 29, 2013 | 1:00-3:00 p.m.

2013 Accountability Overview and Update. TETN Session #18318 | August 29, 2013 | 1:00-3:00 p.m. Texas Education Agency | Office of Assessment and Accountability Division of Performance Reporting Shannon Housson, Director. Review and Feedback on 2013 State Accountability Release.

holli
Download Presentation

TETN Session #18318 | August 29, 2013 | 1:00-3:00 p.m.

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 2013 Accountability Overview and Update TETN Session #18318 | August 29, 2013 | 1:00-3:00 p.m. Texas Education Agency | Office of Assessment and Accountability Division of Performance Reporting Shannon Housson, Director

  2. Review and Feedback on 2013 State Accountability Release

  3. 2013 Accountability Ratings and Designations

  4. 2013 Performance Index Targets • 2013 Index Targets for Non-AEA Campuses and Districts • To receive a Met Standard rating, non-AEA campuses and districts must meet the following accountability targets on all indexes for which they have performance data in 2013.

  5. 2013 Performance Index Targets • 2013 Index Targets for AEA Campuses and Charters • To receive a Met Alternative Standard rating, alternative education campuses and charter operators evaluated under AEA provisions must meet the following accountability targets on all indexes for which they have performance data in 2013.

  6. 2013 Accountability Report Updates (posted August 29, 2013)

  7. Accountability Reports with Drill-Down Features • The 2013 Accountability Summary report has been enhanced with clickable links that drill-down to more detailed data for the: • Performance Index Report, • Performance Index Summary, • Distinction Designation, • Campus Demographics, and • System Safeguards • Important Note: The data have not changed. These reports contain the same information that was reported on August 8. SAMPLE HS (000000000) – SAMPLE DISTRICT

  8. Distinction Designation Summary • The 3-page Distinction Designation Summary report released on August 8 has been enhanced with a 4th page that details Numerators, Denominators, Scores, Quartile 1 Minimum Scores, and Quartile Scores for each of the Indicators used in the calculation of Distinction Designations. • Blank values for an Indicator Score occur if the indicator is not applicable to that campus or does not meet minimum size of 10 students. Blank values for a Quartile occur if there are less than 20 campuses in the campus comparison group for each qualifying indicator. SAMPLE HS (000000000) – SAMPLE DISTRICT Campus Type – High School

  9. System Safeguards 9 • This 1-page System Safeguards report released on August 8 has been enhanced with a 2nd and 3rd page that details Numerators, Denominators, and Rates for each of the subjects and student groups used in the calculation of Performance Rates, Participation Rates, Graduation Rates, and Federal Limits on Alternative Assessments. SAMPLE HS (000000000) – SAMPLE DISTRICT

  10. 2013 Statewide Results

  11. 2013 Statewide Results Districts (Including Charter Operators) • Of the 1,228 districts in the state, 1,136 (92.5%) achieved a Met Standard or Met Alternative Standard rating. • A total of 80 (6.5%) districts were rated Improvement Required and 12 (1%) were labeled as Not Rated.

  12. 2013 Statewide Results Campuses • Of the 8,555 campuses in the state, 7,206 (84.2%) achieved a Met Standard or Met Alternative Standard rating. • 778 (9.1%) were labeled Improvement Required. • 571 (6.7%) were labeled as Not Rated.

  13. 2013 Statewide Results Alternative Education Accountability (AEA) Campuses • Of the 396 campuses registered to be evaluated under AEA provisions, 220 (55.6%) achieved a Met Alternative Standard rating. • 36 (9.1%) were labeled as Improvement Required. • 140 (35.4%) were labeled as Not Rated, which comprise 53 AECs of Choice and 87 Residential Facilities.

  14. 2013 Statewide Results Distinction Designations • Only campuses that received a Met Standard rating are eligible for Distinction Designations in 2013. Districts, charter operators, and AEA campuses are not eligible to receive Distinction Designations. • Of the 8,555 campuses, 1,991 (23.3%) campuses received a distinction for achieving the Top 25% in Student Progress. • 2,323 (27.2%) received a distinction for reading/ELA and 1,906 (22.3%) received a distinction for mathematics. • In total, 3,599 (42.1%) received one or more Distinction Designations. • 759 (8.9%) received Distinction Designations in all three categories.

  15. 2013 Statewide Results System Safeguards • Of the 55 performance indicators (five subject areas x 11 student groups) evaluated in the system safeguards, 52 (94.5%) indicators achieved the performance target of 50%. • All 22 of the participation indicators (two subject areas x 11 student groups) achieved the participation target of 95%. • Of the 11 student groups, 9 (81.8%) achieved the graduation rate of 78% for the four-year rate, achieved 83% for the five-year rate, or demonstrated sufficient improvement to achieve the goal of 90%. • The state did not exceed the federal limit of 1% on STAAR Alternate or the 2% limit on STAAR Modified results.

  16. Notice of Performance Requirements

  17. Notice of Performance Requirements • Sections 39.361 and 39.362 of the Texas Education Code require districts to do the following: • Requires districts to state whether the campus has been awarded a distinction designation or is currently rated Improvement Required, and an explanation of the significance of the information. • Requires districts by the 10th day of the new school year to have posted on the district web site the current accreditation status and accountability ratings, Performance Reports (formerly referred to as the AEIS reports), and School Report Cards (SRC) as well as an explanation of the information. • An updated FAQ is available at the following link to help districts meet these requirements: http://ritter.tea.state.tx.us/perfreport/3297_faq.html

  18. 2013 Appeals Process

  19. Appeals Timeline

  20. Appeals Process • Districts may appeal for any reason. However, since the new state accountability system relies on performance index calculations, the state accountability appeal process will be limited to rare cases where a data or calculation error is attributable to the testing contractor or TEA. • The compensatory nature of the index framework and other features of the indexes, such as the use of multiple indicators to derive an overall index score, minimize the possibility that district errors in coding student demographic information in PEIMS or the STAAR assessment program negatively impact the overall accountability rating. • Also, the use of online applications provided by the agency and testing contractor ensures that districts are aware of data correction opportunities. District responsibility for data quality is the cornerstone of a fair and uniform rating determination.

  21. Appeals Process Special Circumstances • District requested that writing results be rescored. Include a copy of the dated request to the test contractor and the outcome with the appeal. If the rescored results impact the rating, the copies are necessary since rescored results may not have been processed in time to be included in the assessment data that determined the accountability ratings by August 8th. • Other serious problems found. Copies of correspondence with the test contractor or the regional ESC should be provided with the appeal. • Errors based on STAAR or TELPAS online test submission. Errors must include documentation of the administration of the assessment. • Campus shut down during a test administration. The issuance of a Not Rated label is possible. In these cases, any affected results that may have been scored are not evaluated. Also, no reliable rating can be issued based on available data.

  22. Appeals Process Not Rated: Other • Districts rated Not Rated: Other are responsible for appealing this rating by the scheduled appeal deadline if the basis for this rating was a result of special circumstance or error by the testing contractor that affected data used to determine accountability ratings. If the agency determines that the Not Rated: Other rating was assigned due to a unique circumstance, the agency will assign an updated rating. Distinction Designations • Academic Achievement Distinction Designations (AADD) cannot be appealed. AADD indicators are reported for most campuses regardless of eligibility for a designation outcome. Since campuses rated Improvement Required are noteligible for an AADD outcome, campuses that appeal an Improvement Required rating will automatically receive any Distinction Designation earned if their appeal is granted and their rating is raised to Met Standard.

  23. Appeals Process Relationship to the Accountability System Safeguards and PBMAS • The Accountability System Safeguard measures, Performance-Based Monitoring Analysis System (PBMAS) indicators, and Program Monitoring and Interventions Division intervention staging requirements will be considered when making decisions on appeals. • School district data submitted through PEIMS or to the state assessment contractor are also considered. • Please note that certain appeal requests may lead to Program Monitoring and Interventions activities to address potential concerns related to data integrity.

  24. 2012-13 Annual Performance Report

  25. Performance Report and School Report Card • The Annual Performance Report, formerly known as the Academic Excellence Indicator System (AEIS) report, will be released on the TEA Secure Environment (TEASE) and TEA’s public website in November 2013. • The School Report Card (SRC) will report a subset of data that are reported on the Performance Report. • The SRC and all its reporting requirements will be released on the web in early December. • More information on the Annual Performance Report and School Report Card will be disseminated during the November 14, 2013 TETN (#18319).

  26. 2014 Accountability Development

  27. Accountability Advisory Committees • Accountability advisory groups will convene in fall 2013 to finalize recommendations for accountability ratings criteria and labels for 2014 and beyond and performance index targets for 2014—2016. • Early December 2013 – Accountability advisory groups convene to develop recommendations to commissioner for accountability ratings criteria and labels for 2014 and beyond and performance index targets for 2014, 2015, and 2016 accountability ratings. • Spring 2014 – commissioner announces accountability ratings criteria for 2014 and beyond and final 2014 targets, preliminary 2015 targets, and preview 2016 targets.

  28. Ratings Criteria & Targets for 2014 and Beyond • Index 3: Closing Performance Gaps • The percent of students at the specified student performance level on the assessment is multiplied by the weight for that performance level. The STAAR weighted performance rate calculation was modified for 2013 because STAAR Level III performance could not be included until 2014. • Phase-in 1 Level II (2013 and beyond) – one point for each percent of students at the phase-in 1 Level II performance standard. • Level III Advanced (2014 and beyond) – two points for each percent of students at the final Level III performance standard.

  29. Ratings Criteria & Targets for 2014 and Beyond • Index 4: Postsecondary Readiness • STAAR Level II Performance for Index 4In 2014 and beyond, credit will be given for final Level II performance on the same assessments used in Index 1 at final Level III performance standard. • Subjects Areas Evaluated for STAAR Performance in Index 4All subject areas (reading, mathematics, writing, science, and social studies) are combined. Subject areas are not evaluated separately. • Student Groups Evaluated for STAAR Performance in Index 4Eight student groups are evaluated.All Students and the Seven Racial/Ethnic groups: African American, American Indian, Asian, Hispanic, Pacific Islander, White, and Two or More Races

  30. Ratings Criteria & Targets for 2014 and Beyond • Index 4: Postsecondary Readiness for AEA Campuses and Charters • Some AEA campuses and charters serve a unique student population that warrants alternative criteria and index targets in regards to Index 4. Modifications to Index 4 will be reviewed with the accountability advisory groups in fall 2013 to ensure all of the requirements of Senate Bill (SB) 1538 are met. • Graduation and General Educational Development (GED) Score will contribute 75 percent of the points to Index 4 and STAAR Score (Percent Met final Level II on One or More Tests) will contribute 25 percent of the points.

  31. Distinction Designations for 2014 and Beyond • Campus Top Twenty-Five Percent Distinction DesignationsWill be based on performance on Index 2 and Index 3 in relation to campuses in the comparison group. • 2013 and Beyond: Top 25% Student Progress. Based on performance on Index 2: Student Progress. Campuses in the top quartile of their campus comparison group in performance on Index 2 earn this distinction designation. • 2014 and Beyond: Top 25% Closing Achievement Gaps. Based on performance on Index 3: Closing Performance Gaps. Campuses in the top quartile of their campus comparison group in performance on Index 3 earn this distinction designation. • Academic Achievement Distinction Designations in Science and Social StudiesCampuses will be eligible for distinction designations in science and social studies in 2014. Indicators will be determined based on input from advisory groups that will be convened in fall 2013 and spring 2014.

  32. Distinction Designations for 2014 and Beyond • New Academic Achievement Distinction Designations (AADD) Indicators in Reading/ELA and Mathematics • Grade 10 (PSAT and PLAN) and Grade 11 (PSAT) Participation.A student in grade 10 or 11 can take these measurements of college readiness. The PSAT consists of three sections that assess a number of academic skill sets: critical reading, mathematics, and writing. PLAN includes four multiple-choice tests: English, math, reading, and science. • PSAT Grade 10 and Grade 11 Performance Indicators: ELA and Mathematics.These measures of college readiness are typically taken by students in grades 10 and 11. Consists of three sections that assess a number of academic skill sets: critical reading, mathematics, and writing. • PLAN Grade 10 Performance Indicators: English and Mathematics.This is a measurement of college readiness typically taken by students in grades 10 and 11. A PLAN Performance indicator will be evaluated for both English and mathematics.

  33. Legislative Changes During the 83rd legislative session, the following bills will affect the 2014 accountability system and beyond. These legislative changes will be reviewed by accountability advisory groups in fall 2013 to develop recommendations to the commissioner for implementation. See Chapter 13 of the 2013 Accountability Manual for details. http://ritter.tea.state.tx.us/perfreport/account/2013/manual/index.html

  34. House Bill (HB) 5 Changes • House Bill 5 Accountability Provisions • Expands the postsecondary readiness indicators evaluated for state accountability to include Texas Success Initiative (TSI) college readiness benchmarks and the number of students who earn postsecondary credit required for the foundation high school program, an associate’s degree, or an industry certification. • Beginning in the 2016-17 school year, requires TEA to assign ratings of • A, B, C, D, or F to districts, and ratings of exemplary, recognized, acceptable, or unacceptable to campuses.

  35. House Bill (HB) 5 Changes House Bill 5 - Community and Student Engagement • Beginning with the 2013-14 school year, districts will be required to evaluate community and student engagement compliance for the district and each of their campuses and assign a rating. The ratings are required to be reported to TEA by August 8, 2014. • The statute requires that districts assign a performance rating of exemplary, recognized, acceptable, or unacceptable based on locally-determined criteria. These performance ratings must be based on criteria developed by a local committee. Statute does not permit the Agency to determine the criteria that can be used for these evaluations. • TEA is required to develop a data collection system that allows districts to submit their locally-determined performance ratings in nine possible categories for each campus in the district. TEA is also required to report these ratings publicly by October 1, 2014.

  36. Other Legislative Changes • Senate Bill 1538 • TEC §39.0545 is added to require the evaluation of dropout recovery schools that are defined as: • serves students in grades 9-12; • has enrollment of which at least 50 percent of the students are 17 years of age or older as of September 1 of the school year; and • meets the eligibility requirements for and is registered under alternative education accountability procedures adopted by the commissioner. • Further modifications to the applicable indexes will be reviewed with the accountability advisory groups in fall 2013 to ensure all of the requirements of Senate Bill 1538 are met.

  37. Calendar

  38. Resources • 2013 Accountability Manualhttp://ritter.tea.state.tx.us/perfreport/account/2013/index.html • Frequently Asked Questionshttp://ritter.tea.state.tx.us/perfreport/account/2013/faq.html • STAAR Progress Measure Documentshttp://www.tea.state.tx.us/student.assessment/staar/ • Performance Reporting Home Pagehttp://www.tea.state.tx.us/perfreport

More Related