180 likes | 293 Views
AYP for Schools: Consequences of State Accountability Design Decisions. Robert L. Linn Center for Research on Evaluation, Standards, and Student Testing University of Colorado at Boulder. CRESST Conference, UCLA September 8, 2005. Adequate Yearly Progress (AYP).
E N D
AYP for Schools: Consequences of State Accountability Design Decisions Robert L. Linn Center for Research on Evaluation, Standards, and Student Testing University of Colorado at Boulder CRESST Conference, UCLA September 8, 2005
Adequate Yearly Progress (AYP) • Central to the Accountability System of the No Child Left Behind (NCLB) Act of 2001 • States required to define AYP for the state, school districts, and schools in a way that enables all children to meet the state’s student achievement standards by 2014
State Variation in Percentage of Schools Meeting AYP vs. Variation in Performance on NAEP • Variation in percentage of schools meeting AYP is extremely large and makes little sense in comparison to variation of performance on NAEP
Many Reasons for State-to-State Variability in Percentage of Schools Missing AYP Targets • Definition of proficient level of achievement • State demographics—Influence on number of subgroups in schools with sufficient n for reporting • Number of grades tested—More grades, more use of disaggregated results • Trajectory selected to go from starting point to 100% proficient in 2013-2014 • Minimum n used for disaggregated reporting • Whether or not the state uses confidence intervals
Porter, Linn, & Trimble Focus on Three State Design Decisions • Trajectory to go from starting point to 100% proficient • Minimum n for disaggregated reporting • Use of confidence intervals
Trajectories • Straight line • Straight line with plateaus • Back-loaded
Number of KY Schools that Would Have Failed Various Numbers of AYP Goals in 2003 as a Function of Design
Number of KY Schools that Would Have Failed Various Numbers of AYP Goals in 2004 as a Function of Design
Number of Kentucky Schools that Would Have Met AYP RequirementsGiven Various Design Decisions
Conclusions • State design decisions have a major influence on the likelihood that a school will meet AYP requirements • State variation in percentage of schools making AYP is influenced by state design decisions