1 / 22

American Educational Research Association Annual Meeting March, 2008

Using Growth Models to Monitor School Performance Over Time: Comparing NCE, Scale and Scores on NRTs and SBTs. Pete Goldschmidt, Kilchan Choi, Felipe Martinez, and John Novak. American Educational Research Association Annual Meeting March, 2008. Introduction.

cliff
Download Presentation

American Educational Research Association Annual Meeting March, 2008

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Using Growth Models to Monitor School Performance Over Time: Comparing NCE, Scale and Scores on NRTs and SBTs Pete Goldschmidt, Kilchan Choi, Felipe Martinez, and John Novak American Educational Research AssociationAnnual Meeting March, 2008

  2. Introduction Using Growth Model Value Added estimates, do inferences about school change Examine the role of the metric NCE vs Scale Scores on a Vertically equated assessment. Examine the role of switching Assessment type NRT vs SBT

  3. 4 Summary Parameter Estimates Compared Estimated Initial Status Residual Initial Status Estimated Growth Value Added

  4. 5 Summary of Estimates Compared Using Rank Order Correlations Also compare school ranks based on the residual Initial Status and Value Added estimates

  5. 6 Summary of Results Describing SAT-9 Reading Achievement

  6. 8 Correlations Between Value added estimates for NRT for models without student covariates

  7. 9 Correlations Between Value added estimates for NRT for models with student covariates

  8. 13 Comparison of Relative Bias to the Effect Size of Growth

  9. Mathematics

  10. School context and inferences While individual student characteristics’ impact differ depending on assessment used (though not metric) -particularly for growth, School enrollment characteristics have virtually no impact inferences between NRT and SBT.

  11. Mathematics

  12. Reading

  13. Mathematics

  14. Relationship between missing scores and school performance

  15. Relationship between missing scores and school performance

  16. Summary – the scale Using a relative scale for monitoring individual achievement growth when the assessment is vertically equated – significantly under-estimates growth. Using a relative scale for monitoring school performance based on growth when the assessment is vertically equated – yield very consistent results to using an absolute scale. No patterns as to where deviations may occur.

  17. Summary – the assessment Individual results between NRT and CST highly correlated in each year. Individual student characteristics affect relative performance Attempting to become more egalitarian? School results fairly consistent in Mathematics, but not in Language Arts School characteristics have virtually no impact on changes in inferences or rankings of schools.

  18. Summary – the method Means highly correlated with student background Means inversely correlated to misingness VA added estimates based on individual growth substantively less related to student background VA added estimates based on individual growth substantively less related to missingness

More Related