1 / 15

Are there really good schools?: The role of changing demographics within schools

Are there really good schools?: The role of changing demographics within schools. Pete Goldschmidt & Motoaiki Hara CRESST Conference 2004 University of California, Los Angeles. Are there really good schools = are there excellent schools? or

alder
Download Presentation

Are there really good schools?: The role of changing demographics within schools

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Are there really good schools?: The role of changing demographics within schools Pete Goldschmidt & Motoaiki Hara CRESST Conference 2004University of California, Los Angeles

  2. Are there really good schools = are there excellent schools? or = are there any good school or are there simply good students grouped together? There is a long history of disentangling this question. e.g. effective schools research Coleman Report Educational Production functions Value Added models

  3. Data: - Large urban school district - 300,000 students (20% sample) - 510 elementary schools - 10 years of observations o     4 years per student - Panel and cohort dataset. -        State NRT assessment o     Mathematics and Reading - Census data by zip code.

  4. Are school means (singular or over time) appropriate indicators of quality?-        do not adjust for inputs.-        artificially attribute all of the variation in student scores to schools.-        Assume equally precise measures of school performance.-        Potential ecological fallacy.-        Potential confounding factors.

  5. Means over time may or may not be correlated. -   If correlated – indicates that schools with high scores one year have high scores the next, but does not address whether schools or students are good. if uncorrelated – indicates that mean performance is inconsistent, but does not address whether this is due to changing school quality or changing student composition.

  6. Value Added Model: Value added estimates preferable to means because they attempt to account for potential confounding factors. Using annual measure of school performance we can correlate annual value added estimates. May or may not be correlated.

  7. Value Added con’t After accounting for student background, school performance much less consistent. Does this indicate that good students, not good schools are identified under current year by year analyses?

  8. School Performance\Quality: Given that school performance is related to student background and that there is a concern about the ramifications to “disadvantaged” schools, what is the role of school context? Common value added modeling approach is some form of longitudinal model from which value added estimates are derived.  Value added estimate of interest is often for growth (i.e difference between actual and expected growth).  Effect of school context in growth model estimates the extent to which school context mediates growth. That is, achievement growth might be higher in schools with high average SES than in schools with low average SES.

  9. This is a static view of the role of school context and only addresses between school differences in context. Two Questions:  1)   1) At what time point should school context be measured in a growth model?  2) What is the effect of changing demographics within a school?   Dilemma: Want to examine effect of changing school context on changing achievement. That is, want to use school demographics as a time varying covariate – but can’t simply add to the between occasion, within-student, part of the growth model because it mixes units within a level.

  10. Solution - Use a doubly time nested design. -Two approaches to analyze. oMeasurement within time oTwo stage model. Two Stage model: Stage 1- cross-sectional Value added model for each year. VA for each school for each year is net of student characteristics. Stage 2- longitudinal model using VA estimates nested within schools. Each school has (approximately) 10 observations.

  11. Preliminary Results -Expect mean to be 0. -Expect mean growth to be 0. -What are the effects over time of school context? oGenerally none. §Preliminary results indicate that school performance is relatively invariant to changes in school context. -Community context effects? oSmall §Preliminary results indicate that school performance is relatively invariant to changes in community context.

  12. After accounting for student characteristics, school context effects between schools is generally small. Similarly, after accounting for student characteristics, changes in school context have relatively minor effects on changes on school performance. If changing school enrollment characteristics have relatively little influence on performance, then likely that changing school structure, policies, and practice may account for low correlations between yearly performance estimates.

  13. The broad issue we address here is whether there really are good schools – that is, they remain top performers based on value added results over a ten year period, or whether top performance is fleeting and more closely linked to the cohort(s) that happen to be passing through the system at a particular time. The results from these queries begin to address the likelihood that schools not meeting AYP will be able to do so at some point in time despite “unfavorable” demographic circumstances.

More Related