390 likes | 584 Views
January 2011 Phillip Adam – Coordinator for Assessment Park Hill School District. The growth of value-added models in park hill. Presentation Outline. What is Growth Data? Park Hill’s growth history Benefits of growth/VA models Challenges and considerations. Park Hill’s Growth History.
E N D
January 2011 Phillip Adam – Coordinator for Assessment Park Hill School District The growth of value-added models in park hill
Presentation Outline • What is Growth Data? • Park Hill’s growth history • Benefits of growth/VA models • Challenges and considerations Park Hill’s Growth History
What is Growth Data? • Questions that Growth Data can answer • Purposes for calculating & reporting growth data at the following levels: • Student • Teacher • Classroom • Building • District • State Park Hill’s Growth History Are the students in this classroom/building/district showing adequate growth? How does my child’s growth compare to the typical child’s growth? Is an intervention/ program working?
Park Hill’s Philosophy • Use better data than we did last year to make better decisions than we did last year • Better decisions means better programs and processes for students Park Hill’s Growth History
Making Inferences • We have been making data-based judgments and decisions for decades. • Is this program working? • Which school has the best learning? • Which grade level creates the most student achievement? • Which schools or classrooms need an instructional makeover? • What are our opportunities for improvement? • Our questions haven’t changed much, but the quality of the answers has. Park Hill’s Growth History
Making Inferences • The method of analysis must match the intended inference. Park Hill’s Growth History
Status & Improvement • Starting in the early 1990s • ITBS • SAT-9 • MMAT • MAP Park Hill’s Growth History
Status & Improvement 6th grade did the best 2nd grade needs to improve SAT-9 NCEs Park Hill’s Growth History What does this really tell us?
Status & Improvement 4th grade did the best 3rd grade needs to improve SAT-9 NCEs Park Hill’s Growth History +0.0 -0.8 +1.1 +0.5 +0.7 +1.0 -0.1 What does this really tell us?
Cohorts are different… SAT-9 NCEs Park Hill’s Growth History We need to control for students’ histories!
Cohort Improvement • Started in 2002 • Stanford-9 NCEs • EXPLORE to PLAN • PLAN to ACT • The case of AYP Park Hill’s Growth History
Cohort Improvement 3th grade did the best 7th grade needs to improve SAT-9 NCEs Park Hill’s Growth History +6.0 +0.7 +4.9 +0.8 -2.3 -0.2
Cohort Improvement • Expanded in 2006 • MAP Terra Nova Percentiles • SAT-10 NCEs • Combined across multiple measures • Expanded further in 2009 • Terra Nova Percentiles Grades 1 – 5 • STAR – Reading and Math Percentiles Park Hill’s Growth History
Growth by Grade Span Intermediate Primary Middle High School
Growth Percentiles • Started in 2008 • Now using regression-based model with matched data • Produced by OSEDA • Growth per student Park Hill’s Growth History
Growth Percentiles Park Hill’s Growth History
Growth Percentiles • Used for: • Program evaluation • Subgroup analysis Park Hill’s Growth History
EVAAS (Educational Value-Added Assessment System) • Started in 2009 Park Hill’s Growth History
What’s the Difference?Growth vs. Value Added Park Hill’s Growth History +3.6
What’s the Difference?Growth vs. Value Added 75th Percentile Park Hill’s Growth History
What is Value-Added? Park Hill’s Growth History
What’s the Difference?Growth vs. Value Added Park Hill’s Growth History
EVAAS • Used for: • Evaluating school effectiveness • Evaluating teacher effectiveness • Evaluating program effectiveness Park Hill’s Growth History
Benefits of Growth/VA Models • More accurate data • More accurate inferences • Better decisions • Cultural shift toward growth/value added • Challenges traditional beliefs about effectiveness • Good school/bad school • Achievement gap Benefits of Growth/VA
Challenges and Considerations • Missing data • Teacher-student association accuracy • Complexity of the regression methodology • Traditions/upsetting longstanding beliefs • It is a more complete picture of what is happening inside the Black Box. Benefits of Growth/VA
Phillip Adam – Coordinator for Assessment Park Hill School District (816) 359-5508 adamp@parkhill.k12.mo.us The growth of value-added models in park hill