1 / 15

Value-Added Systems

Value-Added Systems. Dr. Robert H. Meyer Research Professor and Director Value-Added Research Center University of Wisconsin-Madison April 15, 2011. Value-Added Model Definition.

greg
Download Presentation

Value-Added Systems

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Value-Added Systems Dr. Robert H. Meyer Research Professor and Director Value-Added Research Center University of Wisconsin-Madison April 15, 2011

  2. Value-Added Model Definition • A value-added model (VAM) is a quasi-experimental statistical model that yields estimates of the contribution of schools, classrooms, teachers, or other educational units to student achievement, controlling for non-school sources of student achievement growth, including prior student achievement and student and family characteristics. • A VAM produces estimates of productivity under the counterfactual assumption that all schools serve the same group of students. This facilitates apples-to-apples school comparisons rather than apples-to-oranges comparisons. • The objective is to facilitate valid and fair comparisons of productivity with respect to student outcomes, given that schools may serve very different student populations.

  3. A More Transparent (and Useful) Definition of VA • Value-added productivity is the difference between actual student achievement and predicted student achievement. • Or, value-added productivity is the difference between actual student achievement and the average achievement of a comparable group of students (where comparability is defined by a set of characteristics such a prior achievement, poverty and ELL status).

  4. VARC Philosophy • Development and implementation of a value-added system should be structured as a continuous improvement process that allows for full participation of stakeholders • Model Co-Build; Complete customization • Analysis • Reporting • Value–added is one tool in a toolbox with multiple indicators

  5. VARC Value-Added Partners • Design of Wisconsin State Value-Added System (1989) • Minneapolis (1992) • Milwaukee (1996) • Madison (2008) • Wisconsin Value-Added System (2009) • Milwaukee Area Public and Private Schools (2009) • Racine (2009) • Chicago (2006) • Department of Education: Teacher Incentive Fund (TIF) (2006 and 2010) • New York City (2009) • Minnesota, North Dakota & South Dakota: Teacher Education Institutions and Districts (2009) • Illinois (2010) • Hillsborough County , FL (2010) • Broward County, FL (2010) • Atlanta (2010) • Los Angeles (2010) • Tulsa (2010)

  6. Districts and States working with VARC Minneapolis Milwaukee Madison Racine Chicago New York City Los Angeles Tulsa Atlanta Hillsborough County Broward County

  7. Measuring knowledge • Many factors influence what a student learns and how their knowledge is measured • A variety of measures, including (but not limited to) assessments, tell us what a student knows at a point in time. • What are some ways we measure knowledge?

  8. Measuring knowledge End-of-course Exam Diagnostic Test MAP WKCE Daily Journal Unit Project After-school Activities Hands-on Project

  9. The Simple Logic of Value-Added Analysis • School Value-Added Report • School specific data • Grade level value-added • Comparison Value-Added Reports • Compare a school to other schools in the district, CESA, or state • Also allows for grade level comparisons • Tabular Data available for School Report and Comparison Reports

  10. Attainment and Value-Added

  11. How complex should a value-added model be? • Rule: "Simpler is better, unless it is wrong.“ • Implies need for “quality of indicator/ quality of model” diagnostics.

  12. Model Features • Demographics • Posttest on pretest link • Measurement error • Student mobility: dose model • Classroom vs. teacher: unit vs. agent • Differential effects • Selection bias mitigation: longitudinal data • Test property analysis

  13. Visit the VARC Website http://varc.wceruw.org/ for more information about VARC and value-added

More Related