130 likes | 236 Views
The Implementer's Guide to Growth A CCSSO/ASR-SCASS Publication AERA Symposium New York - March 25, 2008 Presented by Bill Auty - Education Measurement Consulting. Growth Models in School Accountability. ASR Project. Council of Chief State School Officers
E N D
The Implementer's Guide to Growth A CCSSO/ASR-SCASS Publication AERA Symposium New York - March 25, 2008 Presented by Bill Auty - Education Measurement Consulting Growth ModelsinSchool Accountability
ASR Project • Council of Chief State School Officers • State Collaborative on Assessment and Student Standards • Accountability Systems & Reporting • 28 State Education Agency Members • Follows publication of The Policymakers Guide to Growth Models for School Accountability
Purpose • The Value Of Setting Purposes In Advance • There are a Wide Variety of Growth Models • Different Models serve Different Purposes • Technical Issues can be Informed by Purpose
Definitions • Model Types • Status • Improvement • Growth • Value-Added • Transition Matrix
Definitions • Growth Methods • Improvement • Difference Gain Scores • Residual Gain Scores • Linear Equating • Transition Matrix • Multi-Level
Characteristics of Growth Models • Data Requirements • Database of matched student records over time • Requires common scale • Psychometric Issues • Confidence Interval • Includes students with missing scores • Includes Results From Alternate Tests • Growth Question Answered • Student Performance Standards Explicitly Included in Definition of Growth • Handles non-linear growth
Meeting NCLB Requirements • Based on Policy and Practice as of Early 2008 • USED Guidance • Peer Reviewer Comments • Analysis of Approved Pilot Programs
Reporting Growth • Although Including Growth Adds Complexity, Guiding Principles Apply: • Accuracy • Clarity • Transparency • Brevity • User-Friendliness • Comprehensibility • Completeness • Self-Sufficiency
Growth Models In Action • Examples: • Delaware • Florida • Hawaii • Michigan • Oregon
Technical Notes • Use of Multiple Measures • Confidence Intervals • Expected Growth • Reliability • Software • Growth Metrics • Units of Time
Conclusions • Document Covers Current State of Art • Technical Expertise Under Development • Many More Options Outside NCLB Approval • Develop Outside of High-Stakes Environment • Get The Data Out – There Will Be Surprises
Resources • The IGG is available online from CCSSO • http://www.ccsso.org/publications/details.cfm?PublicationID=360 • Join ASR • Contact Bill Auty • bill@edmeasure.com