180 likes | 350 Views
The Smarter Balanced Assessment System. Joe Willhoft, Ph.D. Executive Director. NCES Summer Forum on Education Statistics Washington, DC July 10,2012. A Next Generation of Assessments.
E N D
The Smarter BalancedAssessment System Joe Willhoft, Ph.D. Executive Director NCES Summer Forum on Education Statistics Washington, DC July 10,2012
A Next Generation of Assessments US Dept. of Ed has funded two consortia of states with development grants for new assessments aligned to Common Core State Standards (Federal Register / Vol. 75, No. 68 / Friday, April 9, 2010 pp. 18171-85) • Rigorous assessment of progress toward “college and career readiness” • Common cut scores across all Consortium states • Provide both achievement and growth information • Valid, reliable, and fair for all students, except those with “significant cognitive disabilities” • Administered online • Use multiple measures • Operational in 2014-15 school year
A National Consortium of States 27 states representing 43% of K-12 students 22 governing, 5 advisory states Washington state is fiscal agent WestEd provides project management services
A Balanced Assessment System Summative assessments Benchmarked to college and career readiness Teachers and schools have information and tools they need to improve teaching and learning Common Core State Standards specify K-12 expectations for college and career readiness All students leave high school college and career ready Interim assessments Flexible, open, used for actionable feedback Teacher resources for formative assessment practices to improve instruction
Computer Adaptive Testing (CAT) Portion Setting Performance Standards (Cut Scores) • Built on solid technology • Coverage of full breadth/depth of Common Core • Precise assessment of all students • K-12, higher ed, business, and policymakers part of decision-making • Broad review of “Achievement Level Descriptors” • Field testing includes PISA, TIMSS, NAEP items • Longitudinal data systems used for triangulation ✔ Summative Assessments for Accountability Performance Task (PT) Portion • Deeper learning with thematic and scenario-based tasks • Real-world problems aligned to Common Core • PT scores combined with CAT for overall score
Flexible Authentic Measures • Includes full range of item types • Uses the same scale as the Summative Assessment • Includes performance assessments • Non-Secure • Timing and frequency are locally determined • Interim test-builder creates aligned assessments Interim Assessmentsto Signal Improvement Supports Proficiency Based Instruction • Teachers can match assessments with scope and sequence • Teachers can review student responses • Teachers can score student responses ✔
Faster results • Turnaround time is significantly reduced ✔ Summative and Interim Use ofComputer Adaptive Technology Shorter test length • Fewer questions compared to fixed form tests ✔ Increased precision • Improved measures of student growth over time Tailored to student ability • Item difficulty based on student responses Greater security • Large item pool means not all students receive the same questions Mature technology • GMAT, GRE, COMPASS (ACT), Measures of Academic Progress (MAP)
Improving Instruction • Tools/materials for Classroom-based Assessments • Fully aligned to Common Core State Standards • Available for in-service and pre-service development Formative Tools for Classroom- Based Assessment Practices Pooling Resources • Access to the best resources available • Collaborate with other states on special projects • Professional social networking across the Consortium • Tools to evaluate publishers’ tests ✔
A Balanced Assessment System English Language Arts and Mathematics, Grades 3-8 and High School School Year Last 12 weeks of the year* DIGITAL CLEARINGHOUSE of formative tools, processes and exemplars; released items and tasks; model curriculum units; educator training; professional development tools and resources; scorer training modules; and teacher collaboration tools. • ELA/Literacy • Computer adaptive items and tasks • Performance events • Mathematics • Computer adaptive items and tasks • Performance events Optional Interim Assessment Optional Interim Assessment Computer Adaptive Assessment and Performance Tasks Computer Adaptive Assessment and Performance Tasks Re-take option Scope, sequence, number and timing of interim assessments locally determined *Time windows may be adjusted based on results from the research agenda and final implementation decisions.
IT Readiness Smarter Balanced and PARCC partnered to develop an IT Readiness Tool for states and districts First data collection completed June 30 Analysis of first collection available in August Second data collection in Fall 2012 Coordinated through each state’s State Readiness Coordinator (SRC)
Logical Component DiagramSystem Architecture – Phase 1 Reportwww.smarterbalanced.org/smarter-balanced-assessments/technology/
Smarter Balanced Architecture Reports www.smarterbalanced.org/smarter-balanced-assessments/technology/ Assessment System Architecture and Technology Phase I Report Enterprise Architecture Governance Plan Draft Smarter Balanced Quality Assurance Approach Instructions for iPad Installation of the Smarter Balanced Architecture Application Jan. 23 Webinar
Architecture Review Board Oversees ongoing development of IT systems architecture and recommends technology standards to the Consortium XiaobingHou Central Connecticut University Josh Klein Oregon Department of Education Rodney Okamoto California Department of Education Brenda Williams West Virginia Department of Education David Wu Hawaii Department of Education Jason Young Missouri Department of Elementary and Secondary Education Karl Buchanan Wasatch School District, UT Bonnie Edwards Chancellors Office, California Community Colleges Phil Emer North Carolina State University John Fleischman Sacramento County Office of Education Glenn Gorton Michigan Department of Education Richard Halverson University of Wisconsin, Madison Martin Horejsi University of Montana
Major Milestones All-Call for Pilot Testing Interim & Formative Available for Use All-Call for Field Testing State Educator Teams Begin Item/Task Writing Begins Set Performance Standards (Cut Scores) Operational Summative Assessment Verify Performance Standards IT Readiness (Round 1) IT Readiness (Round 2) IT Readiness (Round 3) Cognitive Labs & Field Trials Pilot of 10,000 Items/Tasks Field Test 37,000 Items/Tasks
Find Out More Find us at:SmarterBalanced.org