170 likes | 182 Views
Annual Assessment and Accountability Meeting Updates. August 29, 2018. Susie Lee Bureau of K-12 Student Assessment. Paper-Based Transition. In Spring 2019, the following tests are paper-based only: Grades 4–6 ELA Writing Grades 3–6 ELA Reading and Mathematics Grades 5 & 8 Science
E N D
Annual Assessment and Accountability Meeting Updates August 29, 2018 Susie Lee Bureau of K-12 Student Assessment
Paper-Based Transition • In Spring 2019, the following tests are paper-based only: • Grades 4–6 ELA Writing • Grades 3–6 ELA Reading and Mathematics • Grades 5 & 8 Science • Combined Test and Answer Book for ELA/M • Separate Test Book and Answer Book for Science • Grade 7 ELA Writing moves online
Paper-Based Transition for Grades 3–6 Remember when…
Paper-Based Transition for Grades 3–6 • Daily Session Schedule • Multiple grade levels can be administered on the same day • Providing a daily schedule • Same protocol as in the past • Allows for a more secure, standardized administration • All districts/schools must adhere to the PBT guidance • Any deviation must be requested, in writing, and describe a specific hardship or need (not preference) that requires flexibility.
Spring 2016 • March 28–April 8: Grade 3 R, Grades 3 & 4 M (3 tests) • ~ 600,000 books • June 10 – Results reported • 9 weeks (PBT) • 5 weeks (CBT) • Spring 2019 • May 1–14 – Grades 4–6 R; Grades 3–6 M (7 tests) • ~ 1,400,000 books • June 30 – Reporting requirement • 6 ½ weeks (PBT) • 4 ½ weeks (CBT) • +~800,000 books; - 3 weeks • Proper packaging, labeling, and returning on time
Paper-Based Transition for Grades 3–6 • School Staff • Security and Forms • Locked Storage • PreID Labels • Books with no labels will not be processed • Packaging and Returns • Shipping from schools • Students • Item types • Test Item Specifications and Practice Tests will be updated this fall • New Practice Resources
Calibration • Calibration school selection is a scientific process that creates a sample that is representative of the entire state. • This includes demographics and a range of performance • School cooperation • is crucial to complete the calibration analyses in a timely fashion for scoring and reporting. • contributes towards Florida having valid and reliable assessments and results.
Calibration • Calibration schools receive special materials that contain “anchor sets” – these item sets are scored and evaluated statistically to set scoring parameters for the test. • An anchor set is a “mini-test” that models the item parameters of the entire test. They also “anchor” the test to previous years to ensure that item parameters are the same or extremely similar from year to year.
Calibration • Once tests for calibration schools are processed, psychometric teams from FDOE, our contractors, and a third, independent party evaluate the results. • Then, post-equating is used to place IRT-processed scores on the assessment scales and to ensure that the resulting scores are comparable to those of previous years.
Calibration • Making scores comparable allows comparisons between, for example, the achievement of grade 6 students in 2017 and the achievement of Grade 6 students in 2018. • Each assessment is designed to be of similar difficulty each year; however, slight differences in test difficulty (the content of the test items) may influence student scores. Without equating, it would be difficult to determine whether differences in scores between years are the result of these slight differences in the test difficulty or differences in students’ true levels of knowledge and skill.
Calibration • Grades 3–5 ELA/Mathematics • Entire school selected • Materials return with striped labels • Grades 6–10 ELA/Mathematics • One subject/grade level test per school • Grade 6 – materials return with striped labels • Grades 7–10 – test during week one
Statewide Assessment Program Guide “The Statewide Assessment Program Guide is a very useful document all in one place. We shared this document with district and school staff. It helps explain the details of the FSA to parents especially confusion over how the Writing component is included in the ELA test. We love this comprehensive document.” – Richard Baum, Director Student Assessment and Research Broward County Schools
Statewide Assessment Program Guide • Test Content • Development • Administration • Scoring and Equating • Reporting • Resources • History and Uses
Uniform Assessment Calendars • Complete 2018-19, post on district website, and send link to the department by October 1, 2018. • 2018-19 and 2019-20 templates are available on the FDOE website: http://www.fldoe.org/accountability/assessments/k-12-student-assessment/assessment-schedules.stml • Contact Catherine Altmaier with any questions.
NAEP • Spring 2017 Results • Spring 2019 • State-Level Year for Grades 4 and 8 Reading and Mathematics • NAEP Participation • Communication • Incentives • Results