120 likes | 129 Views
This informational presentation summarizes the alignment study conducted by ACS Ventures for the Wisconsin Department of Public Instruction on the ACT assessment. The study compares the alignment of test items to the academic standards in Wisconsin and Nevada. The presentation provides an overview of the alignment percentages for English Language Arts and Mathematics, as well as alignment to specific instructional domains.
E N D
Office of Assessment, Data, and Accountability Management (ADAM) Summarizing an alignment study by ACS Ventures, LLC for Wisconsin Department of Public Instruction The act in NevadaINFORMATIONAL PRESENTATION to the Academic Standards council
The ACT in Nevada • College and Career Ready Assessment adopted by Assembly Bill 288 of the 2013 Legislative Session • Enacted by NRS 390.610 • NRS 390.610 State Board to select college and career readiness assessment for grade 11; requirement of pupil to take assessment; results not used for receipt of standard high school diploma; use of results to provide data and information for pupil; adoption of regulations prescribing manner in which results must be used to inform instruction to pupils in grade 12. • Assembly Bill 7 of the 2017 Legislative Session • Made the ACT the Federally report High School exam for Mathematics and English Language Arts (ELA)
ACT: A Proprietary Assessment • ACT assessment content is confidential– ACT does not share content/test questions with Nevada • October 2017 – ACT provided access to ACS Ventures to perform an alignment study to the Wisconsin Academic Standards (WAS) for Federal Peer Review • Wisconsin shares the same set of Mathematics and ELA standards as Nevada
ACS Alignment Study Methodology • Panelists were instructed to only indicate an item was aligned if the Knowledge, Skills, Abilities (KSAs), included within a(WAS) standard, were required to answer to the item correctly. • The panel completed the alignment process for the first of three test forms by making independent judgments and then coming to consensus on all ratings. Figure 1. Summary of Panelist Expertise & Experience
The NVACS and ACT College and Career Ready Standards (CCRS)are unique structures
Study Overview: ACT / NVACS • English Language Arts • All test items can be aligned to standards • 50% of standards were observed in test items • Mathematics: • 56% of items can be aligned to High School standards • 44% of items can be aligned to Middle School standards • 78% of standards were observed in test items • All domains but Modeling are at least partially observed in test items
ACT / NVACS: English Language Arts • Alignment to Instructional Domains • Reading: 80% • Writing Ideas & Content: 70% • Writing Linguistic Production: 67% • Speaking & Listening: not on the ACT
Percent of ACT Reading items aligned to each Reading Standard and Domain
ACT English items and Writing scoring elements aligned to each Language/Writing Standard
ACT / NVACS: Mathematics • Alignment to Instructional Domains • Number & Quantity: 67% • Algebra: 100% • Functions: 90% • Modeling: not on the ACT • Geometry: 67% • Statistics & Probability: 67% • Mathematical Practices: 0% to 50% dependent on Category and Score Range
References Becker, S., Wiley, A., (2017) Alignment of the ACT to the Wisconsin Academic Standards in ELA and Mathematics Final Report. ACS Ventures