360 likes | 479 Views
Iowa Assessment Update. School Administrators of Iowa November 2013 Catherine Welch Iowa Testing Programs. Past -- Emphasis. Present – Forms E and F. Guided by mandate to be linked to previous forms for accountability reporting (A, B, E, F) Guided by desire to inform instruction
E N D
Iowa Assessment Update School Administrators of Iowa November 2013 Catherine Welch Iowa Testing Programs
Present – Forms E and F • Guided by mandate to be linked to previous forms for accountability reporting (A, B, E, F) • Guided by desire to inform instruction • Emphasis on level of information in reporting structure • Emphasis on reliable reporting • Guided by the quality of the information provided to users • Emphasis on measuring growth • Emphasis on college and career readiness
Forms E and F– Test Similarities Balance of Concepts, Applications and Procedures Range of Cognitive Demands Aligned to Common Core Domains Connects Practice to Content
Forms E and F– Technical Similarities Vertical Scale to Measure Growth Allows Direct Comparisons to Previous Forms Parallel Forms allow the Tracking of Students Addresses NCLB Requirements Valid, Reliable and Technically Sound
Current Results • State Performance • Growth • Use of Information
Considerations for Moving Forward • Evaluate Purpose of Assessments • Evaluate Products to Match Purpose • Make Appropriate Comparisons • Define Criteria for Evaluation from House File 215 • aligned with the Iowa common core standards in both content and rigor; • accurately describes student achievement and growth for purposes of the school, the school district, and state accountability systems; and • provides valid, reliable, and fair measures of student progress toward college or career readiness
Evaluate Purpose • Accountability • Administrator • Teacher • Student • Summative • Formative • Interim
Evaluate Products and Reports to Match Purpose • Review the items and tests • Review the score reports • If adaptive, review the algorithms for adaptive testing • For example, understand how high-level 4rd graders will be tested and the implications for alignment • Understand how low-level 8th graders will be tested and the implications for comparisons across students • If fixed form, review the implications for the balance and selection of content • Compare level of reporting to requirements
Define Criteria for Evaluation • Aligned • Reliable • Valid • Growth • Readiness • Technology • Costs • How much is enough? • Who are the experts to evaluate these criteria? • What are the compromises to be made? • How are these compromises tied to purpose?
Alignment? • “Aligned” by 15 trained experts • “Aligned” to 11 different standards • “Aligned” to 4 different grade levels • “Aligned” to 3 different domains
Alignment? • “Aligned” by 7trained experts • “Aligned” to 6different standards • “Aligned” to 3 different grade levels • “Aligned” to 3different domains
Define Criteria for Use • What are the metrics to be reported? • Are they understood by parents? • Will teachers have enough information from the results to shape their instruction? • Will teachers receive the responses from the open-ended, constructed-response items? • Will teachers receive professional development on the usefulness of the results?
Define Criteria for Technology • Identify the vendor that will deliver the assessment • Pilot test the types of items to be used • Pilot test in a variety of districts in the spring of the year during the same 12-week window; during the busiest times of the day • Pilot test using the vendor-developed online tools • Pilot test using the graphics, videos, that will be a part of the assessment
Define Criteria for Administration • Demand same time-of-year testing • Demand reports/information prior to the end of the year • Demand reports that show growth, readiness, achievement indicators and instructional-relevance