New MATH ISAT and the Illinois Assessment Framework September 2005

1. New MATH ISAT and the Illinois Assessment FrameworkSeptember 2005 Joan Barrett Madison County ROE jbarrett@roe41.k12.il.us

2. New Contractor-Harcourt Educational Measurement • Responsible for test development, printing, scoring, and reporting • Stanford 10 format with color • Aligned to Illinois Assessment Framework (IAF)

3. 2006 Mathematics ISAT • All test items on the 2006 ISAT align to the Illinois Mathematics Assessment Framework • Norm-referenced Stanford 10 items • Same items taken in other states for national comparison • Criterion-referenced items • Illinois-developed and used only in Illinois • All items contribute to the overall ISAT scale score.

4. Reporting • Strengths and weaknesses listed for schools • Student results for parents with more information- more detailed reporting that is tied to the IAF • More data information than previous ISAT • Performance levels remain the same (Exceeds, Meets, Below, Academic Warning) • Test results: Online by June 1, 2006

5. Grades and Subjects to be tested March 13-24th, 2006

6. The ISAT mathematics will be administered in three sessions and applies to all grades 3-8. *Extended time: up to an additional ten minutes for each session

7. Item Formats • Multiple–choice (MC) items – 70 items (5 pilot) • Short constructed–response (SCR) items are similar to multiple-choice items but require the student to write a response, as opposed to select from a list of possibilities - 3 items (1 pilot) • Extended–response (ER) items- Students are expected to clearly communicate through writing, pictures, diagrams, or well–ordered steps) their solution process - 2 items (1 pilot)

8. How to Create or Find Samples of Short Constructed Response Items • Use old MC items and remove the choices • Go to http://nces.ed.gov/nationsreportcard/ • Select “mathematics” from the subject area list on the left hand side of the page • Scroll down to How the NAEP Mathematics Assessment Works and select the third bullet that says “Explore sample questions..”

9. How to find Samples of Short Constructed Response (cont.) • Then click on the blue bar at the top left that says “new search” • Then scroll down on this new page to Advanced Search and use the drop down to select “mathematics” from the select a subject bar. • Hit “continue”

11. Sample SCR item for 4th grade

12. Sample SCR for 8th Grade

14. Short and Extended Response • Short-response items and Extended-response items are scored using a rubric. • Item-specific rubrics are developed for each item before scoring. • The 2 short-response items will contribute 5% to the scale score. • The 1 extended-response item will contribute 10% to the scale score.

15. Short Constructed Response Rubric Note: Task-specific rubrics are developed for each item before scoring. Completely correct response, including correct work shown and/or correct labels/units if called for in the item 2 1 Partially correct response 0 No response, or the response is incorrect

16. Rubric for Extended Response • Revised August 2005 • Available at the ISBE Website http://www.isbe.net/assessment/math.htm )

17. Kid FriendlyRubrics • Available at the ISBE website • http://www.isbe.net/assessment/math.htm • 3-4 grade levels are combined • 5-6 grade levels are combined • 7-8 grade levels are combined

18. Test Item Development • Illinois items written by teachers in October 2004 • Reviewed by teachers in November 2004 • Pilot-tested with Illinois students inApril 2005 • No test results for students or schools • Only results on individual items • Data analyzed • Some selected for 2006 ISAT

19. Calculators • In grade 3, students are not allowed to use calculators on any part of the mathematics assessment, unless it is a documented accommodation for a student with an Individualized Education Program (IEP). • In grades 4 through 8, students are allowed to use a calculator on any part of the mathematics assessment. • Students are allowed to use any calculator they normally use in their mathematics classes.

20. Rulers for 3 graders The ruler provided to all students in grade 3 is divided into quarters of an inch and half centimeters.. These rulers are printed eight to a page on hard-stock paper and must be torn out prior to testing.

21. Rulers for 4-8 • The 6-inch ruler provided to all students in grades 4 through 8 is divided into eighths of an inch and millimeters. • These rulers are printed eight to a page on hard-stock paper and must be torn out prior to testing.

22. Reference Sheet for 7 and 8 • All students in grades 7 and 8 will be provided with a reference sheet to use during the mathematics assessment. This reference sheet includes any necessary formulas for items at those grades.

24. Summarizing Changes in the 2006 test • All grades 3-8 will be tested in both reading and math • Students will receive a norm-referenced score in addition to the criteria referenced score that had been given in the past • Not all items will be developed by IL teachers but all items will be reviewed by IL teachers • Time may be extended (beyond 45 minutes ) for students still actively engaged in taking a section of the test

25. Summarizing Changes in the 2006 test (continued) • The addition of Short Constructed Response (SCR) items • Students will be given 6-inch rulers and asked to measure during testing • Four answer choices for MC at all grades • The IL Assessment Framework - Specific list of what is going to be tested at each grade level is available to all educators

26. Illinois Assessment Framework was designed to clearly define those elements of the Illinois Learning Standards that are suitable for state testing beginning in the 2005-2006 school year

27. Designed for: • Test makers • Educators • Policy Makers • General Public

28. Website Illinois Assessment Frameworks (for 2006 Assessments) can be found at: www.isbe.net/assessment/IAFindex.htm

29. Resources that were used when writing the IAF • Illinois Learning Standards including the Performance Descriptors • The National Council of Teachers of Mathematics (NCTM) National Standards • The National Assessment of Educational Progress (NAEP) framework

30. Content Emphasis • The proportion of each year’s tests devoted to each math goal is clearly specified in the Mathematics Content Category Table • These percents are estimates used to guide the general distribution of items throughout the test.

35. Frequently asked question • What’s a “net”? (two dimensional drawing of three dimensional shape) 9.3.08 Identify a three–dimensional object from its net.

36. Each Objective has a unique identifier with three components: • State Goal - 6 • Grade level – 3 for 3rd grade • Objective Number – “01” indicates that this is the first assessment objective for this state goal 6 Example: 6.3.01

37. Grade 3 ISAT itemSets 1, 4, 6IAF: Primary 7.3.03, Secondary 9.3.01 What is the perimeter of the square? 5 m A. 5 m B. 10 m C. 15 m D. 20 m from Illinois Standards Achievement Test Sample Mathematics Materials 2003, page 17

38. Grade 5 ISAT itemSet 5IAF: Primary 9.5.13 Which of these figures are congruent? A. M and O B. N and P C. N and R D. N and Q E. P and O from Illinois Standards Achievement Test Sample Mathematics Materials 2003, page 32

39. Grade 8 ISAT itemSets 1, 2, 5 IAF: Primary 9.8.11, Secondary 6.8.16 ∆XYZ is similar to ∆RST. What is the length of ST?X A. 5 cm 8 cm 10 cm B. 7.5 cm C. 8 cm Y 12 cm Z D. 9 cm E. 10 cm R 6 cm S T from Illinois Standards Achievement Test Sample Mathematics Materials 2003, page 63

40. Assessing Standards such as 9C “Construct convincing arguments and proofs to solve problems.” Must use Extended-Response Item to assess standards such as this

41. Megan Forness • Illinois State Board of EducationPrincipal Performance Consultant100 North First Street Student Assessment Division E-216Springfield, IL 62777-0001 • E-mail: mforness@isbe.net • Web site: www.isbe.net/assessment