EQuIP Mathematics Student Work Protocol Washington, DC May 19, 2014

EQuIP Mathematics Student Work Protocol Washington, DC May 19, 2014

Specific Objectives of the Student Work Protocol • To confirm the alignment of the assignment with the letter and the spirit of the targeted CCSS. • To determine how students performed on an assignment as evidence of how well designed the lesson/unit is. • To provide criterion-based suggestions for improving the assignment and related instruction.

The Student Work Protocol invites teachers to… • Develop a common understanding of the challenging work required by the CCSS. • Close the gap between the expectations embodied in assignments and what students are supposed to be learning. • Create more equitable educational opportunities for students. • Improve assignments and instructional practices/strategies. • Engage in structured, thoughtful conversations about standards-based instruction with colleagues that can deepen the existing collaboration among states and districts.

What You Need To Conduct Review • A team of reviewers* • The directions or prompts for the task/assignment • Any accompanying answer keys, rubrics, and/or scoring guides • A copy of the CCSS, and particularly those standards targeted by the task/assignment • Forms to record Notes & Observations and Task-to-CCSS Alignment Recording Chart • Copy of Alignment of Task rating descriptors • Several pieces of student work *This process may be completed by a single reviewer

The Five-Step Process • STEP 1: Review the Instructional Materials. • STEP 2: Without consulting the standards or the lesson/unit, analyze the purpose and demands of the assignment as evidenced by the directions and the rubrics/scoring guides. • STEP 3: Compare the alignment of the content and and performance(s) to the targeted standards. • STEP 4: Diagnose student work. • STEP 5: Provide criterion-based suggestions for improving the assignment.

When working with a review team… • If reviewers are part of a team, each step should be completed individually before sharing observations with others. • If working with reviewers new to the process, the team should pause to discuss Notes and Observations after each step. • More experienced review teams may choose to complete all steps individually before discussion.

EQuIPStudent Work Protocol Applying the Steps to an Example

Step 1: Review the Instructional Materials * • Record the grade and title of the lesson/unit on Student Work Protocol recording form. • Locate the assignment/task to be evaluated and record the assignment title or description on the recording form. • Locate the student work that corresponds to the assignment. • Scan the lesson/unit to see what it contains and how it is organized. * Note: This step should be done quickly. This is not a deep study of the lesson or the assignment. Try it now – on your own at first.

Step 1: Review the Instructional Materials This performance task is the Common Core-aligned culminating task for a grade 3 unit of instruction presented by NYC DOE with the same name. Unit Table of Contents Overview and Standards…………………………………..page 1 Performance Task: Cookie Dough……………………..pages 4-5 Rubric, Scoring Guide, Descriptors…………………….page 6-8 Instructional Supports ……………………………………….pages 19-88 (Student Work Samples are in a separate document)

Step 2: Identify content and performances. * • Without consulting the standards or the lesson/unit, analyze the purpose and demands of the assignment as evidenced by the directions/prompts and the rubrics/scoring guides. Guiding Questions: • Based on the directions and/or the scoring guides for the assignment, what is its likely purpose? • Based on the directions and/or the scoring guides for the assignment, what demands does it make of students? *Note: This step requires a more in-depth look at the task/assignment, working the problem(s) and making notes about all grade-level strategies students are likely to use.

Step 2: Identify content and performances. Tips and Reminders: • Take the assignment at face value. • Stick to purposes and demands that are evident from the written words on the page; do not assume skills and knowledge that are not readily apparent, even if all agree that is probably what was meant.

Step 2: Identify content and performances. Notes & Observations Performances Required (skills): Students must multiply (or skip count by 3’s, 4’s, and 5’s) and add whole numbers, solve word problems, Content Required (knowledge): Whole number operations Try it now – on your own at first.

Step 2: Example Requirements of the Cookie Dough Task: • Multiply and add whole numbers • Multi-step problem solving • The inverse relationship between multiplication and division • Quantitative reasoning

Step 2: Example Notes & Observations Performances Required (skills): Students must multiply (or skip count by 3’s, 4’s, and 5’s) and add whole numbers, solve word problems, reason mathematically. They MAY use the inverse relationship between multiplication and division and/or repeated addition and subtraction. Content Required (knowledge): Whole number operations

Step 3: Compare Alignment to Targeted Standards • Compare the alignment of the content and performance(s) of the assignment to the targeted standards for the lesson/unit. Guiding Questions: • Do the directions, prompt(s), and/or scoring guide for the assignment give students the opportunity to demonstrate all or part of the targeted standards for the assignment and lesson? • How well aligned are the content and performance(s) of the assignment with the targeted standards in the assignment and the lesson? • If the assignment is given a score of 1 or 0 for any one of the targeted standards, is there another assignment in the lesson that addresses that standard?

Step 3: Compare Alignment to Targeted Standards Tips and Reminders: — The student-work task need not address every targeted standard in the lesson/unit as long as the requirements of the task are central to the lesson’s learning goals. — In making suggestions for improvement, consider whether the assignment was intended to incorporate all of the targeted standards or if the assignment is one of a series in the lesson/unit used to assess student competency.

EQuIPStudent Work Protocol Grade 3 Math: Cookie Dough These standards are targeted for the unit: 3.OA.1 Interpret products of whole numbers, e.g., interpret 5 x 7 as the total number of objects in 5 groups of 7 objects each. 3.OA.2 Interpret whole-number quotients of whole numbers, e.g., interpret 56 ÷ 8 as the number of objects in each share when 56 objects and partitioned equally into 8 shares, or as a number of shares when 56 objects are partitioned into equal shares of 8 objects each. 3.OA.3 Use multiplication and division within 100 to solve word problems in situations involving equal groups, arrays, and measurement quantities, e.g., by using drawings and equations with a symbol for the unknown number to represent the problem. 3.OA.4 Determine the unknown whole number in a multiplication or division equation relating three whole numbers. 3.OA.5 Apply properties or operations as strategies to multiply and divide. 3.OA.6 Understand division as an unknown-factor problem. Cont.

EQuIPStudent Work Protocol Grade 3 Math: Cookie Dough These standards are targeted for the unit (cont.): 3.OA.7 Fluently multiply and divide within 100, using strategies such as the relationship between multiplication and division (e.g., knowing that 8 x 5 = 40, one knows 40 ÷ 5 = 8) or properties of operations. By the end of Grade 3, know from memory all products of two one-digit numbers. 3.OA.8 Solve two-step word problems using the four operations. Represent these problems using equations with a letter standing for the unknown quantity. Assess the reasonableness of answers using mental computation and estimation strategies including rounding. 3.OA.9 Identify arithmetic patterns (including patterns in the addition table or multiplication table), and explain them using properties of operations. MP.1 Make sense of problems and persevere in solving them. MP.2 Reason abstractly and quantitatively. MP.3 Construct viable arguments and critique the reasoning of others. MP.4 Model using mathematics.

EQuIPStudent Work Protocol The Steps Step 3 (cont.): Rate the alignment to each targeted standards using the 0 – 3 scale provided. Try it now – on your own at first. 3.OA’s and MP’s

EQuIPStudent Work Protocol Grade 3 Math: Cookie Dough Step 3 (cont.): Alignment Ratings of 3 or 2

EQuIPStudent Work Protocol Grade 3 Math: Cookie Dough Step 3 (cont.): Alignment Ratings of 1 or 0

EQuIPStudent Work Protocol Grade 3 Math: Cookie Dough Step 3 (cont.): Notes & Observations Notes & Observations Gaps in Alignment: There are gaps in alignment with several of the standards targeted for the overall unit. Those that align (rating of 3 or 2) with the performance task are 3.OA.1, 3, 4, and 5; and MP.1, MP.2, and MP.3 Gaps in alignment (rating of 1 or 0) that are addressed elsewhere in the unit include 3.OA.2, 6, 8, and 9, and MP.4. Only 3.OA.7 is not fully addressed in the task or in the unit. RE: 3.OA.7 - Fluency is a goal of this grade but is not addressed specifically in the activities of the unit or this performance task. This may be addressed in other units. Try it now – on your own at first.

EQuIPStudent Work Protocol Grade 3 Math: Cookie Dough Step 3 (cont.): Notes & Observations Notes & Observations Gaps in Alignment: There are gaps in alignment with several of the standards targeted for the overall unit. Those that align (rating of 3 or 2) with the performance task are 3.OA.1, 3, 4, and 5; and MP.1, MP.2, and MP.3 Gaps in alignment (rating of 1 or 0) that are addressed elsewhere in the unit include 3.OA.2, 6, 8, and 9, and MP.4. Only 3.OA.7 is not fully addressed in the task or in the unit. RE: 3.OA.7 - Fluency is a goal of this grade but is not addressed specifically in the activities of the unit or this performance task. This may be addressed in other units.

Step 4: Diagnose Student Work Guiding Questions: • What does the collection of student work communicate about the kind and level of skills and knowledge students have learned and still need to learn? • What are the most frequent and fundamental successes students appear to be having with the assignment? • What are the most frequent and fundamental problems students appear to be having with the assignment?

EQuIPStudent Work Protocol Grade 3 Math: Cookie Dough Step 4: Notes & Observations Notes & Observations Try it now – on your own at first.

Step 4 – Example Responses Notes and Observations: There is a full range of response levels in the student work associated with this task. Level 4 students: Student responses meet the demands of the entire task with few errors and also include explanations that are clear and complete. Level 3 students: For most of the task the students’ response shows the main elements of the performance demands of the task and is an organized attack on the core of the problem. In some cases there were errors in calculations or in interpretation of the work. Work shown may be limited but appears to show mathematical understanding. Level 2 students: Students show partial understanding of the problem but either misread or misinterpreted some parts of the problem. In some cases the student was unable to work backward – or understand the inverse relationship between multiplication and division. In part 4 students at this level misinterpreted the question. Level 1 students: Students at this level have minimal success. In some cases even when questions are answered correctly, the work shows misunderstandings and flawed reasoning. Students appear to be stuck at the conceptual understanding of multiplication.

Step 5: Improving the Assignment & Lesson Guiding Questions: • How does the assignment fit into the overall lesson or unit plan? • What does the review of student work suggest are the strengths and weaknesses of the assignment and related instructional materials? Use the criteria in the EQuIP quality review rubric to guide this feedback. • What should be kept, deleted, and/or added to the assignment or lesson/unit for tighter alignment with the depth of the targeted standards? • Do the rubrics/scoring guides accurately communicate CCSS expectations for proficiency? If not, how might they be improved?

Step 5: Improving the Assignment & Lesson Tips and Reminders: • Avoid trying to force-fit an assignment to a standard. If it clearly doesn’t fit any standard, overhaul the assignment so that it is a good fit. • Pay attention to strengthening and clarifying the directions to students, in addition to the dimensions of the assignment itself.

EQuIPStudent Work ProtocolGrade 3 Math: Cookie Dough Step 5: Notes & Observations Notes & Observations Suggestions to strengthen the lesson/unit: Suggestions to strengthen the assignment: Suggestions to strengthen the scoring rubric: Try it now – on your own at first.

Step 5 – Example Response Notes and Observations: At all levels student performance would be improved by making complete explanations and justifications. Better and more detailed prompts could alleviate that problem somewhat. Interpretation of quotients, the most critical aspect of 3.OA.2, is not specifically required in the performance task. However, there is a possibility that students would use this type of thinking for parts 3 and 4. Revising the prompt to specifically require using a quotient would provide alignment with this standard. In this performance task students must use abstract reasoning to solve the problems (MP.2). They decontextualize the verbal description in order to manipulate the numbers and then re-contextualize when presenting their solution and reasoning. If the units were not provided with each answer line, but were instead expected as part of the answer, alignment to MP.2 would be improved. As it stands, this task does not require modeling (MP.4). If the directions, “Write an equation to represent the problem” were added to “Show how you figured it out” on parts 2, 3, and 4, alignment to MP.4 would be improved.

EQuIPStudent Work ProtocolGrade 3 Math: Cookie Dough http://schools.nyc.gov/Academics/CommonCoreLibrary/TasksUnitsStudentWork/default.htm The full annotated version of these student work samples (and several other full units) are available at:

Achieve www.achieve.org 1400 16th Street, NW / Suite 510 Washington, DC 20036

EQuIP Mathematics Student Work Protocol Washington, DC May 19, 2014