Measuring and Interpreting Test Results for Teaching Core Standard Expectations

1. Measuring and InterpretingTest Results for Teaching Core Standard Expectations

2. From a very recent research report • Knowledge of mathematics is crucial to educational and financial success in contemporary society and is becoming ever more so. • High school students’ mathematics achievement predicts college matriculation and graduation, • early-career earnings, and earnings growth

3. Elementary school students’ knowledge of fractions and division uniquely predicts their high school mathematics achievement, • even after controlling for a wide range of relevant variables • suggesting that efforts to improve mathematics education should focus on improving students’ learning in those areas.

4. Robert S. Siegler, Greg J. Duncan, Pamela E. Davis-Kean, Kathryn Duckworth, Amy Claessens, Mimi Engel, Maria Ines Susperreguy, and Meichu Chen, Early Predictors of High School Mathematics Achievement, Psychological Science, June 14, 2012.

5. Close examination of test questions, and student responses including to the distracters, can tell us a tremendous amount about these issues. This is what I would like to discuss today.

6. Close examination of test questions, and student responses including to the distracters, can tell us a tremendous amount about these issues. This is what I would like to discuss today.

7. Grade 3

8. Grade 3

9. Comments • It is literally impossible for this to happen if students actually do understand the area model. • So the 91% correct response to the first means something entirely different.

10. The First Problem • What of (B) (30%)? • It seems that these children counted the number of WHITE regions A B C D 11% 30% 53% 5%

11. The Second Problem • What of (A) (38%)? • It seems that these children also counted the number of WHITE regions • In both situations, it is clear that they had very little understanding that the model worked with EQUAL AREAS A B C D 38% 44% 8% 10%

12. And look at the results for division of fractions.

13. Grade 6

14. The First Problem • Note the number of students who simply multiplied (B). • 9% Added top and bottom • Too many checked (D), so we could not measure other errors. • These are issues with the teaching of the subject. A B C D 9% 24% 37% 31%

15. The Second Problem • 11%, about the same as before added top and bottom. • Too many checked (D), so we could not measure other errors, including the dominant “multiplication” • These again are issues with the teaching of the subject. A B C D 8% 37% 11% 44%

16. Grade 6

17. The First Problem • The correct answer is (D), which is unfortunate since it seems that a common strategy here is to check (D) when the students don’t know. • so we could not measure errors, though they seem to all be in placing the decimal – a problem with understanding magnitude. A B C D 27% 22% 6% 45%

18. The Second Problem • Note that more answered (B) than the correct answer (C) • (A) and (B) both show a lack of understanding of magnitude. • Too many checked (D), so we could not measure other errors. • These again are issues with the teaching of the subject. A B C D 7% 36% 34% 24%

19. And look at the results for fraction addition.

20. Grade 5

21. The First Problem • The correct answer is (D) which a simple size estimate shows which is somewhat unfortunate. • (A) could have just been a simple arithmetic error, but again ¾ + 2/7 > ¾ + ¼ = 1, so it should not have happened. • But what of (B)? A B C D 18% 37% 9% 37%

22. The Second Problem • Note that more answered (A) than the correct answer (C) • (A) shows the relatively surprising error of adding top and bottom separately on the frational parts of the mixed number • These again are issues with the teaching of the subject. A B C D 42% 4% 34% 20%

23. We have huge reasons to make sure students learn fractions and division completely and carefully. But, for mathematical reasons, student difficulty with fractions and division rest on earlier problems with place value

24. But these difficulties actually start with PLACE VALUE as it is taught in the earliest grades.

25. Grade 1 As one can see, the percent correct is not always a good measure of what is going on. But the distracters tell us quite a bit.

26. Grade 2 The distracters here give very important, troubling but consistent information.

27. This is an inevitable consequence of lessons like the following

28. Typical U.S Lesson on Place Value Note Focus on Manipulatives Linear model For 10’s, area for 100’s, volume for 1000’s. This is Illogical and confusing What represents 10,000?

29. This is codified in the U.S. curriculum to the extent that if a third grade text does not have this lesson it will typically be rejected as being mathematically insufficient.

30. By contrast here is how this topic is handled in the high achieving countries

31. First Grade Russian Text: Place Value

32. First Grade: Russian Text: Models for Place Value. Especially note use of Decimeters for putting (2 place) Place value on number line

33. Second Grade: Russian Text. Note consistency Of models for higher Places and tight focus

34. Even 1000’s are Consistent E Consistent models make Comparison easier. Note attention to Comparisons

35. “Bundles” In Core Standards

36. This should warn us that there is much, much more going on in Core Standards than one might think. I believe care is necessary in choosing our Core Standard “experts.”