Mark DeCandia Kentucky NAEP State Coordinator Mark.DeCandia@education.ky

1. Mark DeCandia Kentucky NAEP State Coordinator Mark.DeCandia@education.ky.gov

2. NAEP 2011 Reading Mark DeCandia Kentucky NAEP State Coordinator Mark.DeCandia@education.ky.gov

3. What is NAEP? • The National Assessment of Educational Progress (NAEP) is the largest continuing and nationally representative assessment of what our nation’s students know and can do in core subjects. • A survey designed to produce national, state, and select urban district level results. • NAEP results are for populations of students, not for individual students nor schools. • Measures student performance nationally and reports changes over time. • Allows comparisons between states and the nation.

4. NAEP School and Student Selection • NAEP uses a carefully designed sampling procedure for the assessment to be representative of the geographical, racial, ethnic, and socio-economic diversity of schools and students in the state. • First, schools are selected to be representative of schools. • Then, within each chosen school students are randomly selected to participate. Each participating student represents hundreds of other similar students.

5. NAEP Administration • NAEP is administered over a six-week period. • For 2011: January 24th – March 4th • About 3,000 students in approximately 100 schools are selected in each state for each grade and subject. • Each student is only assessed in one subject area. • Students only take a small portion of the assessment • Accommodations are provided as necessary for students with disabilities and English language learners.

6. NAEP Results • The results of NAEP are released as The Nation’s Report Card. • The report card provides national, state, and district-level results, results for different demographic groups, inclusion information, and sample questions. • NAEP Results are reported in two formats • Average Scale Scores • Numeric scale • 0 − 500 on mathematics and reading assessments • Scores cannot be compared across content areas • Achievement Levels • Categorical scale • Below Basic, Basic, Proficient, Advanced

7. Student, School/District Characteristics for Kentucky Public Schools

8. 2011 Participation School and Student Counts Total actual number of schools that participated: • Grade 4 - 185 • Grade 8 - 131 316 Total number of students assessed: • Grade 4 – 4,800 • Grade 8 – 3,700 8,500

9. 2011 Kentucky Participation in NAEP • Total Kentucky NAEP Districts – 123 • 4th Grade – 185 • 8th Grade – 131 • 12th Grade – 11 327 Total Schools __________________________________ • TUDA (Jefferson County) -107 Schools

11. Grade 4 ReadingResults

12. Reading 4th Grade Average Scale Scores Over Time NOTE: Observed differences are not necessarily statistically significant.

13. Reading 4th Grade2011 Achievement Levels NOTE: Observed differences are not necessarily statistically significant. Percentages might not sum to 100 due to rounding.

14. Reading 4th GradeScore Gap Comparison:NSLP Not Eligible and Eligible National Public Kentucky NOTE: Observed differences are not necessarily statistically significant.

15. During 2009 - Scores increase since 2007 in 3 states and decrease in 4 states

16. During 2011 - 4th Grade Reading Students in 4 states score higher than in 2009, and students in 2 states score lower 1 Department of Defense Education Activity (overseas and domestic schools).

17. Students assessed with 2 text types and 3 reading processes Grade 4 Grade 8 Text Types Literary 50% 45% Informational 50% 55% Grade 4 Grade 8 Reading Processes Locate and recall 30% 20% Integrate and interpret 50% 50% Critique and evaluate 20% 30% 17

18. 18

19. 2011 NAEP ReadingScale Scores

20. 2011 KY ReadingGrade 4 Compared w/ Other Jurisdictions Students’ average scale scores: • Higher than KY (5 Jurisdictions) • Not significantly different (16 Jurisdictions) • Lower than KY (nation and 30 Jurisdictions)

21. 2011 ReadingGrade 4

22. Kentucky Average Scale Scores for Grade 4Reading1998 to 2011

23. Kentucky vs. Nation Average Scale Scores for Grade 4Reading1998 to 2011

24. KY Average Scale Scores: Grade 4 Reading 1998 - 2011

25. 2011 ReadingGrade 4

26. 2011 Kentucky ReadingGrade 4 Scale Score •  In 2011, the average scale score for students in Kentucky was 225. This was higher than that of students across the nation (220). •  In Kentucky, the average scale score for students in 2011 was not significantly different from that in 2009 (226).

27. 2011 Kentucky ReadingGrade 4 Achievement Level •  In 2011, the percentage of Kentucky's students who performed at or above Proficient was 35 percent. This was greater than the percentage of the nation's public school students who performed at or above Proficient (32 percent). •  In Kentucky, the percentage of students who performed at or above Proficient in 2011 was greater than the percentages in 1992, 1994, 1998, 2002, 2003, and 2005, but was not significantly different from the percentages in 2007 and 2009.

28. 2011 Gender Gap: ReadingGrade 4

29. 2011 White Black Gap: ReadingGrade 4

30. 2011 NSLP Not Eligible and Eligible GAP : ReadingGrade 4

31. 2009 – 2011 Exclusion Rates of SD/ELL – ReadingGrade 4

32. Grade 8 ReadingResults

33. Reading 8th GradeAverage Scale Scores Over Time NOTE: Observed differences are not necessarily statistically significant.

34. Reading 8th Grade 2011 Achievement Levels NOTE: Observed differences are not necessarily statistically significant. Percentages might not sum to 100 due to rounding.

35. Reading 8th Grade Score Gap Comparison: NSLP Not Eligible and Eligible National Public Kentucky NOTE: Observed differences are not necessarily statistically significant.

36. During 2009 – 8th Grade Reading Scores increase since 2007 in 9 states, and no states decline

37. During 2011 - 8th Grade Reading Students in 10 states score higher than in 2009, and no states score lower 1 Department of Defense Education Activity (overseas and domestic schools).

38. 38

39. Locate and Recall Question • 59% of eighth-graders were able to locate specific information from the passage

40. 2011 KY ReadingGrade 8 Compared w/ Other Jurisdictions Students’ average scale scores: • Higher than KY (7 Jurisdictions) • Not significantly different (17 Jurisdictions) • Lower than KY (nation and 27 Jurisdictions)

41. 2011 ReadingGrade 8

42. Kentucky Average Scale Scores for ReadingGrade 8 – 1998 to 2011

43. Kentucky Average Scale Scores for ReadingGrade 8 – 1998 to 2011

44. KY Average Scale Scores: Grade 8 Reading 1998 - 2011

45. ReadingGrade 8

46. Kentucky ReadingGrade 8 Scale Score •  In 2011, the average scale score for students in Kentucky was 269. This was higher than that of students across the nation (264). •  In Kentucky, the average scale score for students in 2011 was not significantly different from that in 2009 (267).

47. 2011 Kentucky ReadingGrade 8 Achievement Level •  In 2011, the percentage of Kentucky's students who performed at or above Proficient was 36 percent. This was greater than the percentage of the nation's public school students who performed at or above Proficient (32 percent). •  In Kentucky, the percentage of students who performed at or above Proficient in 2011 was greater than the percentages in 1998, 2002, 2005, and 2007, but was not significantly different from the percentages in 2003 and 2009.

48. 2011 Gender Gap: ReadingGrade 8

49. 2011 White Black Gap: ReadingGrade 8

50. 2011 NSLP Not Eligible and Eligible GAP : ReadingGrade 8