1 / 48

JUST READ, FLORIDA!

JUST READ, FLORIDA!. N ational A ssessment of E ducational P rogress (NAEP). “ The Nation’s Report Card” Nation’s only measure of student achievement in the United States that can be used to:

kynton
Download Presentation

JUST READ, FLORIDA!

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. JUST READ, FLORIDA! Florida Department of Education June 2006

  2. National Assessment of Educational Progress (NAEP) “The Nation’s Report Card” Nation’s only measure of student achievement in the United States that can be used to: • Compare the performance of students in Florida with the performance of students across the nation and in other states 2. Track changes over time Florida Department of Education June 2006

  3. NAEP • Has produced National results for grades 4, 8, and 12 since 1969 • Has produced state-level results at grades 4 and 8 since 1990 • Has produced results for Trial Urban Districts (TUDA) since 2002 • Does not produce student-, school-, or district-level results, except for the 10 TUDAs Florida Department of Education June 2006

  4. Current OrganizationStructure of NAEP US Department of Education Institute of Education Services National Assessment Governing Board (NAGB) National Center for Educational Statistics Contractors: ETS, Westat, AIR, NCS Pearson, GMRI, Hager Sharp, HumRRO, And ESSI Assessment Division National Assessment of Educational Progress Florida Department of Education June 2006

  5. Federal Legislative Reference No Child Left Behind Act of 2001 (NCLB) • Section 111(c)(2) of NCLB requires states/districts who receive Title I funding to participate in biennial State NAEP assessments of 4th and 8th graders in Reading and Mathematics, beginning with the 2002-2003 school year. Florida Department of Education June 2006

  6. State Legislative Reference Florida State Statute 1008.22 (2) “The Commissioner of Education shall direct Florida school districts to participate in the administration of NAEP . . . both for the national sample and for any state-by-state comparison programs .” • State legislation requires all selected schools to participate in all NAEP assessments. Florida Department of Education June 2006

  7. NAEP Components National Assessment of Educational Progress Main NAEP Long Term Trend NAEP TUDA (Public) (Grades 4 & 8) NATIONAL (Public & Private) (Grades 4, 8 & 12) NATIONAL (Public & Private) (9, 13 & 17-year olds) STATE (Public) (Grades 4 & 8) Florida Department of Education June 2006

  8. NAEP Assessment Schedule Florida Department of Education June 2006

  9. NAEP Frameworks • The American Institute of Research (AIR) develops the NAEP frameworks. • The National Assessment Governing Board (NAGB) approves and adopts the frameworks after they have been reviewed and critiqued by teachers. • Each framework describes the content and format of the 4th, 8th, and 12th grade assessments. • There are frameworks for each of the content areas assessed by NAEP. Florida Department of Education June 2006

  10. NAEP Design: Item Development • Items are based on the subject area frameworks approved by the National Assessment Governing Board (NAGB). • Items are developed by teachers, subject area specialists, and assessment experts. • Items meet professional standards for testing. • Experts review items for technical/statistical quality, content quality, bias, and sensitivity. Florida Department of Education June 2006

  11. How Florida’s School Sample is Selected • Step 1: Lists of schools are obtained from the National Center for Education Statistics Common Core of Data (CCD). • Step 2:Schools are grouped into strata by two primary characteristics: • Type of location (central city, urban fringe, rural) • Minority enrollment (white, African-American, Hispanic) • Step 3:Within strata, schools are ordered by a measure related to achievement. • Step 4:A proportional sample is selected systematically from the ordered list. Florida Department of Education June 2006

  12. Florida’s Measure of Achievement Grade 4 Mathematics average scale scores for all students, grade 4, in 2005 Grade 8 Median household income because the match rate for achievement scores for 8th grade was less than 70% Florida Department of Education June 2006

  13. How is the Student Sample Selected? • A list of all 4th or 8th grade students enrolled at the sampled schools is submitted electronically to Westat from the FLDOE, based on the October FTE. • 90% of selected students must participate in the assessment or a make-up session is scheduled. • Students exempted by their parents are not replaced and are not used to calculate the assessment participation rate. Florida Department of Education June 2006

  14. NAEP 2007 • NAEP assessments will be administered in Florida from January 22 through February 21, 2007. • Assessment will only take 90 minutes of a student’s time. • Assessment is administered by a team from Westat, the NAEP administration contractor for the US DOE and National Center for Education Statistics (NCES). • Parents must be notified prior to the assessment. Florida Department of Education June 2006

  15. Sampling Schools and Students • ~350 Florida public schools in 52 districts will participate in some type of NAEP Assessment in 2007. • At grade 4 – Reading and Mathematics: Florida’s sample will include 167 schools. Schools can elect to take all students (up to 120). If there are more than 120 4th graders, NAEP will select a sample of 62 students to assess. • At grade 8 – Reading, Mathematics, and Writing: NAEP will select a sample of 93 students at each of the 161 Florida schools included in the sample. • At grade 12 – Reading, Mathematics, and Writing: Florida’s sample will include 31 high schools. 75 students from each school will be selected to participate. Florida Department of Education June 2006

  16. NAEP Inclusions and Accommodations • NAEP has included students needing accommodations since 1998. • Students with disabilities and limited English proficient students are to be included in NAEP based on an IEP/504 Accommodations Plan/LEP Plan team decision. • Most frequent accommodations with NAEP: • Extra testing time • Individual or small group administrations • Large print booklets • Does not include reading aloud of passages or questions on the NAEP reading assessment. • Assessment must be completed in one day. • Assessment is not available in Braille unless the district or state provides it. Florida Department of Education June 2006

  17. Analysis and Reporting National, State, and Trial Urban District Assessment (TUDA) results. • NAEP scores are reported in two ways – by Scale Scores and by Achievement Levels • No student, classroom, or school results are provided • No district results are provided except for the TUDA’s • Subgroup, state, and national comparisons can be made • Relationships between student proficiency and certain background variables are available Florida Department of Education June 2006

  18. NAEP Scale Scores Scale scores provide a comparison of student performance with regard to a group (e.g., the nation) or a subgroup (e.g., LEP) on a set of items. Scale scores: • Reading and Mathematics scale score range is 0-500 • Science and Writing scale score range is 0-300 Scale scores are reported as an average for groups of students and may obscure progress or problems related to student performance across a distribution of scores. Florida Department of Education June 2006

  19. National NAEP Scale Scores for Grades 4 and 8 Reading National NAEP average reading scale scores are 2 points higher in 2005 than in 1992 at both grades 4 and 8. Florida Department of Education June 2006

  20. National NAEP TrendsGrade 4 Reading • White students scored higher, on average, in reading than their African-American and Hispanic peers. • African-American and Hispanic students each scored higher, on average, in 2005 than in 2003. • Score gaps between white and African/American students and between white and Hispanic students narrowed between 2003 and 2005. Florida Department of Education June 2006

  21. National NAEP Trends Grade 8 Reading • White, African-American, and Hispanic students scored higher, on average, in reading in 2005 than in 1992. • The score gap between white and Hispanic students decreased by 2 points between 2003 and 2005. Florida Department of Education June 2006

  22. Florida Compared to the NationNAEP 2005 Scale Scores Grade 4 Reading Of the 52 states and other jurisdictions that participated in the 2005 4th grade reading assessment, students’ average scale scores in Florida were higher than that of 15 jurisdictions, not significantly different from that of 19 jurisdictions, and lower than that of 17 jurisdictions. Florida Department of Education June 2006

  23. Florida Compared to the NationNAEP Scale Scores 1998-2005 Grade 4 Reading Florida improved from scoring below the National Average in 1998 to above the National Average in 2005. Florida Department of Education June 2006

  24. Florida Compared to the NationNAEP 2005 Scale Scores Grade 8 Reading Of the 52 states and other jurisdictions that participated in the 2005 8th grade reading assessment, students’ average scale scores in Florida were higher than that of 5 jurisdictions, not significantly different from That of 11 jurisdictions, and lower than that of 35 jurisdictions. Florida Department of Education June 2006

  25. Florida Compared to the NationNAEP Scale Scores 1998-2005 Grade 8 Reading Florida grade 8 performance parallels and continues to score below the National performance. Florida Department of Education June 2006

  26. NAEP Grade 4 Reading 1998 - 2005Florida and the Nation Average Scale ScoreRace/Ethnicity Florida Department of Education June 2006

  27. NAEP Florida and the Nation Grade 4 Reading 1998 - 2005 Performance Gaps Between Average Scale Scores by Race/Ethnicity Florida Department of Education June 2006

  28. NAEP Grade 8 Reading 1998 - 2005Florida and the Nation Average Scale ScoreRace/Ethnicity Florida Department of Education June 2006

  29. NAEP Florida and the Nation Grade 8 Reading 1998 - 2005 Performance Gaps Between Average Scale Scores by Race/Ethnicity Florida Department of Education June 2006

  30. NAEP Achievement Levels NAEP Achievement Levels (ALs) try to identify what students should know and be able to do at various achievement levels. • Advanced, Proficient, Basic, and below Basic indicate NAEP achievement levels. Each is determined by cutpoints established by professional educators and NAGB. • The number or percentage of students in the population at large or in subpopulations can be reported by the four achievement levels. • Results show how different groups are performing in relation to each other and over time. Florida Department of Education June 2006

  31. National Percentage of StudentsPerforming at NAEP Achievement Levels Grade 4Reading 1992 - 2005 Grade 4 – percentage of grade 4 students performing at or above Basic increased from 60 percent in 1992 to 63 percent in 2005 Florida Department of Education June 2006

  32. National Percentage of StudentsPerforming at NAEP Achievement Levels Grade 8 Reading 1992 - 2005 Grade 8 – percentage of grade 8 students performing at or above Basic increased from 68 percent in 1992 to 71 percent in 2005 Florida Department of Education June 2006

  33. Florida Compared to the Nationat or Above Basic Grade 4 Reading 2005 Of the 52 states and other jurisdictions that participated in the 2005 grade 4 reading assessment, the percentage of students scoring at or above Basic in Florida was higher than that of 15 jurisdictions, not significantly different from that of 19 jurisdictions, and lower than that of 17 jurisdictions. Florida Department of Education June 2006

  34. Florida NAEP Achievement Levels Grade 4 Reading 1992 - 2005 Florida has a greater percentage of students scoring at Basic and Above in 2005 than does the Nation. Florida Department of Education June 2006

  35. Florida Compared to the Nationat or Above Basic Grade 4 Reading 1998 - 2005 Florida went from scoring below the National average in 1998 to scoring above the National average in 2005 at the Basic and above achievement level. Florida Department of Education June 2006

  36. Florida NAEP Achievement Levels Grade 4 Reading • The percentage of students in Florida who performed at or above the NAEP Basic level was 65 percent in 2005. This percentage was not significantly different from that in 2003 (63 percent) but greater than that in 1992 (53 percent). • Florida is one of six states that had more than a 10 point increase in the percentage of low-income students that performed at the Basic level or higher between 1998 to 2005. Florida Department of Education June 2006

  37. Florida Compared to the Nationat or Above Basic Grade 8 Reading 2005 Of the 52 states and other jurisdictions that participated in the 2005 grade 8 reading assessment, the percentage of students scoring at or above Basic in Florida was higher than that of 4 jurisdictions, not significantly different from that of 13 jurisdictions, and lower than that of 34 jurisdictions. Florida Department of Education June 2006

  38. Florida NAEP Achievement Levels Grade 8 Reading 1998 - 2005 Florida has a smaller percentage of students scoring at Basic and above than does the Nation. Florida Department of Education June 2006

  39. Florida Compared to the Nationat or Above Basic Grade 8 Reading 1998 - 2005 Florida grade 8 performance parallels and continues to score below the National performance. Florida Department of Education June 2006

  40. Florida NAEP Achievement Levels Grade 8 Reading • The percentage of students in Florida who performed at or above the NAEP Basic level was 66 percent in 2005. This percentage was not significantly different from that in 2003 (68 percent) and in 1998 (67 percent). Florida Department of Education June 2006

  41. NAEP AND FCAT • FCAT – measures student performance on selected benchmarks, as defined by Florida’s SSS • NAEP – reports on the performance of groups of students at a given time - and across time - without specifying how a subject should be taught Florida Department of Education June 2006

  42. FCAT and NAEP Grade 4 Reading by Achievement Level 1998 - 2005 Percentage of students scoring at Level 3 and above on FCAT and Basic and Above on NAEP increased between 1998 and 2005. Florida Department of Education June 2006

  43. FCAT and NAEP Grade 8 Reading by Achievement Level 1998 - 2005 Performance of grade 8 students has been flat on both the FCAT and NAEP. Florida Department of Education June 2006

  44. FCAT and NAEPGrade 4 Reading 1998 - 2005 Race/Ethnicity White, African-American, and Hispanic students all improved from scoring lower on the FCAT than on NAEP in 1998 to higher on the FCAT than on NAEP in 2005. Florida Department of Education June 2006

  45. FCAT and NAEPGrade 8 Reading 1998 - 2005 Race/Ethnicity White, African-American, and Hispanic students continued to score higher on NAEP than on the FCAT. Florida Department of Education June 2006

  46. The Nation’s Report Cardhttp://www.nces.ed.gov/nationsreportcard/ Florida Department of Education June 2006

  47. NAEP Websites Florida’s NAEP website: http://firn.edu/doe/sas/naephome.htm NAEP website: http://nces.ed.gov/nationsreportcard/ NAEP Data Explorer: http://nces.ed.gov/nationsreportcard/nde/ NAEP Questions Tool: http://nces.ed.gov/nationsreportcard/itmrls Florida Department of Education June 2006

  48. NAEP Coordinator Contact Information Michele Sonnenfeld NAEP State Coordinator Florida Department of Education (850) 245-0787 SC 205-0787 FAX (850) 245-0781 SC 205-0781 Michele.Sonnenfeld@fldoe.org Florida Department of Education June 2006

More Related