1 / 54

READING CONTENT ADVISORY COMMITTEE MEEETING

READING CONTENT ADVISORY COMMITTEE MEEETING. NATIONAL ASSESSMENT of EDUCATIONAL PROGRESS. NAEP is a congressionally mandated program that assesses a representative sample of students in every state, the District of Columbia, the Department of Defense Schools, Puerto Rico, and 10 urban districts.

chung
Download Presentation

READING CONTENT ADVISORY COMMITTEE MEEETING

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. READING CONTENT ADVISORY COMMITTEE MEEETING

  2. NATIONAL ASSESSMENT of EDUCATIONAL PROGRESS NAEP is a congressionally mandated program that assesses a representative sample of students in every state, the District of Columbia, the Department of Defense Schools, Puerto Rico, and 10 urban districts.

  3. NAEP’s two major goals are to: • Measure and compare student achievement in states and other jurisdictions 2. Report changes in achievement of 4th, 8th, and 12th graders over time

  4. NAEP • Has produced National results for grades 4, 8, and 12 since 1969 • Has produced age-level results since the 1970’s via the Long-Term Trend assessment (9-, 13-, and 17-year olds) • Has produced state-level results at grades 4 and 8 since 1990 • Has produced results for Trial Urban Districts (TUDAs) since 2002 • Does not produce student-, school-, or district-level results, except for the 10 TUDAs

  5. Current OrganizationStructure of NAEP US Department of Education Institute of Education Services National Assessment Governing Board (NAGB) National Center for Educational Statistics Contractors: ETS, Westat, AIR, NCS Pearson, GMRI, Hager Sharp, HumRRO, And ESSI Assessment Division National Assessment of Educational Progress

  6. Federal Legislative Reference to NAEP No Child Left Behind Act of 2001 (NCLB) • Section 111(c)(2) of NCLB requires states/districts who receive Title I funding to participate in biennial State NAEP assessments of 4th and 8th graders in Reading and Mathematics, beginning with the 2002-2003 school year.

  7. State Legislative Reference to NAEP Florida State Statute 1008.22 (2) “The Commissioner of Education shall direct Florida school districts to participate in the administration of NAEP . . . both for the national sample and for any state-by-state comparison programs .” • State legislation requires all selected schools to participate in all NAEP assessments.

  8. NAEP Components National Assessment of Educational Progress Main NAEP Long-Term Trend NAEP TUDA (Public) (Grades 4 & 8) NATIONAL (Public & Private) (Grades 4, 8, & 12) NATIONAL (Public & Private) (9-, 13-, & 17-year olds) STATE (Public) (Grades 4 & 8)

  9. NAEP Schedule of Assessments

  10. NAEP Frameworks • The American Institute of Research (AIR), with the assistance of teachers, develops the NAEP frameworks. • The National Assessment Governing Board (NAGB) approves and adopts the frameworks after they have been reviewed and critiqued by teachers. • Each framework describes the content and format of the 4th, 8th, and 12th grade assessments. • There are frameworks for each of the content areas assessed by NAEP.

  11. NAEP Reading Framework2007 Content of Reading Assessment • Reading for literary experience • Reading for information • Reading to perform a task Four Aspects of Reading • Forming a general understanding • Developing interpretation • Making reader/text connections • Examining content and structure

  12. NAEP Reading Framework2009 Content of Reading Assessment • Literary Text Fiction Literary Nonfiction Poetry • Informational Text Exposition Argumentation and Persuasive Text Procedural Text and Documents

  13. NAEP Reading Framework2009 Cognitive Targets Locate/Recall Integrate/Interpret Critique/Evaluate Vocabulary will be measured explicitly and provide a report on the extent of vocabulary knowledge.

  14. NAEP Design: Item Development • Items are based on the subject-area frameworks approved by the National Assessment Governing Board (NAGB). • Items are developed by teachers, subject- area specialists, and assessment experts. • Items meet professional standards for testing. • Experts review items for technical/statistical quality, content quality, bias, and sensitivity.

  15. How is Florida’s NAEP School Sample Selected? • Step 1: Lists of schools are obtained from the National Center for Education Statistics Common Core of Data (CCD). • Step 2:Schools are grouped into strata by two primary characteristics: • Type of location (central city, urban fringe, rural) • Minority enrollment (white, African American, Hispanic) • Step 3:Within strata, schools are ordered by a measure related to achievement. • Step 4:A proportional sample is selected systematically from the ordered list.

  16. Measure of Achievement Used for Florida’s NAEP School Sample Selection Grade 4 Mathematics average scale scores for all Grade 4 students in 2005 Grade 8 Median household income (because the match rate for achievement scores for 8th grade was less than 70%)

  17. How is Florida’s NAEP Student Sample Selected? • A list of all 4th, 8th,or 12th grade students enrolled at the sampled schools is submitted electronically to Westat from the FLDOE, based on October FTE data. Westat randomly selects students to participate in NAEP. • 90% of selected students at each chosen school must participate in the assessment. Make-up sessions are scheduled at schools not meeting this benchmark.

  18. NAEP 2007 • NAEP 2007 was administered in Florida from January 22 through February 21, 2007. • Each student takes only a portion of the questions, answering two 25-minute sections of subject-area questions. • Students also answer questions related to their backgrounds and their home or school experiences in the subject of their assessment. • Assessment is administered by a team from Westat, the NAEP administration contractor for the US DOE, and the National Center for Education Statistics (NCES). • Parents must be notified prior to the assessment. Refusals must be in writing.

  19. NAEP Sampling School and Student Selection • ~350 Florida public schools in 49 districts participated in NAEP 2007. • Grade 4 – Reading and Mathematics: Florida’s sample included 167 schools. Schools could elect to assess all students (up to 120). If there were more than 120 4th graders, NAEP selected a sample of 62 students to assess. • Grade 8 – Reading, Mathematics, and Writing: NAEP selected a sample of 93 students at each of the 161 Florida schools included in the sample. • Grade 12 – Reading and Writing: Florida’s sample included 31 high schools, and 75 students from each school were selected to participate.

  20. NAEP Inclusions and Accommodations • NAEP has included students needing accommodations since 1998. • Students with disabilities (SD) and English language learners (ELLs) are to be included in NAEP based on an IEP/504 Accommodations Plan/ELL Committee decision. • Most frequent accommodations with NAEP: • Extra testing time • Individual or small group administrations • Large print booklets • Does not include reading aloud of passages or questions on the NAEP reading assessment • Assessment must be completed in one day.

  21. NAEP Analysis and Reporting National, State, and 10 Trial Urban District Assessment (TUDA) results • NAEP scores are reported in two ways – by Average Scale Scores and by Achievement Levels • No student, classroom, or school results are provided • No district results are provided except for the 10 TUDAs • Subgroup, state, and national comparisons can be made • Relationships between student proficiency and certain background variables can be drawn

  22. NAEP AVERAGE SCALE SCORES Scale scores provide a comparison of student performance with regard to a group (e.g., the nation) or a subgroup (e.g., ELL) on a set of items. Scale scores: • Reading and Mathematics scale score range is 0-500 • Science and Writing scale score range is 0-300 Scale scores are reported as an average for groups of students and may obscure progress or problems related to student performance across a distribution of scores. Cannot compare scale scores across grade levels or across subjects.

  23. National NAEP Average Scale Scores Grades 4 and 8 Reading 1992-2005 National NAEP reading average scale scores are 2 points higher in 2005 than in 1992 at both Grades 4 and 8.

  24. Florida Compared to the Other 49 States, District of Columbia, and Department of Defense SchoolsNAEP 2005 Average Scale Scores Grade 4 Reading Of the 50 states and two jurisdictions that participated in the NAEP 2005 Grade 4 reading assessment, students’ average scale scores in Florida were higher than that of 15, not significantly different from that of 19, and lower than that of 17. Florida scored significantly higher than most of the other southern states.

  25. Florida Compared to the NationNAEP Average Scale Scores 1998-2005 Grade 4 Reading Florida improved from scoring below the National average in 1998 to above the National average in 2005 on NAEP Grade 4 reading.

  26. NAEP Grade 4 Reading 1998 - 2005Florida and the Nation Average Scale Scores by Race/Ethnicity

  27. NAEP - Florida and the Nation Grade 4 Reading 1998 - 2005 Performance Gaps Between Average Scale Scores by Race/Ethnicity

  28. Florida NAEP Trendsby Race/EthnicityGrade 4 Reading • Florida’s Hispanic students in Grade 4 reading and mathematics continue to score above the national average for Hispanic students. • Florida’s African-American students went from scoring higher than 15 % of the other 35 states and jurisdictions with reportable populations in 1998 to higher than 70% of the other 42 states and jurisdictions with reportable populations in 2005.

  29. Florida Compared to the Other 49 States, District of Columbia, and Department of Defense SchoolsNAEP 2005 Average Scale Scores Grade 8 Reading Of the 50 states and two jurisdictions that participated in the NAEP 2005 Grade 8 reading assessment, students’ average scale scores in Florida were higher than that of 5, not significantly different from that of 11, and lower than that of 35.

  30. Florida Compared to the NationNAEP Average Scale Scores 1998-2005 Grade 8 Reading Florida grade 8 performance is parallel to and below the National performance on NAEP Grade 8 reading.

  31. NAEP Grade 8 Reading 1998 - 2005Florida and the Nation Average Scale Scoreby Race/Ethnicity

  32. NAEP Florida and the Nation Grade 8 Reading 1998 - 2005 Performance Gaps Between Average Scale Scores by Race/Ethnicity

  33. Florida NAEP Trendsby Race/EthnicityGrade 8 Reading • Florida’s African American students went from scoring higher than 11 % of the other 36 states and jurisdictions with reportable populations in 1998 to higher than 77% of the other 42 states and jurisdictions with reportable populations in 2005. • Florida’s Hispanic students showed improvement in Grade 8 reading and mathematics, surpassing the national average for Hispanic students in both subject areas.

  34. NAEP Achievement Levels NAEP Achievement Levels (ALs) try to identify what students should know and be able to do at various achievement levels. • Advanced, Proficient, Basic, and below Basic indicate NAEP achievement levels. Each is determined by cutpoints established by professional educators and NAGB. • The number or percentage of students in the population at large or in subpopulations can be reported by the four achievement levels. • Results show how different groups are performing in relation to each other and over time.

  35. Florida Compared to the NationNAEP 2005 at Basic and above Grade 4 Reading 2005 Of the 50 states and two jurisdictions that participated in the NAEP 2005 Grade 4 reading assessment, the percentage of students scoring at Basic and above in Florida was higher than that of 15, not significantly different from that of 19, and lower than that of 17.

  36. NAEP Achievement Levels Florida and the NationGrade 4 Reading 1992 - 2005 Florida has a greater percentage of students scoring at Basic and above in 2005 than does the Nation on NAEP Grade 4 reading.

  37. Florida Compared to the Nationat Basic and above Grade 4 Reading 1998 - 2005 Florida went from scoring below the National average in 1998 to scoring above the National average in 2005 at Basic and above on NAEP Grade 4 reading.

  38. Florida NAEP Grade 4 Reading Summary of Achievement Level Results • The percentage of students in Florida who performed at the NAEP Basic and above level was 65 percent in 2005. This percentage was not significantly different from that in 2003 (63 percent) but greater than that in 1992 (53 percent). • Florida is one of six states that had more than a 10 point increase in the percentage of low-income students that performed at Basic and above between 1998 to 2005.

  39. Florida Compared to the NationNAEP 2005 at Basic and above Grade 8 Reading 2005 Of the 50 states and two jurisdictions that participated in the NAEP 2005 Grade 8 reading assessment, the percentage of students scoring at Basic and abovein Florida was higher than that of 4, not significantly different from that of 13, and lower than that of 34.

  40. NAEP Achievement Levels Florida and the NationGrade 8 Reading 1998 - 2005 Florida has a smaller percentage of students scoring at Basic and above than does the Nation on NAEP Grade 8 reading.

  41. Florida Compared to the Nationat Basic and above Grade 8 Reading 1998 - 2005 Florida NAEP Grade 8 reading performance is parallel to and below the National Grade 8 reading performance.

  42. Florida NAEP Grade 8 Reading Summary of Achievement Level Results • The percentage of students in Florida who performed at the NAEP Basic and above level was 66 percent in 2005. This percentage was not significantly different from the percentage in 2003 (68 percent) and in 1998 (67 percent).

  43. FCAT AND NAEP • FCAT – measures student performance on selected benchmarks, as defined by Florida’s Sunshine State Standards • NAEP – reports on the performance of groups of students at a given time and across time, without specifying how a subject should be taught

  44. FCAT and Florida NAEP Grade 4 Reading by Achievement Level 1998 - 2005 For reading, the percentage of Grade 4 students scoring at Level 3 and above on FCAT and Basic and above on NAEP increased between 1998 and 2005.

  45. FCAT and Florida NAEP Grade 8 Reading by Achievement Level 1998 - 2005 Performance of Grade 8 students has been flat on both the FCAT and NAEP.

  46. EXPLORE NEW HORIZONS WITH NAEP

  47. The Nation’s Report Cardhttp://www.nces.ed.gov/nationsreportcard/

  48. The NATION’S REPORT CARD • Provides an overview of NAEP, information specific to various stakeholders (e.g., parents), and a vast array of data from NAEP • Provides in-depth descriptions of subject areas, special studies, and other aspects of NAEP

  49. NAEP QUESTIONS TOOL

  50. NAEP SAMPLE QUESTIONS Questions Tool contains over 1,000 items from many content areas. • Sorts items by domains, objectives, cognitive ability, and difficulty level. • Includes various types of items such as multiple-choice, short constructed response, and extended-constructed. • Indicates how students performed on an item, provides examples of student responses, and indicates state performance results on items.

More Related