National Assessment of Educational Progress

1. National Assessment of Educational Progress Felicia Mallory, Executive Director Denetra Collins, Staff Specialist

2. Overview of NAEP • NAEP is mandated and funded by Congress and administered by the National Center for Education Statistics (NCES) in the U.S. Department of Education. • Policy oversight is provided by the National Assessment Governing Board (NAGB). NAGB establishes the frameworks on which NAEP is based. • Results of the assessments allow for comparisons between states and to the nation • Results of NAEP are not connected to the No Child Left Behind measurement of adequate yearly progress (AYP). However, use of a common scale of achievement allows for the comparison of states’ assessment systems.

3. NAEP in Florida Florida State Statute 1008.22 (2) “The Commissioner of Education shall direct Florida school districts to participate in the administration of NAEP . . . both for the national sample and for any state-by-state comparison programs.”

4. Purpose of NAEP • A common nationwide measure of student performance • Reports changes over time. • Provides results for the nation, states, and some urban districts. • Secondary indicator for state progress and allows national comparisons between states and large urban districts • Used by the President, Congress, and state leaders to set education policy

5. Features of NAEP • Broad subject-area assessments based on NAEP frameworks • Limited number of schools and students within schools • Item sampling –students take only a subset of test items • Administered across the country by contracted administrators – minimal burden to schools • Contains multiple-choice and constructed response questions

6. Sampling • Every school and student has a chance of being selected for the sample. • The sample is designed to be representative of the entire student population. • Lists of schools are obtained by Westat from the National Center for Education Statistics Common Core of Data (CCD).

7. Reporting of NAEP Results • NAEP results are reported by: • Scale scores – 0-300 or 0-500 depending on the subject • Achievement levels – Basic, Proficient, Advanced • Data is disaggregated by subgroups

8. Features of TUDA • Provides district-level data to participating urban districts • Provide a common yardstick to measure student achievement in comparison to • Other urban districts • States • Large Central Cities • National Public Schools • Census Regions

9. NAEP 2009 Assessed Components

10. NAEP Instrument Design • Long Test, Short Booklet • Each student gets a small part of the test • No individual student scores • Test Questions • Multiple-choice • Open-ended • Background Items • Student, teacher, administrator questionnaires

11. Science Interactive Assessments • Science Interactive Computer Tasks (ICT) • ( One 40-minute extended task and two 20-minute short tasks) • Science Hands-on Tasks (HOTs) • (Two 20 –minute short tasks and one 40- minute extended tasks)

12. Pre Assessment Visits (PAV) • Meet with Westat Assessment Coordinator • Scheduled between January 6 through January 24, • 2009 • Allow about 2 hours • Confirm participating students

13. Pre- Assessment Visit (PAV) Packet Contents • Student Information Report—List of students selected • for NAEP as well as their demographic information • based on October FTE data • NAEP SD and ELL Questionnaires (www.naepq.com) • Roster of Questionnaires • If Grade 12, School Questionnaire • U.S. Department of Agriculture Letter • NAEP Logistics Questionnaire • NAEP Red Storage Envelope • Parent/Guardian Notification Letter

14. Preparing for the Pre-Assessment Visit (PAV) • Obtain current list of students from the Office of Student Assessment and Educational Testing. • Distribute SD and ELL questionnaires to teachers, who are directly involved with the SD and ELL students selected for the assessment. • Collect completed questionnaires prior to PAV • Complete the 2009 Logistics Questionnaire. • Prepare the parent/guardian notification letter. • Request testing locations.

15. Parent/Guardian Notification Letter • By law, NAEP requires that parents/guardians of all selected students be notified in writing about the assessment. • Notification must be signed by a school representative and dated on school letterhead stationary. • A copy of the letter should be faxed to The Office Student Assessment and Educational Testing and be given to the NAEP Westat Assessment Coordinator during the PAV. • Templates of this letter in English, Spanish, and Haitian-Creole will be provided to the schools in hard copy and posted on-line at http://www.fldoe.org/asp/naep/naep2009.asp

16. During the PAV The school NAEP coordinator will • Provide work space or area to review materials with • NAEP field staff • Provide NAEP field staff with a current student enrollment list provided to you by SAET • Verify student demographic information. • Confirm withdrawn and newly enrolled students. • Corrected NAEP Student Information Report • Provide SD and ELL questionnaires • Discuss and arrange accommodation sessions. • Receive NAEP Teacher Questionnaires. • Provide a copy of dated parent/guardian notification letter. • Finalize assessment logistics with NAEP field staff after they have completed their paperwork.

17. After the PAV The school NAEP coordinator will • Distribute the NAEP school and teacher questionnaires (the questionnaires can be completed online). • Send parent/guardian notification letters to all students selected for the assessment. • Notify the students of the assessment. • Notify the teachers of the assessment. • Place the NAEP Storage Envelope in a safe place.

18. Assessment Day Activities • Have the NAEP Storage Envelope available for the NAEP field staff when they arrive at the school. • Give completed NAEP teacher and school questionnaires to the NAEP field staff. • Make sure all sampled students arrive promptly. • Investigate reasons for student absences (e.g., suspensions, attending classes off campus, absences, etc.).

19. NAEP Inclusions and Accommodations • Schools may exclude students according to carefully designated criteria. • NAEP’s most frequent accommodations include: • Extra testing time • Individual or small group administrations • Large-print booklets • NAEP accommodations do not include reading passages or questions aloud on the NAEP reading assessment.

20. After the NAEP Assessment • Participate in a short debriefing interview with • the NAEP field staff. • Schedule a make-up session, if necessary. • Complete a short quality-control call with a • Westat staff member. Only 25 percent of • schools assessed will be called. • Retain the NAEP Storage Envelope and destroy • the contents on the last day of the academic • year. • Mail the provided postcard to Westat confirming • that the materials have been destroyed.

21. Important Dates for NAEP 2009

22. Information for Parents • If parents have questions or concerns about the NAEP assessment, please share the Sample Questions Booklet with them. • The booklets are available on the MySchool Web site at www.MyNAEP.com and will be distributed to the schools during the PAV.

23. Information for Teachers and Students • Videos available at the National Center for Education Statistics NCES: • Introducing NAEP to Teachers • Introducing NAEP to Students • http://www.nces.ed.gov/nationsreportcard/about/schools.asp

24. Best Practices for Improving Twelfth-Grade NAEP Participation • Includes: • Strategies effective in engaging Grade 12 students in NAEP • Talking points that principals can use with teachers and parents

25. Resources for NAEP NCES NAEP Website http://nces.ed.gov/nationsreportcard/ The Nation’s Report Cardhttp://nces.ed.gov/nationsreportcard/ Florida’s NAEP Website (Parent and Student Letter Templates) www.fldoe.org/asp/naep Sample questions, initial release website http://www.nationsreportcard.gov Examples of background questions http://nces.ed.gov/nationsreportcard/bgquest.asp NAEP School Coordinator Packet http://oada.dadeschools.net/TestChairInfo/96NAEPSchoolCoordinatorPacket.pdf NAEP SD and ELL Questionnaires www.naepq.com Information for Parents http://nces.ed.gov/nationsreportcard/parents NAEP Data Explorer http://nces.ed.gov/nationsreportcard/naepdata/ NAEP Questions Tool http://nces.ed.gov/nationsreportcard/itmrls/