Florida

1. Florida National Assessment of Educational Progress (NAEP) 2007 Assessments Michele Sonnenfeld NAEP State Coordinator Florida Department of Education

2. Florida What is NAEP and Why Do We Participate?

3. National Assessment of Educational Progress (NAEP) • The National Assessment of Educational Progress (NAEP), also known as “the Nation’s Report Card,” is the nation’s only monitor of what students know and can do in various subject areas. • NAEP is a survey designed to produce national- and state-level results and results for populations; it is not a testing program for individual students or schools. • NAEP is authorized by Congress and administered by the National Center for Education Statistics (NCES) in the U.S. Department of Education.

4. National Assessment of Educational Progress (NAEP) • "No Child Left Behind" legislation stipulates that states, districts, and schools within districts that receive Title I funds must participate in NAEP if selected. • Beginning in 2003, all states are required to participate in NAEP reading and mathematics in Grades 4 and 8. • Names of students and schools that are selected to participate are kept confidential.

5. National Assessment of Educational Progress (NAEP) • Since 1969, national NAEP assessments have been conducted periodically in reading, mathematics, science, writing, U.S. history, civics, geography, economics, and the arts. • Starting in 1990, state NAEP assessments have also been conducted. States that chose to participate received assessment results reporting student performance. • Florida has participated in state-level NAEP since 1990.

6. NAEP Design:Components The National Assessment of Educational Progress MAIN LONG-TERM National Public & Private (Grades 4, 8 & 12) National Public & Private (9, 13 & 17 yr olds) State Public (Grades 4 & 8) District -Trial Public (Grades 4 & 8)

7. Florida How are NAEP results reported?

8. Ways of Reporting NAEP Results • Scale scores • Achievement levels • Data disaggregated by • Subgroups (e.g., race/ethnicity, gender, SD, ELL) • State and regional comparisons • Background factors (i.e., school, teacher, and student)

9. Reporting Formats • Nation’s Report Cards • Snapshot Reports for states • Reports on special topics • Web releases • Summary data tables/NAEP Data Explorer • Released items and responses/NAEP Questions Tool • Electronic publications • Initial release website • Tools for analyzing data

10. Using NAEP • Who uses NAEP? • Educators • Policymakers • Media • How is NAEP used? • Track trends in performance • Make comparisons across states and with the nation • Compare subgroup performance across states and the nation

11. Florida How are schools selected to participate in NAEP?

12. NAEP Design: Sampling and Data Collection • Multi-Stage Stratified Random Sampling • Selection of schools • Selection of students within schools • List of schools are obtained from the NCES Common Core of Data (CCD). Visit the CCD Web site at http://nces.ed.gov/ccd.

13. NAEP Design: Sampling and Data Collection • Schools are grouped into strata based on school location and minority enrollment. • Within strata, schools are ordered by a measure related to achievement. • The sample is selected systematically from the ordered list.

14. Florida What will happen prior to the NAEP assessment day?

15. Prior to the NAEP Assessment • The Florida Department of Education notified your District Coordinator of Assessment that your school was selected to participate in NAEP. • In the fall, you completed a NAEP Data CollectionForm on line via the MyNAEP website at www.mynaep.com. • NAEP field staff started contacting the school test coordinators on 12/11/06 to set a date and time for the Pre-Assessment Visit (PAV).

16. Prior to the NAEP Assessment • A PAV will be scheduled sometime between 1/2/07 and 1/19/07. • The purpose of the PAV is to gather data to prepare for assessment day. • A packet of materials for the PAV will arrive in your school by 1/2/07 (unless it is a school holiday). The enclosed Instructions For theSchool Coordinator brochure will assist you in preparing for the PAV. • The PAV should take approximately two hours – one hour of preparation by the NAEP field staff and one hour of meeting with you. • Note: The visit could take longer if the school test coordinator has not prepared for the PAV

17. Preparing for the PAV • Student Information Report – List of all students selected for NAEP, as well as their demographic information. Prior to the PAV, you need to: • Collect any missing demographic information • Review student demographic data for accuracy • Determine if there have been any changes in students identified as Students with Disabilities (SD) and/or English Language Learners (ELL) • Identify which students, if any, have withdrawn or graduated or are not enrolled in the grade to be assessed • Make all corrections directly on the report with a number two pencil

18. Preparing for the PAV • SD and ELL Questionnaires • Your Pre-Assessment packet will include a questionnaire for each student in the sample that was identified as SD and/or ELL. • The teacher who is most familiar with the identified student should fill out the questionnaire. • The questionnaires need to be completed by the teacher and returned to you prior to the PAV. • If you have additional students in the sample that are identified as SD or ELL, let the NAEP field staff know so they can bring you additional questionnaires.

19. Preparing for the PAV • Print out a current list of students enrolled in the selected grade. This list should include first and last names and birth dates. • Notify parents/guardians and keep a dated copy of the notification. The NAEP field staff will need to collect a copy of this document during the PAV. • Complete the Logistics Questionnaire.

20. Parent/Guardian Letter • Parent/Guardian letters will need to be sent home to students selected to participate in the NAEP assessment prior to the PAV. • Please refer to the copy of the parent/guardian letter that was provided to you. • To access an electronic copy of the parent/guardian letter, log on to www.mynaep.com or http://www.firn.edu/doe/sas/naep/naep2007.htm. • You can log on to the MyNAEP web site with your user name and password (obtained when you completed the Data Collection Form). • If a parent/guardian does not want their child to participate in NAEP, they need to notify you in writing. Participation is voluntary and confidential.

21. Parent/Guardian Letter • The parent/guardian letter needs to be sent home on school letterhead with the date that it was sent. Letter can be sent home with the students. • If a parent or guardian does not want his or her child to participate in NAEP, you need to be notified in writing. • Please send a copy of the letter to msonnenfeld@fldoe.org and to your District Coordinator of Assessment.

22. Parent/Guardian Letter If parents/guardians have questions or concerns about NAEP, please share with them the Sample Questions Booklet.

23. Pre-Assessment Visit (PAV) • At the beginning of the PAV, the NAEP field staff will meet with you briefly to collect the information you completed prior to the PAV: • Printed list of current students in the selected grade • Corrected Student Information Report • SD and ELL Questionnaires • Copy of the parent/guardian letter

24. Pre-Assessment Visit (PAV) • The NAEP field staff will then ask for a place where they can complete their paperwork. • Afterwards, they will want to meet with you to: • Verify withdrawn students and new enrollees • Determine accommodations for SD and ELL • Distribute the school and teacher questionnaires • Discuss the logistics of the assessment day

25. SD and ELL • If the student participates in the FCAT, even if he or she needs accommodations, he or she should also participate in NAEP. • If the student requires an assessment where the questions and answer selections are on the same page, they can participate in NAEP as all NAEP booklets are structured in this fashion.

26. SD and ELL • The exclusion rates will be recorded after the PAV and will be monitored by the NAEP State Coordinator for high rates. • NAEP field staff will administer all accommodated sessions. These sessions may have to occur after the standard administration. • If an SD and/or ELL student feels more comfortable with a known test administrator, then the teacher can administer the assessment with the NAEP field staff in the room.

27. After the PAV • Distribute the school and teacher questionnaires that the NAEP staff give to you during the PAV (the questionnaires can be completed online). • Notify the students selected for the assessment. • Notify the teachers about the assessment. • Place the NAEP Storage Envelope in a safe place where it can be found in the event you are absent from school on the day of the assessment.

28. Supporting NAEP in Your School • Since state and national policy is set based on the NAEP results, it is very important to make sure the teachers in your school support the assessment. • A short video that you can share with your teachers to help them understand the importance of NAEP can be accessed through http://www.firn.edu/doe/sas/naep/naep2007.htm.

29. Supporting NAEP in Your School • Also, it is important for students to take the assessment seriously and put forth their best effort. • A short video that you can share with your students to help them understand the importance of NAEP can be accessed through http://www.firn.edu/doe/sas/naep/naep2007.htm.

30. Florida What will happen on the NAEP assessment day?

31. NAEP Assessment Day • The NAEP assessment team will arrive at the school approximately an hour and a half prior to the scheduled assessment time. • The NAEP assessment team will need a staging area throughout the assessment day. • The NAEP team will administer all assessments, including the accommodated sessions.

32. NAEP Assessment Day • NAEP does not need proctors for the assessments. • Classroom teachers and/or other school personnel are welcome and encouraged to stay in the room during the NAEP assessment. • School personnel will have to sign a confidentiality agreement if they observe the NAEP assessment.

33. NAEP Assessment Day • Your biggest role on assessment day is to make sure all students in the sample arrive at the designated assessment locations. • You may need to work with your attendance staff to confirm which students are absent on the day of the assessment. • A make-up session will need to be scheduled if less than 90% of the selected students participate in the assessment. • The 90% does not include students who have withdrawn, students whose parents have refused participation, or students who were excluded.

34. Florida What will happen after the NAEP assessment?

35. After the NAEP Assessment • A NAEP representative will conduct a short interview with you to obtain any comments about NAEP in his/her school. • If needed, a make-up assessment day will be scheduled. • You will destroy the contents of the storage envelope on the date listed on the front of the envelope. • You will mail the postcard provided by the NAEP field staff to NAEP stating that the materials have been destroyed.

36. NAEP 2007 Assessment Components • Assessment window: January 22 – February 22, 2007 • Subjects to be Assessed: • Grade 4 – Reading and Mathematics • Grade 8 – Reading, Mathematics, and Writing • Grade 12 – Reading and Writing • Special Studies: National Indian Education Study (NIES) for grades 4 and 8 only

37. NAEP 2007Assessments • Results will be reported at the state and national level for Grades 4 and 8 in October 2007. Only national-level results will be reported for Grade 12. • The assessment will take approximately 90 minutes of student time (two 25 min. subject matter blocks and survey questions). • Students will only be assessed in one subject. • Reading, mathematics, and writing can all be administered at the same time in the same room.

38. NAEP 2007 National Indian Education Study (NIES) NIES is a two-part study: • Part I (Assessment) – NAEP Reading and Mathematics assessment of American Indian/Alaska Native (AI/AN) students in Grades 4 and 8 • Purpose: To increase reliability of NAEP reading and mathematics achievement data obtained on AI/AN students • Student time: Approximately 90 minutes

39. NAEP 2007 National Indian Education Study (NIES) NIES is a two-part study: • Part II (Survey) – Indian Education Survey focuses on issues of AI/AN students’ education • Purpose: To collect information on educational experiences of AI/AN students from students, teachers, and administrators of selected schools • Student time: 15 to 20 minutes to complete the survey

40. NAEP 2007 National Indian Education Study (NIES) The results of the study will allow us to: • Describe the condition of education of AI/AN students in 4th and 8th grade. 2. Report NAEP performance by regions, states, school location, and density (high/low AI/AN population). 3. Assist the federal government in continuing to work with education agencies to strengthen AI/AN educational programs across the country. 4. Help education agencies and parents develop programs that ensure AI/AN students meet the same academic challenges as all other students.

41. NAEP 2007 National Indian Education Study (NIES) • NIES includes all AI/AN students participating in 4th and 8th grade NAEP Reading and Mathematics. • All selected schools across all states that have an AI/AN student will be included. • It is expected that over 4,000 students from 1,500 schools per grade will be included in reporting achievement for NIES. • As of 2007, NIES is considered part of NAEP and is no longer a separate study; it will be administered at the same time as NAEP.

42. Florida National Assessment of Educational Progress (NAEP) Michele Sonnenfeld NAEP State Coordinator Florida Department of Education (850) 245-0787 Michele.Sonnenfeld@fldoe.org