NAEP 2015 Pre-Administration Workshop

1. NAEP 2015Pre-Administration Workshop Bobbie Bable bbable@doe.k12.ga.us 404-657-6168

2. NAEP Overview • The No Child Left Behind Act of 2001 requires states/districts who receive Title I funding to participate in the biennial NAEP assessment in reading and mathematics at grades 4 and 8. • Georgia law and State Board of Education rules require participation in all NAEP assessments. • Every school and student has some known chance of being selected for the sample.

3. NAEP Purpose • To measure student achievement in the context of instructional experiences. • To track achievement of fourth-, eighth-, and twelfth-graders over time in selected content domains.

4. NAEP Grade Levels and Content Areas • Developed frameworks and assessments • Reading - Economics • Mathematics - Civics • Science - Foreign language • U.S. History - Writing • Geography - The Arts

5. Who is required to take the NAEP? • Eligible schools in the state are randomly selected from groups of schools that have been stratified by variables such as: • Grades 4, 8, and 12 • Region • Minority enrollment • Extent of urbanization • Students within a selected school are sampled to select the list of students that will participate in the assessment.

6. Unique Features of NAEP • National testing program, same assessment in every state • Sample of schools to represent demographics of state • Students in selected schools are sampled • Each student is only assessed in one pre-assigned subject • Results for state or selected district only • Assessed subjects vary by year • Contracted assessment team • Six month results window • Results can be aggregated by demographic variables • Special research studies

7. NAEP Test Score Ranges • Average scale scores and achievement levels reported for reading, mathematics and science. • Scale scores • Range is 0-500 for reading and mathematics • Range is 0-300 for science • Achievement levels • Advanced, Proficient, Basic • Indicate the percentage of students within the total population, or in a particular subgroup, that meet or exceed expectations of what they should know and be able to do.

8. 2015 Assessment and Georgia Sample • 2015 assessments • Reading, mathematics, and science for grades 4, 8, and 12 • Technology based assessment (TBA) pilot for grades 4, 8, and 12 • Trends in International Mathematics and Science Study (TIMSS) for grades 4, 8, and 12 • Georgia Sample • Main NAEP: 386 schools (includes 65 Atlanta schools) • Grade 4 – 167 schools • Grade 8 – 159 schools • Grade 12 – 60 schools • TIMSS: 23 schools

9. NAEP Important Dates • District Superintendents notified of school selection in June • System Test Coordinators notified of school selection and assessment dates in June • Principals of sampled schools notified in August and school coordinator contact requested; reschedule requests being taken now • Contact from NAEP assessment team in early December • Main NAEP assessment – last week in January through first week of March • January 26 to March 6 • TIMSS assessment • March 30 to May 29

10. What is MyNAEP? • MyNAEP serves as your primary resource and action center for the NAEP assessment. • All preassessment activities are completed via MyNAEP. • The site contains confidential information, so all users will be prompted to accept a confidentiality agreement. • Requires a username and password. www.mynaep.com

11. How do I register for the site? • Each school received a MyNAEP registration ID in a letter or email in early August. • Multiple school staff can use the registration ID to register for the website. • Select Please register, then enter the registration ID in the text box to get started.

12. How do I register for the site? • Make sure to select the correct role (school coordinator) during the registration process. • A username will be assigned to you, but you will create your own password. • Thepassword must have: • 8-14 characters • At least one of each: • uppercase letter • lowercase letter • numerical digit • special character (*!,~%@#$%?^+=&) • Sample password: KnightsR#1

13. Registering for multiple schools • If you are a school coordinator for more than one school, please follow these steps: • Register using one of the registration IDs assigned to you. • After successfully registering, use the “Register More Schools” option on the left-hand menu. • Enter each additional registration ID.

14. What do I need to do as School Coordinator? Provide School Information Submit the Student List Prepare for the Assessment Support Assessment Activities Wrap Up

15. MyNAEP Activity Timeline Register for MyNAEP Provide School Information Prepare for Assessment Support Assessment Activities Wrap Up 1 2 3 4 5 Now August - September December - January One week before the assessment Last day of school or by June 1 Register for MyNAEP Provide School Information Submit Student List Prepare for Assessment Support Assessment Activities Wrap Up 1 2 3 4 5 6 Now August - September October - November December - January One week before the assessment Last day of school or by June 1

16. Prepare for Assessment • An assigned NAEP representative will contact you in early December. • A preassessment packet will arrive in your school on December 2nd. • Shortly after, the NAEP representative will contact you to discuss how to complete the prepare for assessment activities • The NAEP representative will schedule a preassessment review call.

17. Prepare for Assessment • The Prepare for Assessment menu includes 7 activities. • Only school coordinators have full access to this menu. • The list of sampled students will be posted under Prepare for Assessment on December 8th. Due: Before the preassessment review call List of sampled students available in the Demographic Data Report

18. Prepare for Assessment: How does it work? • Each activity has a section called Watch Tutorial and Get Started. • This section explains the information you will need to collect at your school before starting the MyNAEP activity. Review the tutorial and instructions, then select Finish to move on.

19. Prepare for Assessment: How does it work? • Each task should be completed in chronological order. • The menu serves as a “virtual checklist.” • Checkmarks will appear after activities are completed. • White checkmarks indicate information that will be confirmed by your NAEP representative during the preassessment review call.

20. Prepare for Assessment: How does it work? • This first 4 activities will be available on December 8th. • Update List of Sampled Students • Include SD/ELL Students • Notify Parents • Manage Questionnaires • The rest will be available in January. • Submit Current Roster • Plan for Assessment Day • Encourage Participation

21. Prepare for Assessment: Update List of Sampled Students • Review the list of sampled students, and make the following updates. • Identify any students who are withdrawn, no longer enrolled, foreign exchange, not attending classes on campus, not in the selected grade. • Update any missing or incorrect demographic information. • Update classifications for students with disabilities and English Language Learners.

22. Prepare for Assessment: Include SD/ELL Students • Provide additional information about students with disabilities (SD) and English language learners (ELL). • How each student is assessed on the state assessment. • Testing accommodations that each student typically receives. • The IDEA category that best describes the student’s disability. • How long each student has been enrolled in U.S. schools (ELL). • Level of English proficiency (ELL).

23. Prepare for Assessment: Include SD/ELL Students • School coordinators can assign this task to SD/ELL specialists.

24. Prepare for Assessment: Notify Parents • Download and distribute the parent/guardian notification letter template. • Customize text and include school letterhead. • Verify that parents/guardians of all sampled students were notified by entering the date the letter was sent. • Upload an electronic copy of the customized parent letter.

25. Prepare for Assessment: Manage Questionnaires • Enter the names and email addresses of questionnaire recipients, then send links to online questionnaires. • The school questionnaire is assigned to the principal. • Teachers at grade 4 & 8 schools should be assigned teacher questionnaires. • Teachers of American Indian/Alaska Native students will be assigned an additional questionnaire.

26. Prepare for Assessment: Manage Questionnaires • Questionnaires for the 2015 assessment are shown in the table below. *Note: Schools and teachers will only receive these questions if the sample includes any American Indian/Alaska Native (AI/AN) students.

27. Prepare for Assessment: Submit Current Roster • Create an Excel list of all currently enrolled students after January 1, 2015. • NAEP uses this list to give newly eligible students an opportunity to be sampled. • The list should include the following information for each student: • State-level unique student ID *optional, no SSNs • First name • Middle name *optional • Last name • Month of birth • Year of birth

28. Prepare for Assessment: Submit Current Roster • School coordinators can assign this task to a school-level student data specialist.

29. Prepare for Assessment: Plan for Assessment Day • Assign a location and time for each assessment session and answer logistics questions. • Determine how students and teachers will be notified. • Plan SD/ELL student accommodation logistics. • Let the NAEP representative know where to park at the school, how to check in, and what to do if there is a weather delay.

30. Prepare for Assessment: Plan for Assessment Day • If your school has been selected for a special study, an extra link will appear. • Special studies for NAEP include the following: • National Indian Education Study (NIES) • Extended Student Questionnaire (ESQ) • Computer Access and Familiarity Study (CAFS) • Students selected for a special study will be asked to complete an additional questionnaire, which takes approximately 15 minutes.

31. Prepare for Assessment: Encourage Participation • Meet with the school principal and ask if it’s possible to use recommended strategies for informing students and teachers about NAEP. • Includes short 5 minute videos for teachers and students about the importance of NAEP.

32. Support Assessment Activities • Print reminders about the scheduled NAEP assessment. • Student appointment cards • Teacher notification letter • List of sampled students (attachment for letters) Due: One week before the assessment

33. Wrap Up • You will receive an email in late spring that contains links for this activity. • Confirm that you have shredded the red storage envelope that contains all student reports. • Participate in an optional feedback survey. Due: Last day of school or by June 1

34. Activity Timeline Recap • Your assigned NAEP representative will contact you in early December before the Prepare for Assessment activities begin. • Instructions, video tutorials, and live help will be available for each task. Register for MyNAEP Provide School Information Prepare for Assessment Support Assessment Activities Wrap Up 1 2 3 4 5 Now August - September December - January One week before the assessment Last day of school or by June 1

35. NAEP Resources • Live chat • Videos • Tutorials • In person training – Contact Bobbie Bable

36. NAEP Resources • NAEP website • All previously released results • Assessment schedules and policies • http://nces.ed.gov/nationsreportcard/ • NAEP Questions Tool • More than 2000 questions from previous assessments • Scoring guide • Actual student responses • Question performance data • http://nces.ed.gov/nationsreportcard/itmrlsx/default.aspx • NAEP Data Explorer • National, state, region, district, and subgroup results • Demographic survey data • http://nces.ed.gov/nationsreportcard/naepdata/

37. Questions?