NECAP Test Administration Workshop Science: Grades 4, 8 & 11

1. NECAP Test Administration WorkshopScience: Grades 4, 8 & 11 April 10, 11, 14, 15 & 16, 2008 New Hampshire Department of Education and Measured Progress

2. NH DOE Staff Contacts for NECAP Information Deb Wiswell, Administrator, Bureau of Accountabilitydwiswell@ed.state.nh.us603-271-3828 Jan McLaughlin, Science Curriculum & Assessment jmclaughlin@ed.state.nh.us 603-271-3856 Gaye Fedorchak, Interim Director of Assessment Supervisor of NH Alternate & ACCESS gfedorchak@ed.state.nh.us 603-271-7383 Tim Kurtz, Director of Curriculum and Assessment (Returning June 12, 2008) tkurtz@ed.state.nh.us 603-271-3846 NH Department of Education, 101 Pleasant Street, Concord, NH 03301-3860

3. NECAP Service Center: 1-877-632-7774

4. The purpose of this workshop is to ensure that… • Students and staff are prepared for a positive and productive assessment experience. • Standardized testing procedures are consistent across all schools. • Accommodations are provided appropriately for students who need them. • Secure test materials remain secure at all times. • Test materials are returned according to specifications to expedite the return of test results. • Test coordinators and test administrators are prepared to carry out all of their responsibilities.

5. NECAP Science: Important Dates

6. Who should be tested in Science? (page 4) All students enrolled in grades 4, 8, and 11 as of May 12, 2008 Exceptions are students who… • Have a NH-Alt portfolio in Science submitted to the NH DOE representing learning and progress during the 2007–2008 school year (NH-Alt Portfolio pick up date is: May 9th) • Qualify for state-approved special considerations

7. NH-Alt Assessment: Who Takes What and When? For more information on NH-Alt, go online to: http://www.ed.state.nh.us/assessment and click “NH-Alternate Assessment”

8. NH State Approved Special Considerations • Students can be excused from the Science assessment for certain medical emergency conditions, which may include: • A serious and fully incapacitating medical emergency or condition that extends across the entire test window; • Acute illness or recovery from a serious injury that is fully incapacitating and extends across entire test window (students with broken arms can usually participate with accommodations); • A recent death in the family Note: If you have a NH-Alt student who arrived from another state or from a privately funded placement after February 1, 2008, contact: Gaye Fedorchak, gfedorchak@ed.state.nh.us

9. NH State Approved Special Considerations Conditions that do not qualify: Chronic medical fragility, or Acute illness or injury that does not extend across entire test window. Missed test sessions can be made up. A general rule: If the student can receive instruction, the student can participate in state assessment. Medical Emergency Procedural Information and Forms are now available online. To access them, go to http://www.ed.state.nh.us/NECAP Select “Spring 2008 Science Materials, Information and Forms”

10. Discussion and Recommendations Preparing students and staff for a successful NECAP experience Discussion Topics: • Preparing students for testing • Introducing the test to students • Encouraging appropriate participation • Scheduling sessions • Scheduling staff • Providing Accommodations • Using the optional reports codes • Other ideas, strategies, issues and options

11. Science Test Design: Grades 4, 8 & 11 Session 2:Estimated time needed: 45 Minutes (Schedule 90 Minutes*) 26 Multiple Choice 1 point each 3 Constructed Response 4 points each Session 1: Estimated time needed: 45 Minutes (Schedule 90 Minutes*) 25 Multiple Choice 1 point each 3 Constructed Response 4 points each *For Sessions 1 and 2, all students are allowed an additional 45 minutes without an accommodation. 90 Minutes includes this extra time. Beyond 90 minutes, an accommodation is required.

12. Science Test Design: Grades 4 & 8 (Session 3) Session 3: Inquiry Task Estimated set up time: 15–20 Minutes task set up beforestudents arrive, plus Estimated time needed with students: 75 Minutes (Schedule 120 Minutes with students**) 7 Inquiry TaskQuestions: 2-point Short Answer & 3-point Constructed Response **For Session 3, additional time may be required in any or all parts of this session – 120 minutes class time with students includes this extra time. All students must start the last section(individual student work) together.

13. Science Test Design: Grade 11 (Session 3) Session 3: Estimated time needed: 45–60 Minutes. (Schedule 60 Minutes**) 7 Inquiry Task Questions 2-point Short Answer & 3-point Constructed Response **For Session 3, students should complete the Inquiry Task and all questions within 60 minutes. Beyond 60 minutes on the Grade 11 Inquiry Task, an accommodation is required.

14. Teacher Judgments of Student Proficiency (page 8) What is this? Teachers are asked to submit online their independent judgments of student proficiency on the content standards. Why? This independent teacher judgment process is designed to aide the setting of proficiency standards in Science. How? Schools will receive a username and password to log in to a secure Web page with student rosters. Who?Teachers who know the student’s work in science will select a single Achievement Level Description for each student listed. Teachers can then select low, medium, or high performance within the achievement level. When? Please submit online anytime from May 1–29. More Info?Go to www.ed.state.nh.us/necap and select “Spring 2008 Science Materials, Information and Forms”

15. Test Preparation: What is supported by research? • Langer, J.A., American Educational Research Journal, 2001 • Two approaches were studied… • 1) Schools that treated test preparation as a separate activity, involving practice tests and test taking hints. • 2) Schools that integrated test preparation with the curriculum by analyzing test demands and reformulating curriculum as needed to be sure that students would develop the knowledge and skills needed for strong performance on tests.

16. Test Preparation: What is supported by research? • Findings… • Low performing schools treated tests as an additional hurdle separated from curriculum – they implemented the first approach. • High performing schools had teachers and administrators who deconstructed and analyzed test items and content standards – they implemented the second approach and obtained higher levels of literacy.

17. Suggested Use of the Practice Tests Practice Tests are most useful for familiarizing students with test format, item types, and test taking strategies. Examining possible student misconceptions Share the information from the Teacher Tips documents The best test preparation is good teaching and building a positive learning environment in the classroom. The science practice tests are available online at www.ed.state.nh.us/necap Look under: “NECAP Test Preparation Support Materials” Select: “Spring (Science) Test Resources”

18. Using the Optional Reports Codes • For districts and schools to group students for analysis at the local level • Groupings based on any factor of interest to the school/district (e.g., class, teacher, feeder school, instructional program) • Six rows = six factors of interest per student • No more than one circle bubbled per row • Schools/districts develop their own coding system or choose not to use field • Keep a record of the key used (NH DOE and Measured Progress will not have copies of your key.) • Data is included in the student data file of NECAP results at the district level. No actual “Report” is produced.

20. School Test Coordinator’s Responsibilities (page 2) Primary responsibilities: • Serve as contact person with Measured Progress & the NHDOE • Ensure that any required additional student labels are ordered • Coordinate all test-related activities • Prepare test administrators to administer NECAP according to directions in the Test Administrator Manual • Observe and monitor test administration in your school • Oversee the inventory, distribution, collection, and return of all test materials • Overall, help the principal maintain test security and ensure compliance with test administration procedures

21. Test Security (page 3) • Test Security relies on the professional integrity of everyone in our schools across all three states. No student should be advantaged or disadvantaged based on how or where the test is administered. • All Student Test Booklets and Student Answer Booklets are secure and may not be copied or duplicated in any way or kept by the school after testing is completed. • Using secure test material to prepare students in any way for this test administration is a violation of test security and testing procedure.

22. Test Security Procedures • Ensure that all school staff who will be involved with the assessment understand the importance of test security and adherence to standard test administration procedures. This includes staff administering any accommodations. • Keep testing materials in a locked location when not in use. Do not remove testing materials from the school. • Inventory test booklets when they arrive at your school. Keep an on-going inventory of materials as they are distributed and returned each day. Although not required, it may be beneficial to have test administrators sign tests in and out each day. • Never leave students alone with testing materials. Do not allow students to carry test materials unescorted from room to room. • Complete and submit the online Principal’s Certification of Proper Test Administration. Keep a copy on file.

23. Breaches in Test Security • Teachers must report any concerns about breaches in test security to the test coordinator and/or principal. • The test coordinator/principal is then responsible for reporting breaches to the district superintendent and to Gaye Fedorchak at the NH DOE (603-271-7383).

24. Checklist for Principals and Test Coordinators (page ii) • Before Testing • During Testing • After Testing A checklist for test administrators is provided in the grade-specific Test Administrator Manuals

25. Before Testing Preparation for Test Administration(pages 4–5) Manuals • Read the Principal/Test Coordinator and Test Administrator Manuals Student Participation and Accommodations • Read the Accommodations, Guidelines, and Procedures: Administrator Training Guide, which covers these topics: • Who should be tested • Determining how students will participate using accommodations • Documenting and bubbling in accommodation codes

26. Accommodations Who is eligible for testing accommodations? ALL students

27. Accommodations • Accommodations do not change what we expect students to know and be able to do. • Test accommodations are based on individual student needs and classroom assessment practice; they are not for the use by an entire classroom or category of students. • They should not give students unfair advantages; rather they are meant to remove barriers that may exist due to a student’s learning style or disability. • Test administrators must be trained in their use. This includes special education assistants and substitutes. • Students should have experience using the accommodation(s). Preferably, they should be accommodations the student uses in day-to-day classroom instruction and assessment.

28. Appendix 5 Table of Standard Test Accommodations (page A-6)

29. 2008 Updates to Science Accommodations C. Presentation Formats: • C-4: Read aloud – Science Added • C-12: Word-to-word (ELL students) – Science Added • C-13: Use of Abacus (to support visual impairment) – Science Added D. Response Formats: • D-5: Dictating Responses – Science added along with reference to “dictating observations during Science Inquiry” • D-6: Use of Assistive Technology to Dictate – Science added along with reference to “dictating observations during Science Inquiry” F. Modifications: • F-1: Use of a Scientific or Graphing Calculator on Session 3 of Science is noted to be a non-credited Modification (This is not an accommodation; student work will be invalidated.)

30. Accommodations Support Manual: Accommodations, Guidelines, and Procedures Use with: Table of Standard Test Accommodations: Updated April 2008 • Available at: http://www.ed.state.nh.us/NECAP Under “NECAP Test Preparation and Support Materials” • Using the Table of Standard Test Accommodations, school teams may choose in advance, and use without state approval, any standard accommodation listed in categories A, B, C, or D. Use of Other Accommodations (E) requires written approval for credit to be granted. (Request form available online.) • After testing is finished, all accommodations actually used during testing must be recorded on page 2 of the Student Answer Booklet.

31. Accommodations Requests for the use of Other Accommodations (E) • Contact state DOE for review and approval before testing (Form online at: www.ed.state.nh.us/NECAP) • Accommodation(s) must be consistent with those used in student’s regular classroom or student has experience using the accommodation prior to the assessment • If the requested accommodation is found to be comparable to a standard accommodation, written approval will be given and student work fully credited • Student work done using category A, B, C, D, or approved E accommodations will be fully credited and scored.

32. Modifications • If state review determines that your request for an “Other Accommodation (E)” will change what the test measures, the state will respond in writing that use of this procedure will produce a test “modification” and must therefore be coded as a “Modification (F)” • Use of a “Modification (F)” will result in no credit given for student work during test sessions in which this modification was used. • Any “Other” Accommodation not registered as approved by your state department of education will be treated as a “Modification (F)”.

33. Accommodations • Expanded information, guidance and forms for choosing, planning, requesting, and using accommodations is available at: www.ed.state.nh.us/NECAPin a printable manual called: Accommodations: Guidelines and Procedures (Contains NH Form – Request for Use of Other Accommodations) • Contact: Gaye Fedorchak at: gfedorchak@ed.state.nh.us, or call: (603) 271-7383 for more information. • Due Date: absolutely no later than May 14, 2008.

34. Scheduling Test Sessions (pages 6–8) • All testing, including accommodated sessions and makeup sessions, must occur within the testing window (May 12–29, 2008). • Test sessions must be scheduled and given in the order presented in the Student Test Booklet. • Students who miss a test session may resume testing as soon as they return to school, taking the same session as their classmates. They should make up the missed session as soon as possible. This is the only case when tests or test sessions may be given out of order. • All grade-level classrooms in the school must follow the same testing schedule. To the extent possible, districts should coordinate testing to avoid possible breaches in test security. Schools do not need to report their testing schedule to the NH DOE.

35. Scheduling Test Sessions 1 & 2 (All grades) • NECAP science sessions 1 & 2 are designed to be completed by most students in approximately: • 45 minutes for grades 4, 8, and 11 • Test sessions may be no shorterthan these minimum time limits. • All Students are allowed an additional 45 minutes up to a total of 90 minutes. Schedule 90 minutes for each session. • The additional 45 minutes can be given to all students if needed, without an accommodation. • Only those students with an extended time accommodation (B-3) may be permitted more than 90 minutes to complete a session. • If all students finish Session 1 or Session 2 before the 90-minute window has ended, testing may be concluded for that session.

36. Scheduling Test Session 3: Inquiry Task At grades 4 & 8, the Inquiry Task requires 15–20 minutes of setup time before students arrive. This is in addition to the times noted below. Grade 11 does not require any setup time beforehand. • Session 3 is designed to be completed with most students in approximately: • 75 minutes for grades 4 & 8 • 60 minutes for grade 11 • Test sessions may be no shorter than these minimum time limits. • All Students at grades 4 & 8 are allowed additional time. It is recognized that in the first operational administration of a task of this type, additional time may be required in any or all parts of this session • Schedule 120 minutes for grades 4 & 8 (see chart on next page)

37. Session 3: Grades 4 & 8

38. Session 3: Grade 11

39. Testing Schedules (pages 7–8) Grades 4 and 8 • Sessions 1 & 2: Schedule 90 minutes • Session 3, Inquiry Task: Schedule 120 minutes • Student Questionnaire: Schedule 20 minutes Grade 11 • Sessions 1 & 2: Schedule 90 minutes • Session 3, Inquiry Task: Schedule 60 minutes • Student Questionnaire: Schedule 20 minutes

40. Sample Testing Schedule: Grades 4 & 8

41. Sample Testing Schedule: Grade 11

42. Student ID Labels(page 9) • Labels created for students based on March i4see submissions • 2 identical labels provided for students in Grades 4, 8, and 11 (one for Student Answer Booklet, one for Student Test Booklet. No label is required for the Task Booklet at grades 4 & 8.)

43. Student ID Labels(page 9) For Students WITH a Label: • 2 fields MUST be correct in order to use label (student name and school name) • If either of the 2 fields are incorrect, DO NOT USE the labels. Throw them away. Follow procedure for ordering additional student labels. • Student ID Labels can still be used with incorrect grade or date of birth. • Student ID Labels should be affixed to the covers of the Student Test Booklets and Student Answer Booklets prior to testing.

44. Sample Student ID Label

45. Student ID Labels (page 9) Student ID Labels for students NOT in your school: • Labels are NOT transferable between schools. • Throw away any labels provided for students not enrolled in your school. • DO NOT forward these labels on to other schools. • DO NOT affix these labels to Student Answer Booklets.

46. Student ID Labels (page 9) Ordering Additional Student Labels: • Schools may order additional labels for students who did not receive labels in the original shipment. • Schools may also order additional labels for students with incorrect student or school name. • All orders must be submitted to your i4see contact by May 13, 2008. • If orders for additional labels are not submitted by May 13, 2008, you must complete the student information on pages 1 and 2 of the Student Answer Booklet.

47. Preparing Student Test and Answer Booklets for Testing(page 10) • All booklets will be shrink-wrapped in packs. • Do not re-sequence test booklets or answer booklets. • Student Answer Booklets for grades 4,8 & 11 come inserted in the Student Test Booklet, paired by form.

48. Preparing Student Test and Answer Booklets for Testing(page 10) • DO NOT separate the Student Answer Booklets from the Student Test Booklets. • If the booklets do become separated, you will need to match the form number on the front cover of the Student Test Booklet with the bracketed portion of the number printed on the bottom right corner of the Student Answer Booklet. • Count the booklets to verify that the quantity received matches the quantity sent. Call Measured Progress if your count does not match the quantity indicated on the Material Summary form sent by Measured Progress. • The unique serial numbers on test booklets and answer booklets are not designed to match.

49. Preparing Student Test and Answer Booklets for Testing(page 10) For students WITH Student ID Labels: • Affix the first label to the front cover of the Student Test Booklet in the space provided. • Affix the second label to the front cover of the Student Answer Booklet in the space provided.

50. Preparing Student Test and Answer Booklets for Testing(page 10) For students WITHOUT Student ID Labels: • Write student name, school name, and district name on the cover of the Student Answer Booklet. • Write student name on the front cover of the Student Test Booklet. • If you ordered additional labels and are waiting for them to arrive, enter the student’s name, school name, and district name in the box in the lower right corner of the Student Answer Booklet titled “AFFIX STUDENT ID LABEL HERE”. Once the label arrives, place it on the box over what has been written. • If no Student ID Label is expected, complete the student information on pages 1 and 2 of the Student Answer Booklet.