Student Success

1. Office of Superintendent of Public Instruction Student Success Proctoring the Spring 2011 Measurements of Student Progress (MSP) Grades 3–8 Paper/Pencil This presentation is provided to assist in the training of proctors and should be augmented with special consideration appropriate for your local district Critical Information for Proctors March 23, 2011

4. Errata Grade-Band 3-5 Page 116

5. Updates from 2010 • Accommodated  kits for students registered through the WAMS Online Test Registration system include a Pre-ID standard form test booklet. • Test booklet labels and Return Shipping labels are color coded to ensure that receipt and scoring of all returned material is accurately processed. • The latest version of the Washington State Accommodations Guidelines for Statewide Assessments combines IEP, 504 and ELL accommodations. • Test booklet back covers (demographic page) have been revised. Student demographic and test status are now specific to the grade level and content. • Proctors sign and submit Test Security Assurance Forms. The completed form must include an explanation of boxes checked “No” and notation of missing materials.

6. Part 1—Overview • The Assessments • Test Preparation • Question Format • Response Formats and Tools Intent of the Assessment: To ensure the best opportunity for students to Demonstratewhat they know and are able to do. Page number reference in the Directions for Administration manual Page~ 2 - 6

8. It is desirable for students to be given a certain amount of practice so they will be familiar with the format of questions on state assessments. Students need to be given practice with multiple-choice, short answer, completion and essay formats in regular instructional activities. Such test preparation activities should be viewed as being a continual process, not something that is only done immediately prior to testing. Students who will be testing online must be provided at least one opportunity to review the Online Demo and Tutorials for the particular subjects in which they will test. Test Preparation Changes for 2010 and Beyond http://www.k12.wa.us/assessment/StateTesting/default.aspx Teacher Resource Tool available at http://www.k12.wa.us/teacherresourcetool/default.aspx Page~ 3 -5

10. MSP Question Format Multiple-choice items have either three (grades 3, 4 and 5) or four (grades 6, 7 and 8) response options. For these questions, students must choose the best answer and completely fill in the circle next to the answer. Any unwanted marks must be erased completely. Short-answerquestions ask students to supply the answer. Dependent on content area, answers may be in the form of words, phrases, sentences, numbers and/or pictures/diagrams. Completion questions ask students to supply the answer, which may be in the form of a word, phrase, short sentence and/or numeric answers on the answer line or in the box provided. Essayquestions in writing at grades 4 and 7 require students to write an essay in response to two prompts. Stand-alone questions on the reading assessments are not connected with a passage. Stand-alone questions on the science assessments are not connected with a scenario. Stand-alone questions ask students to choose the best answer or write a word or phrase for completion. Review sample questions at the beginning of each content area in the DFA manuals Page~ 5

11. Response Formats and Tools • Only No. 2 pencils may be used on state assessments. These procedures also apply to the rough drafts and final copies of writing assessments. • This limitation is based on scoring and testing protocols. Scanning of test booklets may be compromised by use of certain writing instruments. Further, the use of a particular writing instrument may guide or clue a student to a particular type of prewriting activity, in turn influencing the student’s response. • Students may use a No. 2 pencil to underline or check/circle items or key words for future reference, but care should be taken not to make marks near circles on multiple choice questions or penetrate the paper. These procedures also apply to the rough drafts and final copies of writing assessments. Page~ 6

13. Test Security State Laws Governing All test content is confidential and secure. No part of any test content may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording or placement in any information storage and retrieval system. This includes but is not limited to e-mail and text messaging. Ensuring Test Security Test material must be maintained in a secure manner and not revealed to students prior to testing. Students must not be given inappropriate assistance during the time they are taking the test. The test has to be maintained in a secure manner before and after administration because test questions are reused over time. **Staff are not permitted to read, inspect, discuss or transmit secure test content** Pages~7-8

14. Confidentiality and Generally Recognized Standards • Confidentiality • Follow your building testing security plan • Ensure confidentiality of test booklets under your control • Generally Recognized Standards • Ensure access, not advantage • Provide appropriate allowable accommodations Pages~ 8-9

16. Teachers are expected to provide students with an opportunity to acquire the knowledge and skills that will be assessed, primarily by providing students with a rich instructional program. Teachers may not, under any circumstances, use secure test content for instruction of students. Teachers shall maintain the confidentiality of individual students’ results. Teachers may help students improve test-taking skills by: Teaching students test-taking strategies; Providing practice assessments that demonstrate various item formats; and Using resource materials such as assessment questions from the public domain. Responsibilities of Teachers Page~ 9-10

17. Test proctors are educational practitioners who: Must attend required training and read all assigned training materials; Provide a positive test taking environment; Administer assessments according to the Directions for Administration manual and any supplemental materials provided by OSPI; Ensure that assessment documents are given only to the student identified in the coding; Maintain confidentiality concerning secure content; Document and report any testing irregularities/breach in test security; Sign and submit Test Security Assurance Forms. The completed form must include an explanation of boxes checked “No” and notation of missing materials. Examples of Prohibited Activities Reviewing, revealing or copying test content. Causing achievement to be inaccurately measured or reported. Copying or reading student responses. Responsibilities of Test Proctors and Staff Pages~ 10

19. Because cell phones, iPods® and other communications devices have the capability of transmitting secure test content, they must be turned off and kept out-of-view and out-of-reach, until the testing session has completed and secure materials have been collected. Use of cell phones during testing will result in an irregularity and possible invalidation. It is important that school administrators and staff establish and communicate this policy to students. Backpacks, bags and purses must be kept a distance from the student so that items may not be retrieved without leaving the seat. Communication Devices and Backpacks Page~11

20. Part 3—A: Preparation for Testing • Participation in Testing and Special Education • MSP/WAAS Participants • New Non-English Proficient (NNEP) • Absenteeism Pages~ 13-17

21. MSP/WAAS Participants All students enrolled during the testing window must participate in the MSP, MSP-Basic or WAAS-Portfolio assessment. Students are pre-registered and will receive Pre-ID test booklets or Pre-ID adhesive labels. Testing and special education: IEP teams review the available performance data and identify the most appropriate testing option for students in grades 3-8, in the content area for which they qualify for and receive special education services. • Measurements of Student Progress • Without accommodations • With accommodations • WAAS • Portfolio • MSP-Basic —Level 2 “Basic” meets standard Pages~13-14

22. New Non—English Proficient (NNEP) Students • NNEP students are those who first enrolled in a U.S. public school within the past 12 calendar months. They are not required to take the reading and writing assessment. Please keep in mind that these students test their second year in school.. • The No Child Left Behind Act (NCLB), however, does require NNEP students to take the mathematics and science assessments. Test scores, including those in mathematics, are not counted in any way (i.e., Report Card or AYP results). If they do not take the mathematics MSP, they will be counted in AYP as non-participants. As you know, NCLB requires 95% participation. Page~16

23. Absenteeism • All Grades Students who are absent with a valid excuse and do not take the assessment will not be included in the proficiency portion of AYP or state results. However, they will be counted as non-participants for AYP purposes. Absences need to be reported, on the back cover (demographic page) of the student test booklet, either as excused or unexcused. This documentation must follow local school board policy on excused absences. • Grades 3–8 Students in grades 3–8 must be given an opportunity to make up missed sections of the assessment. Make-up session for students who miss one or more parts of the assessment must be scheduled after the initial administration. Students who miss a first-day writing session but are present for the second-day may be tested along with other students and make up the first session at a later time. Page~17

24. Part 3—Before TestingB: Testing Schedules • Guidelines for scheduling the Assessments • Test Preparation • Communicating with Parents and Students • Identifying Proctors, Scribes, Volunteers • Preparing Students for State Assessments Pages~ 19-20

25. Guidelines for Scheduling the Assessments • The standardized schedule helps ensure the security of the assessment content and contributes to the validity and accuracy of student scores. • The MSP is an untimed test. Estimated timeframes are for planning purposes. 10–15 minute supervised breaks are allowed. Caution against discussing test content. Students generally remain in classroom; however, they may be permitted to leave the room, if supervised. • Administration of all tests begins soon after the start of the school day. • All late starts and early dismissals must be canceled on testing days as well as interruptions in testing for specialists or teacher planning. • Contact your assessment coordinator for direction on accommodating students who arrive after testing begins. • Follow your school testing plan for students who need additional time. Each test must be completed during the regularly scheduled day in which it was begun, unless specified in the students’ IEP or 504 Plan. Pages~ 19

27. Statistical Sample Schools (SSS) • MSP Writing SS: Schools identified begin testing on April 12th and end testing on April 20th (early window, expedited return). • Data Recognition Corporation (DRC) has prescheduled your carrier pick-up of grades 4 and 7 participating Statistical Sample Schools. • Writing (limited)- 4/21* • Only schools identified on the Early SSS Writing list: EarlySSSWritingMSP • Completed test booklets return on April 21st • If a student is unable to be assessed during thiswindow, return test booklet(s) to your school assessment coordinator for retention. The student may be assessed during the standard or makeup schedule. * All other writing material administered May 2nd through May 19th (district approved schedule) and returns on standard schedule. Date selected in WAMS.

29. Part 3 -Section C: Ensuring a Proper Testing Environment • All testing locations must be posted with a Testing—Do NOT Disturb sign. When placing the sign, care should be taken not to obscure windows. This posting assists in preventing interruptions in testing and facilitates the monitoring of testing by administration. • Remove or cover aids or prompts in the classroom that may help students answer test questions. • The following are samples of items permitted: • Alphabet • Simple number line • Verbatim Copy of the ‘Writing Checklists’ • Glossaries for Non-Mathematics and Non-Science terms • Mathematics Formula Sheet • My Word List • Compare • Contrast • Connect • Analyze • Interpret • Synthesize • Evaluate Page~21

30. Identifying Test Proctors and Scribes • State assessments must be administered by trained staff members (e.g., teachers, ESAs, EAs, substitute teachers) of a school district under the general supervision of a certificated employee. • Student teachers and interns have a contractual relationship with the school district—even though they are not paid employees—and may assist in the administration of the assessments. • Volunteers may not administer or assist in the administration of any state assessments. Volunteers may assist in the supervision of students who need a break or have completed testing. Pages~21

32. Part 3 Section D: Tools and Manipulatives • Mathematics Tools • Science Tools • Writing Tools • Scratch Paper • Calculators 3-5 Pages~ 23-26 6-8 Pages 23-28

34. Writing Tools Dictionaries and Thesauruses • For the Writing Assessments, students may use a commercially published thesaurus or dictionary. Teacher- or student-created dictionaries are not permitted. • For the Reading, Mathematics or Science Assessments, dictionaries and thesauruses are not allowed on any session. Scratch Paper • For the Writing Assessments, at least 3 sheets of yellow, lined letter-size (8 ½” x 11”) scratch paper should be provided. Refer to Washington State’s Accommodation Guidelines for Statewide Assessments for tools available to students receiving Special Education or ELL Services: http://www.k12.wa.us/assessment/AlternativeAssessment/Accommodations.aspx Page~24-25

35. No. 2 Pencils ONLY Pens, highlighters, markers, mechanical pencils, crayons, and pencils of 2.5, 3.0 etc., are NOT permitted; they will not be picked up by the scanners. Students may use a No. 2 pencil to underline or circle key words in the assessment directions. Scratch Paper For the Reading, Mathematics and Science Assessments, no additional paper of any kind is allowed, including lined or unlined scratch paper, patty-paper, wax paper or transparencies. For the Writing Assessment, students must be provided scratch paper for the prewriting and first drafts of each session. It is suggested that you provide at least 3 sheets of yellow, lined letter-size (8 ½" x 11“) scratch paper so that it can be easily identified and removed for shredding. Providing Testing Materials Pages~25

36. Calculators Calculators are permitted on the following assessments Mathematics (use optional) • Grades 7 and 8 (MSP) Science (use optional) • Grades 5 and 8 (MSP) Calculators areNOT permitted on the following assessments Mathematics • Grades 3, 4, 5 and 6 Proctors are required to review the calculator section of the DFA for policies on use of and types of calculators allowed on state assessments. Students must be thoroughly familiar with the operation of the calculator they plan to use on the test. 3-5 Page~25-26 6-8 Page ~26-28

37. Section E: Testing Materials Tracking Secure Test Materials • MSP and Accommodated CD Forms • Follow your school testing security plan for tracking materials to ensure materials are accounted for and returned to your school assessment coordinator. • Follow building protocol for students who need additional time. • Each student test for MSP (including Braille, large print and accommodated CD) has a unique security barcode number printed on the front cover, upper right hand corner. • New this year • Accommodated materials (Translated Mathematics and Science CDs, large print and Braille) will now be packaged as pre-Identified kit (zip-lock baggy) with a standard form test booklet. 3-5 Page~27 6-8 Page~29

38. Storage and Handling of Secure Materials All test booklets, alternate assessments and accommodated forms must be kept under secure, locked, limited access conditions at all times. Test Proctor is responsible for: • Becoming proficient with the school’s secure test material handling plan • Daily accounting of all secure test material is critical. • Ensuring secure storage of all test materials • Ensuring accuracy of student demographic information • Documenting test irregularities and security breaches • Completing Test Security Assurance Form, including an explanation for boxes checked “no” and notation of missing materials. All missing materials must be immediately reported to your school assessment coordinator. 3-5 Page~29 6-8 Page ~31-32

41. Part 4—During Testing • Distributing and Collecting Booklets • Handling Defective Booklets During Testing • Monitoring and Certifying Test Administration • Reporting perceived Error on a Test • Documenting Irregularities 3-5 Page ~29-30 6-8 Page~ 31-32

42. Distributing and Collecting Booklets • The reading, mathematics and science assessments are to be given in one session. The writing assessments are to be given in two sessions. • Reading, mathematics and science test booklets must be collected after the completion of the testing day and returned to your school assessment coordinator according to your school’s secure test material handling plan. • Writing test booklets must be collected after the completion of session one and stored in a secure, locked, limited access area. Be sure to verify that the correct booklet is given to student identified. • Return to your school assessment coordinator at completion of session two, according to your school’s secure test material handling plan. 3-5 Page ~29 6-8 Page~ 31

43. It is possible that a student might receive a defective test booklet or that a test booklet may become damaged during testing. If a test booklet is incomplete or defective, the proctor should: Obtain a new test booklet from your school assessment coordinator; Verify the student’s demographics are gridded on the back cover of the replacement booklet; Document the testing irregularity in the “Notes: Proctor/Coordinator Use” box on the front cover of the replacement booklet; Tell the student to continue with the replacement copy, beginning after the last question answered in the defective booklet; and Band both the replacement and damaged/incomplete booklets together prior to returning to school assessment coordinator for transcription. Handling Defective Booklets During Testing 3-5 Page 29 6-8 Page~ 31

44. Monitoring & Certifying Test Administration Locations where testing is occurring must have a “Testing – Do Not Disturb” sign posted on the door to allow administrator monitoring and prevent unnecessary interruptions You may not paraphrase questions or read the questions to students. Test proctors and monitors must observe students to ensure: Students are engaged with the assessment and working independently Students are using only a No. 2 pencil Students are not using cell phones or other electronic devices, other than approved calculators. You may not read or comment on student essays, point out incorrectly answered question or point out questions that have not been answered. 3-5 Page 29 6-8 Page~ 31

45. Reporting Perceived Error on a Test If there appears to be an error on the assessment, instruct students to complete that section of the assessment. Assure the student that items found to contain errors will not be counted toward their score. Do not attempt to provide your own remedy. Alert your school and/or district assessment coordinator. Include the following information: content, grade level, form letter, test question number and page number. For security concerns, DO NOT copy the problem, share with colleagues or transmit this information via e-mail or text messaging. The district assessment coordinator will complete a Test Question Ambiguity Form. The state will provide a remedy if needed for all students in the state. 3-5 page ~30 6-8 Page~ 32

46. Collect materials from students immediately after completion of testing. Collect all Writing scratch paper, Mathematics Formula Sheets and Glossaries. Check to be sure that all papers are accounted for, then immediately and securely shred them. Account for all secure materials. Keep large print/Braille tests and accommodated forms (CDs) with the Standard Form A test booklet when returning to your school/district assessment coordinator. Return all test materials to the school assessment coordinator. Complete and submit a Test Security Assessment Form to your school assessment coordinator. After Testing

47. Part 8: Resources • Test Proctor Checklists • Accommodations Available to All Students • Test Administration Irregularities Process • Sample Test Booklet Covers • Test Proctor and Classroom Testing Resources • WAAS-DAPE Deliverables, DFAs and Test Booklets

49. ii: Universal Accommodations Available to Any Student • Wider Access • Accommodations Available for Students Receiving Services • Documenting Accommodations • Scribing Student Work

50. The goal of the Washington Comprehensive Assessment Program is to assure every student has the opportunity to participate in the assessment, without providing a special advantage. Refer to the Washington State Accommodations Guidelines for Statewide Assessments for specific accommodations available to students receiving Special Education Services and English Language Learners. Assure Wider Access The Checklist for accommodations available for all students is available in the Resources section of the DFA.