Modified PPT from the Colorado Department of Education Unit of Student Assessment

1. CSAP Administration Training for BVSD Test Proctors January, 2010 Modified PPT from the Colorado Department of EducationUnit of Student Assessment

2. Today’s Agenda • How to facilitate an Standardized Test Administration • Role and responsibilities of the Test Proctor • Available resources for test proctors • What’s new for the 2010 CSAP administration • Requirements for training, scheduling, and security • Preparing for and managing the administration of the test • Resources for and documentation of accommodations • Preventing misadministrations/test invalidations • Channels of communication

3. Training Norms • Participants are required to sign in. • Communication Devices • Start and end on time. • Stay focused on the task. (Time) • One person talks at a time. • Please limit side conversations.

4. What is a standardized assessment? • All students will have the same test content, resources, directions, testing conditions, and scoring procedures. • Ensure that every student has an equal opportunity to demonstrate what they know and are able to do within standard conditions provided to all students in Colorado.

5. How do we ensure a standardized administration? Communication Training Documentation Principal Assurance Sign-In sheet for district & school trainings Chain of Custody Student Tracking forms Accommodations & Test Invalidations Formal plans signed by parents for Accommodations District-wide & School Specific daily Schedules Slide # 5

6. CSAP Test Proctors • Licensed BVSD employee may administer CSAP. • Required to attend training at school before testing. • Must be very familiar with Proctor’s Manuals before testing. http://bvsd.org/assessment/sac • Ensure appropriate setting for students who need accommodations. • Provide a standardized administration of the assessment, including the appropriate administration for students needing accommodations. • Follow ‘Chain of Custody’ when handling CSAP books during administration.

7. New in 2010 • No make-ups AFTER spring break • All testing must be completed by March 19. • Math Punch Out Tools • Must be destroyed or returned to SAC. • Make sure they are removed from test books. • Proctor to Student Ratio • 1:30 (1:15 small groups) • Accommodations • Restricted use of scribe. • Abacus available for blind students.

8. Testing Window • Content Areas and Grades assessed in 2010: • Grades 3-10 Reading/Writing/Math • Grades 3-4 Lectura/Escritura • Grades 5, 8 and 10 Science

9. Administration Sessions • Grade 3:Two 60-minute sessions (Reading) Two 60-minute sessions (Writing) Two 65-minute sessions (Math) • Grade 4-10: Six 60-minute sessions (Reading/Writing) Three 65-minute sessions (Math) • Grade 5, 8 and 10: Three 65 minute sessions (Science)

10. Sample Session Schedule for Test Proctors for 2010 Minutes Distribution of materials 5 Teacher Directions/Examples 5-10 Testing time 60-65 TOTAL 70-80 **NOTE: Proctors should work as team to verify administration times and sessions each day to minimize CSAP invalidations.**

11. CSAP Scheduling Procedures 25-26 • Test sessions must be administered in the order they appear within each test book. • Students in the same grade, at the same school, must take the same session at the same time. • SAC will provide daily testing schedules that follows the District CSAP administration calendar. • Ensure enough time for make-ups. • Avoid a classroom or grade level misadminstration.

12. A test proctor administers the wrong session. (e.g., Math session 1 instead of Science session 1) If a test proctor realizes that s/he has administered the wrong session, keep the students in that classroom and notify the SAC / administrator immediately. To avoid a massive misadministration Keep the different classes of students separate until tests are taken. Be sure to complete the other assessment the same day e.g., Science session 1 should be administered for the class that took Math & Math session 1 for the classes that took Science) Work with Planning and Assessment to modify the other test days for Science and Math. If a class takes the wrong assessment… Slide # 12

13. Chain of Custody • Sign in to pick up materials before and after testing. • Test proctors may only have access to test booklets the day of testing. • Receive only the content area being assessed. • Return materials to SAC in a designated secure location • Not stored in classrooms • NOTE: Test booklets, draft booklets, math • punch out tool, oral scripts, and • teacher read directions are all included • in the Chain of Custody process. CSAP

14. Maintaining Test Security page 30 • CSAP books must remain secured while in the Test Proctor’s possession. • No duplication of CSAP materials is allowed under any circumstance. • No cell phones* or other communication devices are allowed in the testing room *Exception: A teacher’s cell phone is okay for emergencies. Must be on silent mode during testing. *No cell phone SIGN available on page 103 of Procedures Manual (may be reproduced).

15. Proctor Handling of Test Booklets • Proctors should not be studying items • Items only accessed during test administration • If a test proctor has a question about an item… • Contact the SAC, who will call the DAC • CDE works with the DAC to address important questions about the items • Do not copy the item, • Do not discuss the item with other teachers • Do not email the content of the item Slide # 15

16. Materials and Environment • Check to ensure that you have sufficient materials for all students each day of testing (test booklets, draft booklets, No. 2 pencils, math tools). • Skim through test booklets for any printing errors. Students CANNOT do this. • Postable and unpostable materials (page 37 & 38 in the Procedures Manual) • If posted throughout the year in the classroom: • Holistic/Analytic Writing Rubrics, Writer’s Checklist and Editing Checking List • 2-pt (Math) rubric for Short Constructed Response Items • 3-pt (Math) rubric for Medium Constructed Response Items • 4-pt (Math) rubric for Extended Constructed Response Items Standard conditionsthroughout the state.

17. Procedures DAC/SAC 5 68 Use #2 Pencil ONLY! Student Name District Name Teacher Name School Name Always use a standard, wooden, graphite-based, #2 pencil on any part of the CSAP test book…. including the front cover!

18. Active Proctoring Procedures 20-23 • Follow the script exactly as it is written. • Active Proctoring does NOT mean ‘Active Participation’ • Do not provide feedback. • Do not clarify test items. • Do not answer content related questions. • Do not interfere with the demonstration of skills. • Do not interact with students in a manner that will impact student responses. • If a student asks, you must repeat oral directions in the script of the Test Proctor’s manual to the whole class.

19. Active Proctoring continued Procedures 46 • If students finish before time is up, they can read or sit quietly after the test booklet has been removed. NO writing/ drawing/listen to music/cell phones etc. • Active Proctoring means that the Test Proctor is walking around the room. • Test Proctors should not be grading papers or be otherwise engaged in anything. • Focus on the CSAP administration.

20. Active Proctoring continued Procedures pg 101 • Proctors should write on the black/white board at the beginning of testing: • Start and stop times • Session number • Page numbers • A copy of the stop page may be posted in the room during the assessment. • Proctors should give students a 10 minute warning • Remind them to check that they have completed each item. • Proctor may not point out individual items a student has missed. • Remind them to STOP at stop page to avoid a misadministration.

21. If a student becomes ill… Procedures pg 52 Student becomes ill and needs to leave • Record the amount of time the student had taken test • Student may make up the session at a later time • May notchange responses to any questions s/he has already answered. • Should receive the remaining time from the original session in which to finish. • Be prepared in advance • Identify an adult available to escort students to the office in such an instance. • If a student appears ill before testing begins, please make sure the student’s needs are met.

22. Continuing onto another session Procedures pg 31 • If a student moves onto another session the test proctor must immediately stop the student and take the test book from the student. This is a misadministration. • The student may not make up that session but the student should complete any other sessions that have not been attempted. No scale score or performance level will be generated. Information on student performance can be obtained from the GRT file.

23. Decisions about Accommodations • Decisions must be based on individual student need(not based on category or program). • Decisions must be made by a team including the content area teacher and parent. • Accommodations must be formally documented in a student’s record (IEP, 504, ILP or other formal plan) and used on assessments and during instruction at least three months prior to CSAP. • Document must be signed by parent • Accommodations Video and Manuals http://bvsd.org/assessment • Section 7 (allowable accommodations), Section 8 (specific details about each accommodation)

24. Extended Time • For students with motor disabilities, documented processing disabilities or students with other documented accommodations that require extra time. • Extended Time (usually means time and a half).Unlimited time is not appropriate. The amount of extra time a student needs should be documented in a formal plan. • Students who have too much time may lose interest and motivation to do their best work. • Any session must be completed within one day.

25. Teacher Read Directions & Oral Script • For students with visual disabilities, communication-processing disabilities (e.g., autism), reading processing disabilities, and some NEP and LEP students. • Scripts are to be treated as secure materials. • Must be followed exactly as they are written. • Individually or group administered with no more than 15 students. • Directions can be repeat but must be repeated to everyone. • Do not interact or cue students in any way that may impact their responses.

26. Teacher Read Directions & Oral Script continued • Need Proctor’s Manual for teacher read directions. • Teacher Read Directions for Reading. • Oral Script for Writing, Math, and Science. Follow oral script exactly. • The oral scripts must be followed exactly as they are written. • The proctor must use the same tone and inflection when reading. • The proctor can repeat any problem if a student requests it. • For math oral script, pause for students to read silently any math terminology included in the problems where a ____ is provided in the script.

27. Scribe is restricted on CSAP • Only appropriate for students who are physically unable to write in the test booklet (e.g., Cerebral Palsy, broken arm, wrist, hand or a motor disability). • If a student is eligible for a scribe, consider using assistive technology first. • A scribe must be used for all sessions of a content area. • Know in advance to testing what scribe support student needs (e.g., multi-choice, short responses, extended responses). • Student may respond orally or point to the answer they have chosen for each item. • Scribe must write exact student responses into a CSAP test book. For Writing Test: • Write exact words without punctuation or capitalization. • Show or read back what student dictated to you. • Student places punctuation and capitalization by showing you where to do so.

28. Avoid Scribe Misadministration • A scribe must administer a test in a manner in accordance with standardized procedures. • It is a misadministration if… • a student writes until frustration and a scribe takes over spontaneously. Plan in advance if a student can fill in bubbles or one word responses and document where different handwriting is in booklet. This will result in an ALERT during scoring. • a scribe does not write verbatim or follow specific directions for the writing test. • a scribe accommodation is used for a student who did not qualify. The DAC has the authority and responsibility to invalidate CSAP tests when the standardization of the administration & policies have been violated. Slide # 28

29. Assistive Technology • For students with visual, hearing, fine motor, writing or motor impairments. • Can be administered in a small group setting as long as it does not interfere with other students. • The student’s responses must be transcribed into a regular test booklet exactly as written in AT after testing or it may result in a misadministration. • PLAN in advance, if student will complete MC & short responses in test booklet, so it’s clear to student that AT is only used for longer items (as an example). • The test proctor should not interact with the student during testing unless the student is in the wrong session or get ill during testing. Slide # 29

30. AT Security Implications • Before testing, turn off spell-check and grammar-check for the writing CSAP. • After each session, print out any typed responses and delete the electronic file of the student’s work. (Also delete from the computer “trash bin” too.) • For the writing test (session 1 & 2), the student cannot work off of their rough draft electronically. They must retype their final draft using their printed out rough draft. • Review Assistive Communicative device document. Slide # 30

31. Linguistic Accommodations ELL Accomm pg 39-41 ELL Accomm pg 23 ELL Accomm pg 35-36 Colorado Accommodations Manual for ELLs Students with limited English are eligible for all standard accommodations including: • Direct Linguistic Accommodations • Oral Presentation (English or translated) • Responding in student’s first language – Only if this is currently being done in the classroom on a daily basis.(translation and transcription required) • Word to word dictionary • Indirect Linguistic Accommodations • Extended time, Breaks • Reference Ethical practices in testing NEP students on page 75 in Procedures Manual.

32. Transcribing Books Transcribing is not an accommodation • Takes place after testing • When do I transcribe? • If books are damaged • Alternate formats used (e.g., Braille, Large Print, AT) • When a student responds in a language other than English (Math, Science and Reading) as an approved accommodation • Must take place in a secure environment and, if possible, under the direction of the School Assessment Coordinator.

33. Student Data Grid • Test Proctor must complete the bottom third of the Student Data Grid upon completion of the test to ensure accurate information regarding Test Invalidations and Accommodations is recorded. • Only bubble the one accommodation that impacts student responses the most. • SAC verifies. Slide # 33

34. Post-Administration Responsibilities: SAC & TP SAC & Test Proctor must check for: • Name on cover of draft and test books.In pencil only! • Pre-coded label and/or Student Data Grid are complete and accurate. • Stray marks are completely erased. • TP return test books to SAC: • no adhesive tape, post-it notes, staples or rubber bands should be in/on any test books • Make sure transcription is complete for Braille or large print books.

35. Follow your school’s plan Answer: If something comes up…how will we address it? • Develop a communication protocol at the school. • Have a procedure in place in the event that a student becomes ill or requires discipline. • Inventory all CSAP assessment materials prior to administration.

36. Communication Protocol • If Test Proctor hasquestions, check the manuals first. • If Test Proctor still has questions, ask the SAC. • If SAC has questions, email CSAP Helpdesk (csap.helpdesk@bvsd.org) or call the helpdesk line at x5112 if it is an emergency. Communication Channels