Modified PPT from the Colorado Department of Education Unit of Student Assessment

1. CSAP Administration Training For Test Proctors January, 2009 Modified PPT from the Colorado Department of EducationUnit of Student Assessment

2. Today’s Agenda • Reminder of the role of Colorado Law in the assessment system. • Understand what’s new for the 2009 CSAP administration. • How to facilitate a standardized Test administration • Security, Scheduling, and Planning • Understand resources and documentation required for Accommodations (IEPs, ILPs, 504 plans, and other special circumstances) • Understand the importance of an appropriate setting in which to deliver accommodations. Agenda

3. Training Norms • Communication Devices • Start and end on time. • Stay focused on the task. (Time) • One person talks at a time. • Please limit side conversations. • Participants are required to sign in. Norms

4. Colorado Student Assessment System Unit of Student Assessment Achievement(Colorado Model Content Standards) College Entrance National and State Trends EnglishLanguage Acquisition(Colorado ELD Standards) Colorado Student Assessment Program Colorado ACT National Assessment of Educational Progress Colorado English Language Acquisition Program CSAP COACT NAEP CELApro CELAplace ELAU CSAPA December 18, 2006 Colorado received FULL Approval from the USDoE for our Standards and Assessment System

5. Standardized Assessments • All students will have the same test content, resources, directions, testing conditions, and scoring procedures. • One score obtained by one student in a part of Colorado will mean the same as the same score obtained by another student in another part of Colorado.

6. What do we need to do? And why? • Ensure that every student has an equal opportunity to demonstrate what they know and are able to do within standard conditions provided to all students in Colorado. • All students will have the same test content, resources, directions, testing conditions, and scoring procedures. • NCLB and Colorado Revised Statutes Standardization

7. CSAP The CSAPmeasures student performance relative to the Colorado Model Content Standards. The CSAP is: • large-scale • standardized • paper-and-pencil • timed assessment CSAP

8. Assessment Team • DAC - District Assessment Coordinator • The point person for all communications to and from CDE’s Unit of Student Assessment for the district, schools and parents. • Albert Hernandez, Carie Anderson and Helen Jablan work closely with Brigitte Mutter to ensure smooth operations for CSAP from beginning to end. • SAC - School Assessment Coordinator • Manages test materials at the school level. • Communicates between the DAC and CSAP Test Proctors. • Trains Test Proctors. • Oversee Administration. • CSAP Test Proctors • The licensed staff who administer the test. • Provide a standardized, ethical administration of the assessment. Assessment Team

9. CSAP Test Proctors CSAP Test Proctors • The licensed BVSD employee who administers the CSAP. • Provide a standardized administration of the assessment, including the appropriate administration for students needing accommodations. • Follow ‘Chain of Custody’ when handling CSAP books during administration. Responsibilites

10. CSAP Resources for Administration • Colorado Procedures Manual • School and District Assessment Coordinators’ Manual • CSAP Test Proctor’s Manual • Colorado Accommodations Manuals • General and Special Ed students • English Language Learners • CSAP District-wide test calendars Resources - available on the BVSD website Assessment page http://bvsd.org/assessment Resources

11. Continued Emphasis for 2009 • Adequate documentation of all accommodations used by students. • Ensuring that all schools are providing an appropriate setting for CSAP for all students. Must Improve

12. New or Different in 2009 • Assessment Accommodations • Revised manuals • Research Based • Accommodations DVD • General Accommodations • Spelling of Words • New rules about the use of a scribe • (All or nothing) • Stop pages for Lectura/Escritura (slide 36) New for 2009

13. New for 2009 continued… • New Icons – Grade 9 and 10 mathematics New for 2009

14. Important Reminders in 2009 Filing documentation for Accommodations • Documentation should NOT be filed in student CUM files. • *Procedure for filing documentation securely: • If IEP – then Special Ed files • If 504 Plan – then 504 files • If ILP Plan – then ILP / literacy files • If ELA Plan – then ELL program files • *If other plan – then file with CSAP secure files & summary roster of students who used an accommodation

15. Important Reminders in 2009 • Utilize the new Accommodations Manuals when making decisions for students (sections 6-8) • Clarification for the use of test invalidation bubble “Unable to test due to language“ (Best practice for NEP). • The “Teacher Read Directions” accommodation REQUIRES the use of a script. These are secure materials that must be returned with “unused books”.

16. Important Reminders in 2009 • Students who become ILL during testing (slide 31) • No “one page rule” (slide 32) • Transcribing (slide 52) • All decisions regarding the assessment of ELL students should refer to the flowchart.(slide 37) • Documented accommodations • Extended time USED • Word-to-word Dictionaries • Translated Oral Script

17. Important Reminders in 2009 • There is a test book for every registered student in each grade level and content area. • Daily check-out and return of CSAP test materials to SAC after each test session. • Extra time does not mean unlimited time. NOTE: Any session must be completed within one day.

18. Testing Window • Content Areas and Grades assessed in 2009: • Grades 3-10 Reading/Writing/Math • Grades 3-4 Lectura/Escritura • Grades 5, 8 and 10 Science Important Dates

19. Administration Sessions • Grade 3:Two 60-minute sessions (Reading) Two 60-minute sessions (Writing) Two 65-minute sessions (Math) • Grade 4-10: Six 60-minute sessions (Reading/Writing) Three 65-minute sessions (Math) • Grade 5, 8 and 10: Three 65 minute sessions (Science)

20. Sample Session Schedule for Test Proctors for 2009 Minutes Distribution of materials 5 Teacher Directions/Examples 5-10 Testing time 60-65 TOTAL 70-80 **NOTE: Teachers working as teams to verify administration of times and sessions to be administered will minimize CSAP invalidations.**

21. CSAP Scheduling Procedures 22-23 • Test sessions must be administered in the order they appear within each test book. • Students in the same grade, at the same school, must take the same session at the same time. • Must follow the District CSAP administration schedules, as well as the school plan • Support a smooth and timely return of materials. • Avoid an uneventful administration (i.e., to prevent any misadminstration of the CSAP). Scheduling

22. Maintaining Security Procedures pg 31-32 • CSAP books must remain secured while in the Test Proctor’s possession. • No duplication of CSAP materials is allowed under any circumstance. • No cell phones* or other communication devices are allowed in the testing room *Exception: A teacher’s cell phone is okay for emergencies. Must be on silent mode during testing. *No cell phone SIGN available on page 95 of Procedures Manual (may be reproduced). Test Security

23. Chain of Custody DAC SAC Teacher Teacher Teacher SAC Procedures pg 28 Teacher Teacher Teacher CSAP

24. Materials and Environment • Check to ensure that you have enough materials for all students each day. • Test Proctors can only have access to test booklets the day a content area is assessed. • Test Proctors must be very familiar with the Test Proctor’s Manual prior to administration. • Assist the team in identifying students who may not be tested (i.e., NEP students). • Skim through test booklets for any printing errors. Students CAN NOT do this. Before Testing

25. Materials and Environment Procedures 33-34 • Check to ensure that you have sufficient materials for all students each day of testing (test/draft booklets, No. 2 pencils, math tools). • Materials you may keep posted during CSAP administration (from the CDE web site): • Holistic/Analytic Writing Rubrics, Writer’s Checklist and Editing Checking List • 2-pt (Math) rubric for Short Constructed Response Items • 3-pt (Math) rubric for Medium Constructed Response Items • 4-pt (Math) rubric for Extended Constructed Response Items Before Testing Standard conditionsthroughout the state.

26. Procedures DAC/SAC 5 68 Use #2 Pencil ONLY! Number Two Pencil Student Name District Name Teacher Name School Name Always use a standard, wooden, graphite-based, #2 pencil on any part of the CSAP test book…. including the front cover!

27. Active Proctoring Procedures 16-20 • Follow the script exactly as it is written. • Active Proctoring does NOT mean ‘Active Participation’ • Do not provide feedback. • Do not clarify test items. • Do not answer content related questions. • Do not interfere with the demonstration of skills. • Do not interact with students in a manner that will impact student responses. • If a student asks, you must repeat oral directions in the script of the Test Proctor’s manual to the whole class at the beginning of the test session. Active Proctoring

28. Active Proctoring continued • If a student finishes before time is up, they can read or sit quietly after the test booklet has been removed. They may not write/listen to music/etc. • Active Proctoring means that the Test Proctor is walking around the room ensuring that students have the standardized testing environment. • Test Proctors should not be grading papers or be otherwise engaged in anything but the CSAP administration. Active Proctoring

29. Active Proctoring continued • Proctors should write on the board/white board at the time of testing: • Start and stop times • Session number • Page numbers • Proctors should give students a 10 minute warning and remind them to check to be sure they have completed each item. Active Proctoring

30. If a student becomes ill… Procedures pg 41 Student becomes ill: • If a student must leave the room after beginning the test, the student may make up the session at a later time; however, s/he may notchange responses to any questions s/he has already answered. • If a student appears ill before testing begins, please make sure the student’s needs are met. Making sure there is an adult available to escort students to the office in such an instance is a suggested precautionary measure.

31. Continuing onto another session Procedures pg 28 • If a student moves onto another session the test proctor must immediately stop the student and take the test book from the student. This is a misadministration. • The student may not make up that session but the student may complete any other sessions that have not been attempted. No scale score or performance level will be generated.

32. Invalid Tests / Misadministration The DAC has the authority and responsibility to invalidate CSAP tests when the standardization of the test administration and policies have been violated in any way. Test Invalidation

33. Options for ELLs • Take the assessment in English. • Students with limited English are eligible for all standard accommodations including: • Oral Presentation (English or translated) • Responding in student’s first language(translation and transcription required) • Take the Lectura/Escritura(available for Grades 3 & 4 for students receiving instruction in Spanish). • May also use any other accommodation(s) allowed for all other student. English Language Learners

34. Lectura/EscrituraGrades 3 and 4 • Must be administered in separate setting by a proficient bilingual/biliterate Spanish-speaking Test Proctor. • Instructions for administration are provided in the CSAP Test Proctor’s Manual. They are the same for both English and Spanish. • Scheduling and administration are the same as for English assessments. • Student Data Grids are identical for Reading/Writing and Lectura/Escritura. Lectura/Escritura

35. Lectura/EscrituraGrades 3 and 4 Lectura/Escritura stop page are on page 92 of the Procedures Manual.

36. English Language Learners • Reference ELL Participation in Decision-Making Flowcharts on page 40 in CSAP Procedures Manual. • Reference Ethical practices in testing NEP students on page 69 in Procedures Manual.

37. Decisions about Accommodations Colorado Accommodations Manual • Decisions must be based on individual student need(not based on category or program). • Decisions must be made by a team including the content area teacher and parent. • Accommodations must be formally documented in a student’s record (IEP, 504 or other formal plan) and used on assessments and during instruction at least three months prior to CSAP. Accommodations

38. Accommodations Accommodations are changes made to the assessment procedures to provide a student with access to comprehensible information and an equal opportunity to demonstrate knowledge and skills without affecting the reliability and/or validity of the assessment. Documentation on CSAP Student Data Grid Do NOTRequire Documentation Accommodations Require Documentation • Parents must be informed. • Usually require separate testing environment. • Usually can be incorporated into regular testing environment.

39. Visual Presentation Accommodations for CSAP Accomm. pg 43

40. Tactile and Multi-Sensory Presentation Accommodations for CSAP Accomm pg 43 and 44

41. Presentation Mode:Use of Large Print or Braille version Procedures 47-48 • Complete Student Data Grid on a “regular” CSAP test bookand transcribe student responses exactly into the book for each content area assessed; • Send transcribed test book to SAC with other test books to be scored. • Return Large Print/Braille book to SAC. Accommodations

42. Auditory Presentation Accommodations for CSAP Accomm pg 44

43. Accommodations Requiring Documentation Accomm pg 49-50 Presentation Mode: Oral Presentation OR Teacher Read Directions May read aloud for Math, Science, and Writing: • test directions using the CSAP Standardized Script for ‘Teacher-Read Directions only’ OR • entire test using the CSAP Standardized ‘Oral Script’ OR ‘Translated Oral Script.’ Accommodations

44. Teacher Read Directions and Oral Presentation of Entire CSAP All scripts (including translated) are secure materials! • Read the standardized script exactly as it is written. No modifications are allowed! • Do not point during any part of the test administration. • Do not clarify test items or answer any content-related questions. • Do not interact or cue students in any way that may impact their responses. Oral Presentation

45. Response Accommodations for CSAP Accomm pg 44

46. Response Mode: Scribing Accomm pg 51 • A scribe must be used for all sessions of a content area. • Student may respond orally or point to the answer they have chosen for each item. • Scribe must write exact student responses into a CSAP test book. For Writing Test: • Write exact words without punctuation or capitalization. • Show or read back what student dictated to you. • Student places punctuation and capitalization by showing you where to do so. Accommodations Send scribed test book to SAC for scoring with test books to be scored.

47. Setting, Timing and Scheduling Accommodations for CSAP Accomm pg 45 and 46

48. Materials or devices used to solve or organize responses on CSAP Accomm pg 45

49. Linguistic Accommodations for CSAP ELL Accomm pg 18 ELL Accomm pg 33-34 ELL Accomm pg 34 Colorado Accommodations Manual for English Language Learners • Direct Linguistic Accommodations • Examples: Oral presentation, word to word Dictionary, response in native lang. • Indirect Linguistic Accommodations • Extended time

50. Transcribing Books Transcribing is not an accommodation • Damaged books • Alternate formats • When a student responds in a language other than English (Math, Science and Reading) • Transcriptions must take place in a secure environment and, whenever possible, under the direction of the School Assessment Coordinator. TP/SAC Responsibilities