Colorado Measures of Academic Success (CMAS) Test Administrator Training

1. Colorado Measures of Academic Success (CMAS) Test Administrator Training Boulder Valley School District April 2014 Modified from CDE CMAS Administration Spring 2014

3. Agenda • CMAS Test Overview • Test Administrator Responsibilities • Test Security • Test Environment • Test Administration • Testing Irregularities • Who to contact when

4. Training Norms • Communication Devices off • Start and end on time • Stay focused on the task (Time) • Please limit side conversations • Participants are required to sign in

5. CMAS Test Overview

6. Science & Social Studies Overview Assessment Window • April 14 – May 2, 2014 Test Structure • Social Studies (Grades 4 & 7), Science (Grades 5 & 8) • Each grade level and content area consists of three sections • Each section is 55 minutes plus 25 minutes extra time allowed • The assessments are composed of the following item types: • Selected Response • Constructed Response • Computer-enabled/technology-enhanced • Simulations (science) • Performance Events (social studies) • TestNav8: web-based computer program that runs the CMAS test

7. School Daily Test Schedule • Daily Schedule • Timing per Section • All Students must be allowed 55 minutes • All students are allowed up to 25 minutes of additional time • Only students on an IEP, 504 Plan, or an ELL student on a learning plan who qualify for extended time may receive more than time and a half • What to do when students finish? • Must be given 55 minutes • Then school has a plan in place if students will be dismissed after 55 minutes or remain in room quietly reading only

8. Make-up Plan Students must complete the test in order (Modify with your school’s make-up options) • Option 1 - Student completes missed test section during make-up testing time in advance of re-joining original physical testing group. • Option 2 - Student tests with original physical testing group (e.g., Day 2 – Group 1 section 2, make-up student, section 1). At some point this student will need to make-up a section to be caught up with their testing group. • Option 3 - Student completes missed test section in any available physical testing group in advance of re-joining original physical testing group. In this scenario, the TA may have to manage multiple test sessions in PearsonAccess.

9. Time for Set up About 10 minutes (this time is flexible) • Hand out Student Authorization Tickets • Test Administrator – Logs-in to PearsonAccess • Students – • Start up TestNav8.0 at the following LINK (www.testnav.com/co/) • Students Log in Using Student Authorization Tickets • Test transfer (proctor cache) • Give directions • Review sample items

10. TestNav8 Online Special Forms • Text to Speech Text is read aloud to the student by means of the embedded text-to-speech software • Color Contrast Allows the student to select alternate colors for text and background • Text to Speech with Color Contrast enabled

11. CMAS Test Administrator • Licensed district employee responsible for directly administering the assessments • Trained and have read the Test Administrator’s Manual prior to any assessment administration • Trained in any specific accommodations they are providing • Must sign security agreement before assessment administration begins • Read the directions to students exactly as they appear in the Test Administrator’s Manual • Test session management • Active Proctor - Administer sections actively without looking at test content

12. Test Security Secure Materials Chain of Custody

13. Secure Materials • Include: • All used scratch paper • All Oral Scripts (English and Spanish) • Source book for Social Studies (Paper based only) • Student Authorization Tickets and Seal Codes • Paper and Pencil Test booklets: Including Braille, Large Print • Not Secure Materials: • Test Administrator Manuals

14. Chain of Custody • Check-in and check-out materials using Chain of Custody • Check-out paper-based test forms and materials (oral scripts) on the day of testing, before testing begins (within 15-20 mins before testing) • Check out only the content area being assessed • Return materials to a designated secure location (within 15-20 mins before testing) • DO NOT store any test materials in classroom • If oral scripts need to be translated into a language other than Spanish, test administrators can have access 24 hours in advance • Follow Chain of Custody

15. Maintaining Security of CMAS • All secure test materials must be secured while in the Test Administrator’s possession • DO NOT: • Copy, photograph, or duplicate any secure CMAS materials • No cell phones or other communication, reproduction or recording devices are allowed in the classroom during testing • If using AT devices, make sure all test material is erased/deleted off device right after testing

16. Maintaining Security & Students • All students within a grade, must complete one section of the test before that grade moves on to the next section • Exception: Make-ups • Each section within a grade must be completed in consecutive testing groups, over consecutive days (if needed per device to student ratio) • Students must not talk about the test at all, particularly since all students within a grade may not be able to take the same section at the same time and even on the same day

17. Test Environment Test Administrator: Student Ratio Test Environment Room Configuration Visitors

18. Test Administrators • Ratio must not exceed 1 test administrator (TA) to every 30 students • If you have more than 30 computers and want to test more than 30 students at one time, just add a proctor (may be a para/support staff) • Test Administrator must be able to actively monitor the space within the testing environment • Test Administrators must: • Actively proctor • Remain attentive and in the room during the entire testing section • Circulate throughout the room during the test • Should be in a position to see students’ eyes, not screens

19. The Test Environment • Adequately lit, quiet, free of distractions, heated/cooled • Turn off all bells/alarms to reduce noise • Provide an adequate writing surface • NO cell phones, music, or other distracting devices • “Do Not Disturb/Only authorized personnel allowed” and “No Cell Phones” signs must be placed on the door during test sessions • NO food or drinks are allowed

20. Testing Environment Continued • NO content related posters or aids that suggest possible answers to students • Name tags that have content or can be written on • Word walls • Steps for solving math equations • Any content related materials • Exceptions: basic number line & the alphabet • Room Configuration • Students should not be able to see each other’s work from a normal testing position • May consider dividing screens or other privacy materials may be used if students cannot be placed far enough away from each other • Is there a different way monitors or laptops could be arranged?

21. Unauthorized Visitors and the Media • Allowed in the Testing Area/Room • Students • Test Administrators/Examiners • Authorized School, District, & State Personnel • State-sanctioned test monitors • Not allowed in the Testing Area/Room • Media of any kind • Parents/Guardians • Visitors • Other unauthorized personnel/visitors • Media are not allowed to have access to the tests before, during, or after test administration, or take pictures or video of testing materials or testing students

22. Test Administration During Testing Active Test Administration Administration Steps

23. Materials Provided to Students • Student Authorization Tickets • Scratch paper (to be supplied by Pearson) and pencil or pen • Approved alternative scratch paper as indicated in a student’s IEP (i.e., graph paper or specialized writing paper). Paper must be inspected before use to verify that it is free of any writing. • Headphones if using text-to-speech accessibility feature • Paper CMAS test materials and accommodated materials (for students taking the paper-based assessment) • No. 2 pencil(s) with eraser(s) for paper-based administrations

24. Responsibilities During Testing • Maintain the security of all test materials • Actively administer the test • MONITOR TESTING ACTIVITY in PearsonAccess • Check out and Check In all test materials daily • Immediately notify your SAC of misadministrations, security breaches, technology glitches, other concerns/questions • Account for the assessment of all students and ensure that all students have completed testing. Administer make-up sections as needed.

25. Active Administrators: Administrators May Not: Active Test Administration Ensure they have all necessary materials for each session Ensure a standardized testing environment Follow all scripts exactly as written Move throughout the room during testing Read directions to students when asked (may be read multiple times) Use proximity to keep students on task Provide feedback Clarify test questions Answer content related questions Interfere with the students’ demonstration of skills Interact with students in any way that would impact student responses Engage in other tasks during test sections Read sources, items, or student responses

26. Administration Steps • Proctor Cache test content to proctor caching computer (SACs may want to do this step) • Prepare the test environment and situate students • Start the session in PearsonAccess • Follow directions and read script in the Test Administrator’s Manual • Hand out student authorization tickets and scratch paper • 1 piece of scratch paper at a time per student • Student must turn in used scratch paper to receive another piece • Place used scratch paper in secure envelope • Write Seal Codes for that test section on the board • Remember to erase Seal Codes after that section is completed • Assist students in logging on to TestNav • Complete directions to students and start session • Actively administer the test section • At end of testing- have students exit the test • Only allow students to submit the test after Section 3 is complete • Collect student authorization tickets and scratch paper • End test section • Close session in PearsonAccess ONLY after third section

27. Test Irregularities Misadministrations Breach of Secure Materials Emergencies

28. Misadministrations • A student receives help from anyone on a test item • A student uses an unauthorized instrument, such as a calculator, cell phone, or notes during a test session • A student is denied appropriate accommodations or given the wrong accommodations Note: Sections in the paper form are sealed and should reduce or eliminate instances of students moving on to the next section. However, if a student advances to the next section before that section is administered, it is a misadministration.

29. When a Misadministration Occurs • The student must immediately stop working on that section, but should still complete other test sections as normal • The Test Administrator must immediately inform the SAC • The appropriate invalidation code must be entered into the student’s record in PearsonAccess • The student receives a “no score” for the content area

30. If you administer the wrong test section (Paper based only) • Stop the test immediately • Contact your SAC immediately • Keep students in the classroom, do not let students leave NOTE: For CBT, the computer will not allow test administrators to administer Section 2 before taking Section 1

31. Breach of Secure Test Materials • Students obtain or share secure test materials • Discussing, reproducing, or transmitting, by any means, secure test materials, or descriptions of secure test materials

32. Emergencies: Ill Students • If a student becomes ill during a test: • The student’s needs are the primary consideration • Have the student logout of TestNav8 and exit the test • Select: “I want to exit this test and finish later” • Record the time remaining in the test session • Have the student make up the test • Only allowed the amount of time that was left when the test was suspended

33. Emergencies: Evacuations/Lockdown/Fire Drill • If there is an emergency requiring the test to be stopped: • Evaluate and respond to the emergency… safety first! • If possible: • Record the time remaining in the test session. • Have students logout of TestNav: Select “I want to exit this test and finish later” • Students will be allowed to use the remainder of the testing time to complete the session at a later date.

34. Who to Contact During Testing! • Your SAC: ***Add phone number here*** • Questions related to: • Test administration/environment/security • Test accommodations/online tools • Schedules • Technology Issues • Misadministrations/School Emergencies/Test Irregularities • If your SAC cannot answer your question, they will contact: • Planning and Assessment Helpdesk, x5112 • IT Helpdesk for Network issues, x5065 • PearsonAccess for system errors we can’t resolve, 888-687-4759

35. Questions??