Colorado Measures of Academic Success (CMAS) COORDINATION TRAINING

1. Colorado Measures of Academic Success (CMAS) COORDINATION TRAINING For School Assessment Coordinators (SACs) Boulder Valley School DistrictOctober 2014 Modified from CDE CMAS Administration/ PearsonAccess Training Fall 2014

2. Agenda Part 1 – CMAS Coordination • Overview • School Coordinator Responsibilities • Scheduling and Makeups • Accessibility Features and Accommodations • Test Security • Test Environment • Testing Irregularities • Interruptions to Testing • After Testing Part 2 – PearsonAccess Training

3. Training Norms • Communication Devices off • Start and end on time • Stay focused on the task (Time) • Please limit side conversations • Participants are required to sign in, sign the Pearson Security Agreement & complete post training evaluation

4. CMAS Test Overview Testing Window Who takes CMAS? Test Structure

5. Fall 2014 High School CMAS Assessment Window Testing window includes make-ups 5

6. Who should be tested? • All 12th graders currently enrolled at your school: • Designated at 12th graders for the first time • In their fourth year or less in high school • Part-time private school and part-time home school students do not take the test, other part-time students do • Foreign exchange students participate • Dually enrolled students: • if both enrolled at an online school and brick and mortar school- school where the student resides at 50% of the time is responsible for testing this student • Concurrent students at Tech participate at their home high school • Students who took 11th Grade Alt, will take CMAS CoAlt

7. Test Structure • Each 12th grader takes 3 sections in Science and 3 sections in Social Studies • The assessments are composed of the following item types: • Selected Response • Constructed Response • Computer-enabled/technology-enhanced • Simulations (science) • Performance Events (social studies) • TestNav8: web-based computer program that runs the CMAS test • Follow this LINK -- www.testnav.com/co/

8. Before Testing SAC Responsibilities

9. SAC Responsibilities: Before Testing • Understand all CMAS procedures and requirements • Collect and maintain Pearson security agreement from all school staff involved in testing • Employ school level security plan (Chain of Custody) • Serve as liaison between DACs and Test Administrators • Receive, verify, secure, and distribute all test materials • Maintain secure location & chain of custody process • Email the CMAS Helpdesk any discrepancies w/ papermaterials • Assemble & maintain master list for all students and accommodations or text-to-speech • Prepare students – ePATs(point out writing tool limitation) • Ensure test environment compliance • # portable devices(to document which device students use)

10. SAC Responsibilities: Before Testing In PearsonAccess • Update/Set up user accounts for all necessary personnel (all Test Administrators/CoAlt Test Examiners) • Identify and ensure students requiring text-to-speech form or embedded accommodation is turned on before testing • Verify student records for paper-based tests: • Paper forms of the assessment, including braille and large print • Order any additional secure and non-secure materials as needed from the CMAS helpdesk • Assign all students to a test session and individuals to special forms as needed (e.g., text-to-speech)

11. Training Your Test Administrators (TAs) • SAC lead Test Administrator training must include: • Sign in sheet • Daily schedule and make-up plan • Test Security/Chain of Custody • Standardized Test Environment • Test Administration • Test Administrator Role vs. Teacher Role • Opportunity for personnel to ask questions • How to administer sessions w/ scheduled accommodations • NOTE: Assessment Office will provide PowerPoint to SACs • Late arrival students (where to send them) • Review school-based decisions around administration

12. Training Your TAs (continued) • School-based decisions & identify related “SAY” directions in TA manuals • Plan after regular testing time (dismiss students to ____, read or sit quietly after exiting from section) • Cell phone policy • Will computers/devices be turned on at Chrome browser? • Schedule to complete one section or more per testing period • Option for students to take a survey at the end of each test • Other training requirements: • All TAs view PearsonAccess recorded module • CoAlt: Teachers administering the CoAlt will view a recorded training for Test Examiners • CoAlt: A brief recorded training for SACs at CoAlt schools • TAs are licensed educators, proctors provide support

13. Scheduling and Makeups Scheduling Makeups

14. CMAS: Test Structure and Timing

15. Scheduling Considerations Refer to FALL 2014: CMAS Testing Requirements • Schedule first group with more of a time cushion • Determine whether students will take an entire session/content in one sitting or one section per day • Portable devices: Wifi capacity per classroom, Battery live Record rooms where portable devices will be used (form) • Students with text-to-speech may be with their peers (headphones required for TTS) • Test security considerations: Test sessions back to back, over consecutive days • Colorado weather

16. Makeups Only participation counts for first year of testing Option 1 - Recommended • Student remains in the original test session in PearsonAccess and completes the missed test section in a scheduled make-up testing time in advance of re-joining original (physical) testing group or after physical group finished testing. Option 2 • Student tests make-up section while the original testing group tests next section in the same testing environment. Option 3 • Student who missed test section will make-up during any available physical testing group time in advance of rejoining the original test group, if applicable.

17. Accessibility Features and Accommodations Features for all Students Embedded Features Accessibility Features Accommodations

18. Increased Accessibility • CMAS computer based administration • Setting considerations: available to all students • Embedded features: available to all students to increase accessibility • Embedded accessibility features that must be requested ahead of time (by October 17): available to all students, if appropriate to increase accessibility • Accommodations, both embedded and non-embedded: available to students consistent with their IEP, 504 plan, or English learners that qualify LINK to embedded & accessibility features & accommodations

19. Setting & Other Considerations for All • Specified additional time • Small Group • Set own #, unless small group size specifications on an IEP or 504 plan • Breaks (that do not stop the testing clock) • May not access internet, text books, friends, phones, etc. • Time of Day • Consider test security • Separate locations • Specified testing area or seating • Specialized equipment or furniture • Headphones, unplugged as noise buffer • Keyboard shortcut keys posted (cut, copy, and paste) • Redirect students to test

20. Redirection Test administrator may redirect off-task students back to testing by saying: • “(student’s name), continue working.” • No coaching or assistance may be provided in any way • Test administrator may not remind or encourage students to complete a specific item • Test administrator may not provide any physical cues to the test as they could be misconstrued as directing the student to incorrect or correct responses

21. Embedded Features: Available to All Students • Navigation tools (Back page, next page, flag for review) • Pointer • Highlighter • Answer eliminator: Eliminate answer choice(s) • Ruler (quarter inch and centimeter) • Line reader • Scientific Calculator • Magnification/enlargement (Zoom, magnifier) • Writing tools (limited to numbering) • Other formats won’t go through, shortcuts for cut, copy & paste • Periodic Table • Notepad- allows students to take notes (may be available) or • Blank paper (up to 2 sheets per section, blank , secure)

22. Periodic Table

23. Accessibility Feature: Text-to-Speech (TTS) While available to all students, it is not appropriate for all students • Considerations: • Students who needed oral presentation on CO ACT, ELLs, students in RTI process, students literacy level • Larger test form • Appropriate TTS form: Must turn on this form prior to testing • Volume control: At TestNav8 login (before student logs in) • 2 options: Continue to play or Click to hear • Click to hear is recommend for most students • Requires a headset during administration • Students must have a chance to practice sample items in the ePAT environment to ensure they are familiar with it, and will use it.

24. Accessibility Feature: Text to speech

26. Accommodations Overview • Based on a documented individual academic need • for students with disabilities, in an approved IEP or 504 plan • for ELLs identified based on where they are at in their English Language Development Profile (ELDP), follow district ELL accommodation plan • Decisions made by an educational team including parents and students, if possible • Used regularly during classroom instruction this fall, not only used for assessments • Must be in place the previous spring • Exceptions: New students, unforeseeable circumstances (e.g., concussion needs breaks) • SAC must maintain a master list of all students’ accommodations, noting which need to be turned on • Template will be provided • What if a student refuses to use a documented accommodation?

27. Accommodation: Paper-based Test Since this is an online computer based test, a paper form of the test is considered an accommodation. • Must use a No. 2 pencil! • A paper-based assessment is only available for a student who: • Has a neurological disorder (e.g., recent concussion), a condition that causes seizures, or another health condition that prevents the student from accessing the computer • Needs a braille form with tactile graphics • Has a IEP or 504 plan that requires assistive technology, such as speech-to-text, that may not be compatible with TestNav8 • Students with disabilities that prevent them from utilizing devices safely may meet this criterion. • Written responses in a language other than English or Spanish

28. Oral Presentation • English oral script: • On-site sign language presentation • On-site translations into languages other than Spanish • ELLs that are NEP/LEP, in program 3 years or less (on or after November 1 of freshman year) • Spanish oral script • Oral Script: Administration considerations for both computer- and paper-based test admin • Recommended group size of 3 or less for Science • Recommended group size of 1 for Social Studies • Spanish audio (computer only)

29. Oral Presentation: Spanish Audio • Students select play button to hear the text in Spanish • Directions of text will also be in Spanish (not sources) • Students can control the volume

30. Linguistic Accommodations In addition to oral presentation, there are other accommodations that support ELLs that qualify • Word-to-word dictionaries • Written / typed responses in Spanish • Written responses in language other than Spanish must be paper-based and answers translated and transcribed after testing • Speech-to-text (paper only) • Scribe • Very few ELLs would qualify since it’s typically not part of instruction; Scribe used during classroom instruction and tests • Oral Response in English -- NEP (Writing WIDA level 1 0r 2 while oral must be higher, at least 3) • Oral response in Native Language – NEP (Oral WIDA level 1 or 2), in US for less than one year, instruction in native language

31. Assistive Technology • Check for compatibility with computer-based test • AT may include: Communication devices, adaptive computer input / output devices • Word Prediction (paper only) • Separate machine • Responses are printed and transcribed into test • Speech-to-text (paper only) • Separate machine • Responses are printed and transcribed into test

32. Assistive Technology continued Test security implications: • Students must be seated so that they cannot see other screens • Students… • Must not retrieve or access work from another student • Must not be able to access other programs or the Internet while in testing environment • Must not be able to access any previously saved data while in test environment • Extra time may not be given for “lost” work • May not have access to AT devices that contain secure materials until all secure material is removed from device • Devices containing secure materials must be part of chain of custody process

33. Scribe • For Selected Response: • Students with a physical disability that prohibits the use of a keyboard / mouse, or • AT / Adaptive equipment not compatible with TestNav 8 • For Constructed Response: • Students with a physical disability that severely limits or prevents the student’s motor process of writing through keyboarding or other AT • Must be administered individually • Scribe types into TestNav (computer based test) • Scribe writes into test booklet (paper based test)

34. Color Contrast & Visual Supports • Embedded color contrast (computer-based /CBT) • Includes high contrast and reverse contrast • Check with vision specialists / IEP team • Must indicate color contrast form on CBT prior to test • Will CBT work?-- Only the background and text are adjusted and graphics presented in full color on a white background • External cover overlays • Computer-based or Paper-based test • Braille with tactile graphics • Braille note-taker • Large print

35. Timing • Extended time beyond extra time allowed for all students • All students receive Time (55 min) + Extra Time (15 min) = Extended Time (70 minutes) • Follow time indicated in plan • Time and a half (90 minutes) is presumed if it is not specifically listed in plan • Multiple breaks with stop the clock • Requires separate setting • Per individual plan • For short breaks, do not exit from test (cover screen)

36. Accommodations that must be Ordered, Turned On or Approved Ahead of Testing: Submit to CMAS Helpdesk by 10/3/14 • Oral script (English / Spanish) • Paper-based test • Large Print • Braille Submit to CMAS Helpdesk by 10/17/14 (updated) • Spanish Audio: Requires headset during administration • Color contrast • Text-to-speech with color contrast • Spanish Audio with color contrast Unique Accommodation / Non-standard

37. Test Security Security Plan Chain of Custody

38. Secure Materials • Included in Chain of Custody Process: • Student Authorization Tickets • Seal codes • Social Studies source books & Periodic table (paper only) • All Oral Scripts (English and Spanish) • Paper and Pencil Test booklets, including Braille & Large Print • Blank Paper • Scratch paper provided by the school • Scratch paper should be requested by a student, only 1 piece at a time per student with a max of 2 pieces of paper per student per section of the test • Not Secure Materials: • Test Administrator Manuals (TAM) • Procedures Manual

39. Security Plan • Review security procedures, prohibited activities, testing irregularities, and security breaches with all CMAS personnel • Ensure that no unauthorized individuals enter the testing environment • Establish and follow chain of custody • Lock up all secure materials and allow access only to those authorized • Train all CMAS personnel test security procedures in case of unexpected event that may interrupt testing • Monitor Testing • Required documentation (maintain for 3 years) • School-based CMAS training (sign in sheet) • All personnel involved in testing has signed a security agreement • Chain of Custody documentation (template will be provided)

40. Chain of Custody • Record where materials are before, during, and after testing • Check-in and check-out materials using Chain of Custody • Paper based test books, Oral Scripts, scratch paper, etc • Check-out materials on the day of testing, before testing begins (within 15-20 mins before testing) • Check out only the content area being assessed • Return materials to a designated secure location (within 15-20 mins before testing) • DO NOT store any test materials in classroom • Test administrators will have access to oral scripts 24 hours in advance of testing • Must follow the chain of custody

41. Secure Materials Tracking Form:Chain of Custody

42. Maintaining Security of CMAS • All secure test materials must be secured while in the Test Administrator’s possession • DO NOT copy, photograph, or duplicate any secure materials • DO NOT take photos of an error message on the screen • No cell phones or other communication, reproduction or recording devices are allowed in the classroom during testing • If using AT devices, make sure all test material is erased/deleted off device right after testing • Students must not have access to any prohibited materials during testing or breaks between sections • Cover screen; bathroom breaks (1 student at a time)

43. Test Environment Test Administrator: Student Ratio Test Environment Room Configuration Visitors

44. Test Administrators • Ratio: 1 test administrator to every 30 students • If you have more than 30 computers and want to test more than 30 students at one time, add another TA or Proctor (keep in mind wireless access points for large environments) • Test Administrator must be able to actively monitor the space within the testing environment • Test Administrators must: • Actively proctor • Remain attentive and in the room during the entire testing section • Circulate throughout the room during the test • Should be in a position to see students working, not student work

45. The Test Environment • Adequately lit, quiet, free of distractions, heated/cooled • Turn off all bells/alarms to reduce noise • Provide an adequate writing surface • NO cell phones, music, or other distracting devices • Exception: if there is no landline in classroom • “Do Not Disturb/Only authorized personnel allowed” and “No Cell Phones” signs must be placed on the door during test sessions • NO food or drinks are allowed • NO content related posters or aids that suggest possible answers to students • Name tags that have content or can be written on • Word walls • Steps for solving math equations • Any content related materials • Exceptions: basic number line & the alphabet (CMAS Test Administrator Manual, pages 6-7)

46. Testing Room Configuration • Students should not be able to see each other’s work from a normal testing position • Consider the following seating configurations to maintain test security: • Seat students in every other seat (useful in a computer lab setup) • Arrange monitors back-to-back • Seat students back-to-back • Seat students in a semicircle (useful for schools using laptops) • Seat students in widely spaced rows or in every other row (appropriate for a classroom setup) • Dividing screens or other privacy materials may be used if students cannot be placed far enough away from each other • For larger testing environments may need to schedule an extra proctor (CMAS Test Administrator Manual, page 7)

47. Unauthorized Visitors and the Media • Allowed in the Testing Area/Room • Students • Test Administrators/Examiners and Proctors (support role) • Authorized School, District, & State Personnel • State-sanctioned test monitors • Not allowed in the Testing Area/Room • Media of any kind • Parents/Guardians • Visitors • Other unauthorized personnel/visitors • Media are not allowed to have access to the tests before, during, or after test administration, or take pictures or video of testing materials or testing students

48. Test Administration During Testing Active Test Administration Administration Steps

49. Test Materials • Online and Paper Based Test: • Test Administrator’s Manual • CMAS Secure Return Envelopes • Timer / stop watch • Scratch paper and #2 pencils • Roster (master student list, log computer used for online testing) • Onsite Translations into Languages other than English/Spanish • Online Only: • Student Authorization Tickets • Seal Codes- write on board per directions in script, take down after testing starts • English and Spanish Oral Scripts for Online Form • Section Exit Poster (to be provided) • Paper Only: • Test Books, including Braille and Large Print • Source Books (Social Studies Only) & Periodic chart • English and Spanish Oral Scripts for Paper Form

50. Materials Provided to Students • Student Authorization Tickets • Scratch paper and #2 pencil with eraser • Paper must be inspected before use to verify that it is free of any writing • Headphones if using text-to-speech accessibility feature • Accommodated materials • Paper CMAS test booklet • Social Studies Source book • Periodic Chart