Colorado Measures of Academic Success (CMAS) Administration Training for DACs

1. Colorado Measures of Academic Success (CMAS)Administration Training for DACs Spring 2014

3. Topics Not Covered Today Colorado Alternate Assessments (CoAlt) Technology Readiness

4. Introductions CDE staff Pearson staff PearsonAccess

5. Morning Agenda Science and Social Studies Administration Procedures Program Overview Roles and Responsibilities Training Scheduling and Testing Time Procedures Make-Up Testing Security The Test Environment Test Administration Interruptions to Testing Testing Irregularities Accessibility Features and Accommodations Interruptions to Testing Receiving and Returning Test Materials

6. Afternoon Agenda CMAS PearsonAccess and TestNav TestNav 8.0 Demonstration and Tools User Roles Student Data Test Session Management TestNav 8.0 Test Engine Additional Orders PARCC Field Test Administration Procedures Program Overview Roles and Responsibilities Similarities and Differences to CMAS/TCAP Online and Paper Testing Field Test PARCC Assessment Accessibility Features and Accommodations

7. CMAS: Science and Social Studies Program Overview

8. Spring 2014 CMASAssessment Window 8

9. Critical Dates

10. What is a “Standardized” Assessment? • All students will have the same test content, resources, directions, testing conditions, and scoring procedures. • A score obtained by one student in one part of Colorado will mean the same as the same score obtained by another student in a different part of Colorado. • With that said …

11. Test Structure • Each grade level and content area consists of three sections • The assessments are composed of the following item types: • Selected Response • Constructed Response • Computer-enabled/technology-enhanced • Simulations (science) • Performance Events (social studies)

12. CMAS Communication Plan CDE School School District Charter School Pearson

13. Contact Pearson for • Procedures pertaining to PearsonAccess • SDU • Student information updates and changes • Additional orders • PearsonAccess test session management • Technical issues related to site readiness, including device questions • Technical issues related to TestNav 8.0 • Materials issues

14. Assistance and Escalation for Technical Issues School/District Pearson Customer Service Center Pearson CO Program Team CDE Assessment Unit Alert Customer Service Center when testing is in progress for rapid escalation CDE Recommends that districts allow individuals beyond DAC to contact Pearson Customer Service Center directly during actual testing

15. Contact Assessment Unit for

16. Roles and Responsibilities

17. Key DAC Responsibilities THROUGHOUT Testing • Understand all CMAS procedures and requirements • Employ district level security plan • Serve as liaison between SACs and Pearson/CDE • Read all communications from Pearson/CDE and distribute as appropriate • NEW for CMAS: during testing, school level personnel will have direct communication with Pearson

18. Key DAC Responsibilities THROUGHOUT Testing • INCLUDE YOUR CHARTER SCHOOLS IN ALL TEST PREPARATION AND ADMINISTRATION ACTIVITIES • WORK COLLABORATIVELY WITH YOUR DTC: • Verify device and bandwidth information has been submitted in the Technology Readiness Tool for all of your schools • Identify appropriate devices, spaces and testing strategies • Verify all schools are set up for proctor caching

19. Key DAC Responsibilities BEFORE Testing • Participate in Pearson and CDE-provided trainings and review all manuals • Review school testing schedules, including accommodated and make-up groups. Coordinate testing schedules across schools as needed • Determine district specific procedures (make-up testing, what to do with students who complete testing after 55 minutes, etc.) • Determine and employ district level security plan • Provide and ensure completion of all district training by SACs • Verify DTCs have completed and attended state-provided in person and webinar trainings • Manage and return security and training compliance documents • Receive, secure, and distribute all test materials

20. Key DAC Responsibilities BEFORE Testing • PearsonAccess • Set up user accounts for all necessary personnel • Verify that the PearsonAccess accounts for students needing: • Paper forms of the assessment, including braille and large print • Oral scripts (both paper and online) • Submit additional orders for secure and non-secure materials as needed • Verify all students have been assigned a test session • Verify students requiring special forms for the computer-based assessment have been assigned to the appropriate form • Register/add new students

21. Key DAC Responsibilities DURING Testing • Ensure that all students are assessed in accordance with CMAS policies and procedures • Submit additional orders for secure and non-secure materials as needed • MONITOR TESTING ACTIVITY • Declare, investigate and report testing irregularities (misadministrations, security breaches, technology glitches) • Account for the assessment of all students and ensure that all students have completed testing

22. Key DAC Responsibilities AFTER Testing • PearsonAccess: • Account for the assessment of all students and ensure that all students have completed testing • Verify all testing sessions have been completed • Verify that PearsonAccess has been updated to reflect the accommodations used during testing, including students taking paper-based assessments. Demographic updates can also be made. • Receive, secure, and return all test materials by May 9 • Manage, submit and retain compliance documents

23. Key SAC Responsibilities THROUGHOUT Testing • Understand all CMAS procedures and requirements • Employ school level security plan • Serve as liaison between DACs and Test Administrators • Read all communications from DAC and distribute as appropriate • NEW for CMAS: during testing, school level personnel will have direct communication with Pearson

24. Key SAC Responsibilities BEFORE Testing • Participate in district trainings and review all manuals • Working with STC, create the testing schedule for your school, including accommodated computer-based and paper-based testing groups and make-up sessions • Determine school specific procedures (make-up testing, what to do with students who complete testing after 55 minutes, etc.) • Determine school level security plan • Provide and ensure completion of all training by Test Administrators and anyone else you have authorized or expect to come in contact with secure materials or environments • Receive, secure, and distribute all test materials • Manage and return security and training compliance documents

25. Key SAC Responsibilities BEFORE Testing • PearsonAccess • Set up user accounts for all necessary personnel • Identify and maintain a list of students requiring the text-to-speech form and accommodations (paper-based and computer-based administrations). • Verify that PearsonAccess accounts for students needing: • Paper forms of the assessment, including braille and large print • Oral scripts (paper and online) • Request from your DAC additional secure and non-secure materials as needed • Assign all students to a test session • Assign students requiring special forms for the computer-based assessment to the appropriate form • Register/add new students

26. Key SAC Responsibilities BEFORE Testing • Establish the testing environments • PROCTOR CACHE!!! • Prepare students • Meet with students to review school testing policies and expectations, including that test results should be reflective of individual effort. • Ensure all students are familiar with TestNav 8.0

27. Prepare Students for Assessments • Practice Testing Environments (ePATs) • Expose students to sample items • Familiarize students with online test engine, TestNav 8, and embedded supports • Available on pearsonaccess.com • Item Samplers available on February 7 • Text-to-speech and color contrast • Text-to-speech and color contrast will require form assignment • Full ePAT available on February 28

28. Key SAC Responsibilities DURING Testing Ensure that all students are assessed in accordance with CMAS policies and procedures Request additional secure and non-secure materials from DAC as needed MONITOR TESTING ACTIVITY Distribute and collect paper testing materials daily Report suspected testing irregularities (misadministrations, security breaches, technology glitches). Work with DAC to investigate and declare misadministrations. Account for the assessment of all students and ensure that all students have completed testing. Administer make-up sections as needed.

29. Key SAC Responsibilities AFTER Testing • PearsonAccess: • Account for the assessment of all students and ensure that all students have completed testing • Verify all testing sessions have been completed • Verify that PearsonAccess has been updated to reflect the accommodations used during testing, including students taking paper-based assessments • Transcribe student responses from large print and braille test books into scannabletest books. • Collect, sort, secure, and return all test materials to DAC by district determined date • Manage, submit and retain compliance documents

30. District Technology Coordinator • Responsibilities are covered during technology site readiness trainings and regional meetings • DACs need to work closely with District Technology Coordinators • Determining device availability and scheduling • Identifying local technology coordinators • Providing local technical support • Ensuring tests are administered securely

31. Student Enrollment (Data) • Individual in the district who handles student enrollment data • Sending, viewing, adding and editing student data • Ensures that all students are uploaded to PearsonAccess and that demographic information is correct • Determine who from district (or school) will manage student data

32. CMAS Test Administrator • Individual at school level responsible for directly administering the CMAS: Science and Social Studies assessments • Must be employed by the school/district • Be trained and have read the Test Administrator’s Manual prior to any assessment administration • Be trained in any specific accommodations they are providing • Must sign security agreement before assessment administration begins • Read the directions to students exactly as they appear in the Test Administrator’s Manual • Test session management • Administer sections actively

33. Training

34. District Training Everyone involved in CMAS administration must be trained each year. This includes DACs, SACs, CMAS Test Administrators, technology personnel and any other school or district staff involved in CMAS administration DACs and SACs are responsible for ensuring that all individuals involved in test administration receive training and sign security agreement

35. Training • Comprehensive training must include: • Test Security • Standardized Test Environment • Test Administration • Test Session Management (for appropriate personnel) • Test Administrator Role vs. Teacher Role • Opportunity for personnel to ask questions

36. Forms

37. Scheduling and Testing Time Procedures

38. Definitions PearsonAccess Test Session: Virtual data grouping of students who are grouped together within PearsonAccess for test management purposes. Each PearsonAccess test session consists of one grade level and one content area (three sections). Students must be placed in a scheduled PearsonAccess test session before they can log in to a test. Test Section: The parts of a CMAS: Science and Social Studies assessment. Each grade and content area of the CMAS: Science and Social Studies assessments include three sealed test sections. Physical Testing Group: Students who test within a physical testing environment at the same time.

39. CMAS: Test Structure and Timing

40. Time for Set up and Transition Start up TestNav 8.0 Log in Test transfer (proctor cache…) Give directions Review sample items

41. CMAS Scheduling Considerations • Each grade level and content area consists of 3 sections • Test sections can only be administered to students in consecutive order • One grade level and one content area at a time except for make-ups • To the extent possible, all students within a grade should be assessed at the same time. Should that not prove possible, all students should be assessed within the shortest timeframe practicable (i.e., in back-to-back sections, within the same day or consecutive days if more sections are needed than can be administered in a day, etc.)

42. CMAS Scheduling Considerations • Schedule first group/first day with more of a time cushion than other groups if you can • If you have to do multiple sessions, schedule smallest group first • District policy for students who are finished testing after the required 55 minutes • Determine whether grades will complete testing one at a time or alternate testing (make-ups excluded) • Determine whether the district wants to condense testing (make-ups excluded) or spread throughout the testing window • Plan for accommodations • Recommendation: Schedule students for only one section per day (exception: make-ups) • Remember: This is Colorado

43. Make-Up Testing

44. Make-Up Testing Priority: minimize risk of prior exposure to test content that could result in an invalidation

45. Student completes missed test section during make-up testing time in advance of re-joining original physical testing group Make-Up Testing Option 1 (**Recommended**)

47. Student tests with original physical testing group Make-Up Testing Option 2

49. Student completes missed test section in any available physical testing group in advance of re-joining original physical testing group Make-Up Testing Option 3