CMAS Staff & Test Administrator Training 2014

1. CMAS Staff & Test Administrator Training 2014 Ethics, Security and test administration

2. CMAS Staff and Test Administration Training CMAS Staff Training: Part I • Required Forms: Training Sign-In & Security Agreement • CMAS Overview • Staff Ethics Training • Ethical Responsibilities during CMAS testing • CMAS Test Security • Testing Environment • Testing Irregularities • Infrastructure Trial • CMAS Test Administrator Training: Part II • Administering the CMAS • Role of the Test Administrator • Active Proctoring • Test Administration Procedures • Testing Day in PearsonAccess • Supplemental Information for Test Administrators • Accommodations • TestNav Screens

3. Who needs to be trained? All staff members involved in CMAS administration in any way must be trained each year on ethical assessment practices and standard administration policies and procedures. This includes administrators, teachers, STRs, paras, office staff members and other technology personnel. • Staff training must be completed by 10/28 • Scan/email sign-in sheets to onlineassess@dpsk12.org • Each staff members must sign a CMAS Security Agreement form

4. CMAS Required Forms • ALL staff involved in CMAS must sign-in to verify training and also sign a CMAS Security Agreement. • These forms are available online at onlineassessment.dpsk12.org under the Administration tab Training Sign-In Sheets Scan/Email to onlineassess@dpsk12.org CMAS Security Agreement Keep on-file at your school for 3 years (paper or digital copy)

5. CMAS Overview

6. CMAS PARCC Testing Windows 2014-15

7. What is the purpose of CMAS? The purpose of CMAS is to: • Determine the level at which Colorado students meet the Colorado Academic Standards (CAS) and Common Core State Standards (CCSS) in the content areas assessed. • Monitor how well students are learning • Measure their progress over time • Add to a body of evidence to determine students’ proficiency level in multiple content areas

8. Why…Social Studies and Science? • We want to ensure our students are… • Responsible, Productive Citizens: Powerful social studies learning leads to a well-informed and civic-minded citizenry that can sustain and build on democratic traditions. A strong understanding of science allows us to describe, define, investigate and understand the world in which we live. College and Career Ready for higher education in STEM, Liberal Arts We want to ensure our college and career bound students have social understanding, civic efficacy and an ability to relate to the world around them. “The function of education is to teach one to think intensively and to think critically… Intelligence plus character–that is the goal of true education.”~Martin Luther King Jr.

9. Why12th grade? • Scope and Sequence for science & social studies varies widely across Colorado in grades 9-10 and does not significantly overlap until 11th grade. • To enable optimal coverage of the high school standards, the earliest a science & social studies assessment could be given is 11th grade. • Districts across Colorado voted for Fall of 12th grade.

10. Who Takes this Test? • Students who are… • Designated as 12th graders for the first time • Part of SY 2011-12 freshman cohort (anticipated year of graduation is 2014-15)

11. What is on the Test? Instructional resources for cmas science & social studies

12. Social StudiesAssessment Frameworks: History Geography Economics Civics http://cde.state.co.us/assessment/sumframeworkssocst12

13. ScienceAssessment Frameworks: Physical Science Life Science Earth Systems Science Scientific Investigations and the Nature of Science (SI/NS) http://cde.state.co.us/assessment/sumframeworkssci12

14. What are ePATs? • Expose students and staff with the content and format of the test • See sample itemsand how they work • Familiarize students with online test engine, TestNav 8, and embedded supports • Available at www.pearsonaccess.com/co ePATs are Practice Testing Environments, a great way to….

15. Instructional Resources for CMAS

16. CMAS Performance Levels Performance Level: Top two levels are indicators of being on track for college and career: Distinguished Command Strong Command Moderate Command Limited Command

17. Accountability Ratings *from CDE, August 2014

18. Ethical Responsibilities Cmas testing

19. What is a “Standardized” assessment? • Standardization requires that all proctors give all test sessions in the same way so that all students have the same test content, resources, directions, testing conditions and scoring procedures. Why is “Standardized” so important? Standardization ensures that one score obtained by one student in a part of Colorado will mean the same as a score obtained by another student in a different part of Colorado.

20. Ethical Responsibilities • I understand that the purpose of the CMAS assessment is to measure the level at which Colorado students meet the CAS and CCSS in the content areas assessed. • I understand my role in standardized testing is to allow students to work independently without my help. • I understand that test administrators must follow the rules of standardization in order for the students to receive a valid score. • I understand that the district analyzes unusual CMAS scores trends to ensure that all DPS test scores are valid. • I understand that I must perform my professional responsibilities with honesty, integrity, due care, and fairness.

21. Ethical Practices & CMAS • Teach to the standards, not the test • Provide all approved accommodations Neveruse items from test for test preparation Nevershare or alter student responses Do not coach or clue students during test administration • In order to maintain standardization, test administrators must make sure that their students have the same CMAS testing experience as all of the other students who are taking the same exam.

22. Potential Consequences of Misadministrations or Unethical Behavior Test invalidations of any kind: • will affect school and district accountability reports such as SPF. • may affect compensation and evaluation determinations. • may also result in disciplinary actions including, but not limited to, reprimand, suspension, dismissal, and loss of license.

23. Test Security

24. Test Security Plan • Your SAL and school leader(s) have created a test security plan to determine testing security protocols and a plan to handle testing irregularities and security breaches • This plan: • Establishes a chain of custody protocol for materials • Designates a central locked storage area for securing test materials • Documents that STRs, Test Administrators, and proctors have received necessary documentation and training for successful, secure administration of the CMAS Test

25. Testing Materials • Secure Materials: • Student Authorization Tickets • Seal Codes • Paper test books • Social Studies Source Books • Oral Scripts • Non-Secure Materials: • Test Administrator Manuals (TAM) • CMAS Procedures Manual

26. Keep all Test Materials Secure • Test Administrators may see the Oral Scripts up to 24 hours before the testing window (48 hours for those doing translation accommodations). • This must be done in the presence of the SAL. • The materials cannot be checked out for translation. • Only materials for the content area being assessed will be distributed. • Return materials to a designated secure location (not stored in classrooms)

27. No Reproduction of Testing Materials • Test Security is ensuring that there is no reproduction of any test materials. This includes memorization, photocopying, note-taking, photographing, scanning, encoding, text messaging, sign language, blogging or using other forms of social networking to share information. • Do NOT take a screenshot of any part of the CMAS computer-based assessment. • Do NOT make copies of any portion of the CMAS exams. • Do NOT copy, by any means, any student work that results from this assessment. • Do NOT look at the test prior to testing and prep students on what will be tested. (released and ePAT items are okay to share with students) • Do NOT share student’s responses with anyone verbally, through the internet, or in written format. • Do NOT attempt to score a student’s test before returning the materials.

28. Day(s) of Testing • Your SAL will distribute and track test materials each day. • CMAS testing bins will be checked out 15 minutes prior to testing and must be returned to the secure room within 15 minutes after testing is completed. • Materials that may be included in a CMAS testing bins: • Student Authorization Tickets • Seal Codes • Accommodations materials • Paper-based test • Schedule of students • Exit Posters Double-check you have all your materials before returning to your testing site! Test materials must not be stored in classrooms prior to or following the administration.

29. Maintaining Security of CMAS • No cell phones or other communication, reproduction or recording devices are allowed during test sessions, except to contact your SAL. • Manage devices! Have a plan in place to remove cell phones from students during testing.

30. Testing Environment

31. The Test Environment • The testing environment must: • Be adequately lit, quiet, free of distractions, and heated or cooled • Provide an adequate writing surface (paper-based)` • Be free of electronic devices and music • “Do Not Disturb/Only Authorized Personnel Allowed” sign must be placed on the door during test sessions

32. The Test Environment • No food or drink (inc. candy, gum) are allowed near computers, desks, and test materials • The testing environment must be free of any content-related posters or aids that suggest possible answers to students • Word walls • Steps for solving math equations • Any content related materials • Generally, posters that do not include content specific definitions, content related processes or solutions may remain on the wall

33. Unauthorized Visitors and the Media • Only students, Test Administrators, and authorized school, district, state personnel, or state-sanctioned test monitors may be in testing areas during administration • Parents and Guardians are not allowed in testing areas! • Media are not allowed to have access to the tests before, during, or after test administration, or take pictures or video of testing materials or testing students

34. Prohibited Materials During All Sessions • Classroom resources that may provide unauthorized assistance, or explain, define, illustrate concepts that are part of the subject areas being tested, must be covered up or removed. • Including (not exhaustive list): Posters, maps, or charts Mathematical formulas/theorems Graphic organizers Number lines Multiplication tables 100s charts Word lists Definitions Writing formulas Any manipulative not approved for use prior to testing Refer to the CMAS Procedures Manual for examples of allowable and prohibited posted materials: http://cde.state.co.us/assessment/2014fallcmaspm • When in doubt, cover it up! • Don’t risk a misadministration!

35. Prohibited Materials During All Sessions • All cellular phones – except to call SAL • Non-testing personal electronic equipment (e.g., scanners, eBooks, electronic pens) • Any electronic equipment capable of performing computations or providing other assistance in either content area (other than approved calculators) • Instructional aids and reference books related to the content being assessed

36. Testing Irregularities and Misadministrations

37. Reporting Testing Irregularities • The SAL must immediately report any concern about breaches in test security or noncompliance with test administration procedures to ARE. • Please contact your SAL immediately to report all testing irregularities

38. Testing Irregularities Include… • Building evacuation or lock-down • Power or bandwidth failure • Technology Interruptions • Displaying testing aids in the testing environment (e.g., a bulletin board with relevant instructional material(s) during testing • Failing to provide a student with a documented accommodation • Providing a student with an accommodation that is not documented and therefore is not appropriate • ALL instances of security breaches and testing irregularities must be reported to the SAL who reports it immediately to the ARE.

39. Breach of Test Security • Use of electronic devices (e.g. cell phone) by a student(s) while secure test materials are still distributed or while testing is in progress • Reading non-test related material(s) before closing out the test session • Altering or interfering with students’ responses in any way • Leaving test materials unattended or failing to keep them secure • Leaving students unattended while they are testing • Formally or informally scoring student responses to test items • Failing to follow test administration directions • Not administering a session according to the allotted time ALL instances of security breaches and testing irregularities must be reported to the SAL who reports it immediately to the ARE.

40. Breach of Test Security (cont.) • Failing to actively monitor testing students at all times • Encouraging students to finish early • Cheating by students (passing notes, talking to one another while testing, sharing responses to test items) • Allowing unauthorized persons access to secure test materials • Giving students access to test items or prompts prior to testing • Viewing or letting students view secure content before testing • Copying or reproducing any part of the passages or test items or any secure test materials or online test forms • Removing secure materials from the school’s campus ALL instances of security breaches and testing irregularities must be reported to the SAL who reports it immediately to the ARE.

41. Emergencies • If a student becomes ill during a test: • The student needs are the primary consideration. • The student may make-up the test. • The student may only have the amount of time that was left when the test was suspended. If there is an emergency requiring the test to be stopped: • Evaluate and respond to the emergency … safety first! • If it is possible to do so without any risk to students and your self, note the time remaining in the test session • Students will be allowed to use the remainder of the testing time to complete the session at a later date.

42. Technology Interruptions • Treat technology interruptions as any other “interruption to testing” • Note the time of the interruption • Students must be given remaining time to complete section. • Troubleshooting Devices during testing: • Shut down and reboot device • Try a new device; repeat • Pull student out of testing environment, call Hotline, submit a testing irregularity form. Call your SAL!

43. Most Common Testing Misadministrations When in doubt ASK your SAL if something is allowable. Do not make a judgment call! • A student receives help from anyone on a test item • A student uses an unauthorized instrument, such as a calculator, cell phone or notes, during a test session • A student is denied appropriate accommodations or given the wrong accommodations • Test administrators not reading the Administrator’s Guide verbatim or reading the wrong test session directions. • Test administrators leaving materials on the walls in the testing room that give students an unfair advantage. • Test administrators sharing of test information or aiding students on the exam.

44. Reporting an Irregularity • A test administrator immediately notifies their SAL of the situation or concern. • A SAL calls the CMAS Hotline at 720.423.CMAS to report the irregularity. • SALs will fill out an irregularity report documenting the incident. Test Administrators may need to provide a written account of the testing irregularity that occurred.

45. Infrastructure Trial

46. What is an Infrastructure Trial? • A Dry Run! • An infrastructure trial provides an opportunity for schools and students to prepare for CMAS testing by simulating test-day network utilization and giving students an opportunity to interact with the online testing interface – called TestNav 8 – prior to testing day. • The Trial will confirm that: • TestNav 8 is configured correctly • Devices can successfully run TestNav8 • Participating staff who what to do for CMAS • Students are familiar with the computer-based tools and format

47. Infrastructure Trial Date? When is our school’s Infrastructure Trial? What do I have to do given my role in the school?

48. Online CMAS Resources DPS: http://onlineassessment.dpsk12.org/ CDE: http://cde.state.co.us/assessment/newassess-sum PearsonAccess: http://www.pearsonaccess.com/co

49. This is the End of Part I

50. Section II: Test Administrators