2013 CRT &ALT Test Administrator Training

1. 2013 CRT &ALTTest Administrator Training Presenter: Date:

2. OBJECTIVE: • TAs will be able to maintain the integrity of the MontCAS to ensure accurate, reliable, and valid results.

3. AGENDA Online test materials, resources, and trainings Test Security Test Administration Accommodations

4. WHO CAN BE A TEST ADMINISTRATOR (TA)? • Licensed professionals • May not adminster but can assist under direct supervision of a TA. • Substitute teachers • Student teachers • Paraprofessionals • All TAs must be trained

5. TEST ADMINISTRATOR RESPONSIBILITIES Attend training Read test administration manual Ensure test security Report test irregularities or security breaches Prepare testing environment Correctly administer the assessment Understand and provide accommodations correctly

6. Online Test Materials, resources, and trainings

7. TEST DOCUMENTS, RESOURCES, AND TRAININGS ONLINE

8. Test Security

9. TEST SECURITY STATEMENT All test booklets, test questions, and responses to those items in the Montana Comprehensive Assessment System Criterion-Referenced Test (MontCAS CRT) are secure materials and may not be copied or duplicated in any way or retained in the school after testing is completed. Systems and schools are required to return all test booklets to Measured Progress after testing is completed.

10. TESTING IRREGULARITY Definition: Any event (before, during, or after testing) that could potentially impact the security of the test or the accuracy of the test data. Includes any actions or precautions that vary from directions specified by testing contractor manuals or OPI. Can constitute a security breach which could result in invalidating student scores and impacting AYP determinations.

11. TEST SECURITY/IRREGULARITY ISSUES • Securing Test Materials • Late or Missing Materials • Procedural/Administration Issues • Security Breach • Coaching • Testing environment

12. SECURE TEST MATERIALS • Test booklets, answer booklets and other materials defined by OPI or testing contractor as secure. • These must be kept in a secure location and not copied. • System and school test coordinators, principals, and test administrators are responsible for secure test materials. • Not maintaining the security of materials is a security breach.

13. TEST MATERIAL SECURITY- ROLES AND RESPONSIBILITIES • The System Test Coordinator is responsible for collecting, inventorying, and returning all test booklets to Measured Progress. • School test coordinators are responsible for the security of testing materials and their return to the System Test Coordinator. • The Test Administrator is responsible for security. of test materials and their prompt return to the school testing coordinator

14. SPEEDY AND ACCURATE RETURN OF MATERIALS Test Booklets Answer Booklets

15. LATE OR MISSING MATERIALS Any missing test booklets or delays in returning them to Measured Progress are considered a security breach and will be treated as a serious testing irregularity and could impact AYP results.

16. SECURING TEST MATERIALS • Test materials must be kept secure when not being used for testing • [Insert school/district procedures for securing test materials] • Central locked location • Material check in and check out procedure • Procedure for locking materials in classroom between sessions • Procedure for when a student who needs extra time beyond the scheduled session moves with test materials to alternate location.

17. PROCEDURAL--SECURITY BREACH DEFINITION A security breach is a violation of a testing procedure that gives an unfair advantage to a student or a group of students. A security breach could jeopardize the security and integrity of the tests and/or resulting data.

18. MAINTAINING A STANDARDIZED TEST ENVIRONMENT- DO ACTIVITIES PROCEDURAL--SECURITY BREACH Do cover or remove bulletin boards and instructional aids Do ensure that no student has any form of assistance or material that other students in the state do not have. Do clear home screen (not memory) of calculators both before and after calculator use sessions. Spring 2013

19. Test Security and Cell Phones • Do not allow students to have cell phones in testing areas. (This constitutes a test irregularity) • Not to be used as calculators • Not to be used when a student has completed the test and is waiting • Not to be in testing area EVER • Recommendations • Cell phones should be left in a locker or at home on testing days. (include this in any communications with parents) • Let students know consequences • Do a cell phone reminder before the testing session starts, as students enter the room.

20. Maintaining a Standardized Test Environment- Do not activities PROCEDURAL--SECURITY BREACH • Do not • Answer questions related to the test. • Allow students to have cell phones, headphones,* or other electronic communication devices in testing areas. • Allow students to use dictionaries, thesauri, or reference sources.* • Allow students to use calculators when not specified. • Fill in any unanswered questions or provide actual answers. • Give students access to secure test questions prior to testing or discuss test questions at any time. • Do not… deviate from the procedures specified in the MontCAS test coordinator and administrator manuals. (NOTE: there may be some cases in which the OPI requires procedures different from those in the manuals published by the test contractors. DO follow the OPI procedures.) • Leave students unattended with testing materials or to take them unaccompanied to another location. • Allow students to go back to previous test sections to review, complete, or revise answers. • Allow students to re-test once they have started or completed a test section. • Provide accommodations other than those specified and allowed in MontCAS accommodations guidance.

21. COACHING • Coaching is a type of a procedural security breach. • Examples: • Providing answers to students • Changing student responses • Influencing student responses to test questions by offering hints, clues, cues, facial expressions, nods, voice inflections, or any other manner of assistance that could impact a student’s answers. PROCEDURAL--SECURITY BREACH

22. WHAT DO I DO IF…. • A student asks me what a word is… https://tellagami.com/gami/AFC338/ • I see a student bubbling in the wrong place? https://tellagami.com/gami/41NDX1/ • I want to provide global instructions; can I do that and how do I do it properly? https://tellagami.com/gami/FM58IC/ • A student tells me there is a problem with one of the items on the CRT? https://tellagami.com/gami/FM58IC/

23. TEST SECURITY DOCUMENTATION • Information sheet for teachers • Information sheet for teachers describing their test security responsibilities and what training they should expect. • Each educator handling materials or administering the CRT or CRT-Alternate must receive a copy of this form so they will know what training to expect and what is expected of them.

24. SECURITY REMINDERS Delays in accurate AIM data entry or return of used Answer Booklets could impact timely reporting of results and/or impact individual district or school AYP results. Any missing Test Booklets or delays in returning them to Measured Progress are considered a security breach and will be treated as a serious testing irregularity and could impact AYP results.

25. PROCEDURAL--SECURITY BREACH • A security breach is a violation of a testing procedure that gives an unfair advantage to a student or a group of students and could jeopardize the security and integrity of the tests and/or resulting data.

26. TEST IRREGULARITY REPORTING PROCESS • 2013 Test Security Manual, pages 8 and 22 • Who should be informed? • System Test Coordinator • Principal • Superintendent • OPI—within three days by phone and five days online Spring 2013

27. Test Administration

28. PREPARING TESTING ENVIRONMENT • Post “Testing in Progress – Do Not Disturb” signs on all entrances to the testing location. (available on OPI site) • Remove or cover all instructional materials • E.G. anchor charts, word walls, anything that students use to activate memory. • Hint: can use newspapers or roll paper to cover materials instead of taking them down and putting them back up again. • Collect necessary materials

29. TO COVER OR NOT TO COVER?

30. MATERIALS • Test booklets • Answer booklets (with barcode label attached prior to testing) • 3rd graders will write all answers directly in the test booklet. • #2 Pencils • Highlighters (optional) • Scratch Paper • Collect and destroy after each day of testing • Calculators • Only for calculator use sessions • One per student • Clear screens and collect after each session • Math reference sheets (during math session only)

31. BEFORE THE TEST SESSION: WRITE ON BOARD Teacher’s name Keep working until you reach the stop sign for the session, located on the bottom-right corner of the page. Do not go beyond the stop sign for the session. When you finish the test session, you may check your work in that test session only. For constructed-response questions, make sure your work fits in the space provided. Mark the answer to each multiple-choice question by filling in the correct bubble in your Answer Booklet. (Grade 3 students will mark their answers directly in their Test Booklets.)

32. STUDENT BARCODE LABEL SAMPLE

33. Example of Front Page Required for all grades 4-8 Printed on the cover of each test booklet is a form number (1-4.) The test booklet form that a student tests with must be bubbled here in Box F. Note: grade 3 has an integrated test booklet and the form number is already printed on it If you did not receive a label for a student or it was damaged, boxes A, B, D & E must be bubbled.

34. Example of Page 2 For Special Education & 504 students. Use pg. 33-36 from the TAM to code in accommodations.

35. BUBBLING As part of the TA script you will go over proper bubbling including what to do when changing answers.

36. TEST ADMINISTRATION SCRIPTS Go over test administration scripts in the TAM Suggested activity: do a quick review and have TAs mark the pertinent parts of the script. (highlighter or tabs) Each TA will need to have a TAM for this.

37. WHEN STUDENTS FINISH EARLY: • Announce ahead of time • Students who finish early may: • Check their work in that session of the test only • Sit quietly • Use scratch paper to draw • Read silently

38. WHAT IF THERE IS A MAJOR DISRUPTION? E.g.: Fire Alarm, power outage If possible collect and secure tests [insert your school procedures]

39. DISRUPTIVE STUDENTS? • Plan ahead • Have a location where you can bring a student who is disruptive. • Have a plan for staff to escort and then administer the test in that location. [Discuss your school’s plan]

40. MAKE UP TESTS • Make up Tests • If one session is missed does the student need to make up the whole assessment in order? • No the student should continue on with the sessions as scheduled and make up only the session/sessions that were missed. • [Discuss your school’s make up test plan]

41. accommodations

42. Accommodations are changes in the standard practices and procedures used to teach and assess students. • Accommodations decisions are made for individual students not groups of students. • For use on a standardized test, accommodations should be in place and used in formal classroom assessment routinely three months prior to the standardized assessment.

43. ACCOMMODATION ELIGIBILITY --GENERAL POPULATION Spring 2013

44. ACCOMMODATION ELIGIBILITY --STUDENTS WITH IEPS OR 504 PLANS Spring 2013

45. ACCOMMODATION ELIGIBILITY--LEP STUDENTS Spring 2013

46. IMPACT OF ACCOMMODATIONS ON TEST SCORES

47. WHAT PRACTICES DOES THIS INCLUDE? Presentation accommodations– Allow students to access information in ways that do not require visual reading of standard print. Response accommodations– Allow students to complete activities or respond to questions in different ways. Setting accommodations– Change the location in which an activity or test occurs or the conditions of the setting. Timing and Scheduling accommodations–Change the way in which the time is organized.

48. ACCOMMODATION REMINDERS PRESENTATION Oral Presentation- Standard • Math and Science: • Tests may be read aloud to a student by the Test Administrator as a standard accommodation. • Special math and science text features • Reading Digits • Reading Symbols • Reading charts and graphs • Reading: • Test questions and answer choices may be read aloud to a student by the Test Administrator as a standard accommodation. The reading passages MAY NOT be read aloud to a student as a standard accommodation.

49. PRESENTATION ACCOMMODATION REMINDERS Oral presentation-non standard • Reading • Reading aloud of the reading passages to a student or the student using text-reader software for reading passages is considered a non-standard accommodation. Spring 2013

50. RESPONSE ACCOMMODATION REMINDERS Response Accommodations • Accommodations requiring TA to transfer or scribe a written response • Word for word including punctuation • No. 2 pencil • Directly into answer booklet • Test administrators may not: • Clarify • Elaborate • Make any changes not initiated by the student