Test Security and Integrity of the Testing Program

1. Test Security and Integrity of the Testing Program Mark Billingsley TSNAP Vice-President Austin ISD

2. Why test security? • Validity • Reliability

3. Security Requirements in Response to Office of Inspector General Report • Records retention – minimum of 5 years • Seating charts – locally maintained • Honor Statement – 9 - Exit • TEA on-site monitors 14-point Security Plan

5. Test Security In Detail • Seating charts required by TEA – locally maintained • Reporting local investigatory and disciplinary actions – (see AISD forms) • Document retention – minimum of 5 years • On-site monitoring

6. Test Security Student Seating Charts • Used to link test administrator to student and student to student • Should include in and out times for test administrator(s) • Must reflect movement of students • To be turned in at check-in (AISD) • Must use district form provided (AISD)

7. Test Security Before test administration • Emphasize importance of training • Train as many staff as possible • Principals are required to attend the campus training (AISD) • Distribute test administrator manuals BEFORE training • Follow procedures for oaths • Account for all test materials • Ensure proper storage of materials • When applicable, set aside Form #1 booklets for oral administration and dyslexia bundling • Verify demographic information • Verify testing requirements for special education students, given changes to assessments this year • Be available for questions

8. Test Security During test administration • Ensure each student receives the correct assessment and testing materials • Practice good inventory control at all levels • Emphasize and verify active monitoring • Ensure all testing personnel understand that they may NOT: • provide assistance • view the tests without authorization • discuss confidential student information • check for strategies

9. Test Security After test administration • No unauthorized viewing or scoring student responses • No discussion of confidential student information • No erasing stray marks or darkening response ovals • Account for all test materials

10. Test SecurityPitfalls to Avoid • Assigning untrained staff to administer and/or monitor tests • Failing to inventory test materials • Having insufficient test booklets and/or test administrator manuals • Not accounting for all test booklets and answer documents each day • Assigning a student the incorrect assessment • Failure to give appropriate accommodation(s) • Improper (or nonexistent) monitoring • Failure to remind students to record their responses and/or failure to verify that students have bubbled their answers • Leaving secure materials unattended

11. Test Security Testing Irregularities Violations Resulting in a Referral • Viewing a test before, during, or after an assessment • Hand-scoring student tests • Discussing secure test content or student responses • Copying secure materials • Any Action that Directly or Indirectly Assists Students with Responses • Clarifying or translating writing prompt or test items • Gesturing, pointing, or demonstrating correct responses • Changing student responses • Providing answers to test questions REMINDER: However well intentioned, these actions are never allowable or appropriate. Also, these incidents must be reported to TEA immediately.

12. Test Security Reminder Monitoring • Before a student leaves the room, the test administrator must inspect the completed answer document to be sure that the student has bubbled in answers as instructed • If the student has not done so, the test administrator must instruct the student to bubble in the answers • Test administrators should look to verify that answers are marked; they cannot look or comment on individual answers • Concerning grade 3, test administrators may quickly look through the scorable test booklets after the students are finished to ensure that all items have been answered, but they may not look at answers to individual items

13. Oath Procedures The process for initialing and signing oaths in 2007-08 was a two-part process: • Initialing and signing after training and before handling secure materials • Signing after completion of each test administration for test administrators and at the end of the testing year for campus coordinators and principals TAKS Campus Coordinator will submit signed oaths at the conclusion of training and will sign them again at the end of the testing season. (AISD) Oath process subject will be revised in 2008-09.

14. Common Testing Irregularities Individualized Education Program (IEP) Errors • Accommodation errors • Wrong assessment

15. Common Testing Irregularities Procedural/Monitoring Errors • Improper distribution & handling of test materials • Use of untrained test administrators or monitors • Improper/incomplete transcribing • Use of cell phones during testing

16. Common Testing Irregularities Calendar Errors • Administering test on wrong day • Administering assessments outside testing window REMINDER: If caught in time and reported to TEA, these can generally be easily fixed.

17. Common Testing Irregularities Missing/Late Return of Secure Materials • Misplaced or lost answer documents • Misplaced or lost test booklets • Late return of secure materials REMINDER: Additional information about return of secure materials can be found in the Secure Materials Supplement.

18. Common Testing Irregularities Oral Administration Errors • Failure to administer test orally to eligible students • Administering test orally to ineligible students • Form 1 not used • Working/scoring/discussing test items NOTE: Be sure to refer to the Accommodations Manual for details.

19. Potential Referral to Educator Certification and Standards Viewing a test before, during, or after an assessment Hand scoring student tests Discussing secure test content or student responses Copying secure materials REMINDER: These incidents must be reported to TEA immediately.

20. Reporting Irregularities • Don’t panic • Gather complete information • DON’T ASSUME - contact TEA if you have any questions about how to handle the problem • Report the incident if an irregularity occurred • Gather all facts • Collect documentation • Submit documentation

21. Reporting Irregularities Notify the Security Task Force immediately if you become aware of one of the following types of irregularities: Teacher/test administrator intervention or assistance Unauthorized viewing, scoring, discussing, or duplication of secure material

22. Reporting Irregularities Collecting Documentation • All irregularities require the following documentation to be submitted: • Incident report (preferably via the Online Incident Reporting Process) • Statement(s) from individuals involved NOTE: Do not use the Student Assessment Incident Report Form to submit statements from individuals involved.

23. Reporting Irregularities Submission of Information Incident reports may be submitted to TEA online using the following guidelines: Access the Online Incident Reporting Process located on the TEA Student Assessment Division website at: Review the procedures for reporting an irregularity online and then click the link entitled “Click here to submit an online incident report.” http://www.tea.state.tx.us/student.assessment/admin/incidents/online/

24. Reporting Irregularities Submission of Information (cont.) Select your district and campus from the pull-down menus and complete the required information on the form. 4. Attach electronic supporting documentation and complete the submission process. NOTE: If you do not choose to use the online system’s attachment feature, all supporting documentation must be submitted by fax to 512-463-9302, or by e-mail to testsecurity@tea.state.tx.us within 10 working days of the incident. Be sure to include the incident identification number provided upon completion of the online submission with each set of documentation.

25. Reporting Irregularities Submission of Information If you encounter difficulties using the online submission process, you can download an electronic copy of the incident report form. Download the incident report form from: Complete the form, save it, and e-mail it as an attachment to testsecurity@tea.state.tx.us . Electronic supporting documentation can be attached to the same e-mail as the incident report, or it can be faxed to 512-463-9302. http://www.tea.state.tx.us/student.assessment/admin/incidents/Student_Assessment_Incident_Report_Form.doc