Wisconsin Knowledge & Concepts Examination (WKCE) Test Security

1. Wisconsin Knowledge & Concepts Examination (WKCE) Test Security Wisconsin Department of Public Instruction Office of Educational Accountability 06/26/2013

2. Purpose of this Training Security • To emphasize the importance of test security • To ensure the standardized administration of the tests • To make sure that there is not an unfair advantage to some students • To improve the overall understanding of test security procedures

3. Test Security The primary goal of WKCE test security is to protect the integrity of the examinations by • Securing the test materials at all times • Ensuring appropriate administration of the test

4. Consequences of Test Security Violations • When the security of an item is breached, this may result in making the item unusable in future tests. The state then incurs additional costs associated with item development, which is already a very expensive process. • An unfair advantage may be provided to some students, making it difficult to draw meaningful conclusions about their performance.

5. Consequences of Test Security Violations • Invalidation of test results for individual students or groups of students. This will result in • Parents receive no scores on their child’s report if a test is invalidated • Public reporting will reflect all invalidated tests as “not tested”. This may reduce the percentage of students meeting proficiency. • Schools may have a more difficult time meeting the accountability requirements as a result.

6. Stages of Test Administration During WhichTest Security Must be Ensured • Prior to testing • During testing • After testing • During Item Analysis /data retreats

7. Prior to Testing • District Assessment Coordinators (DACs) • Read the Test Security Manual, District/School Assessment Coordinators Guide (DAC Guide), Test Administration Manual (TAM), and the Accommodations Guidelines • Sign the confidentiality agreement form and send it to DPI • Collect signed & completed confidentiality agreement forms from School Assessment Coordinators (SACs) and other appropriate district staff who will be working with the assessment • Make sure that SACs and other district staff are aware of the importance of the test security • Train SACs and appropriate district staff on test administration and test security procedures

8. Prior to Testing • District Assessment Coordinators (DACs) • Inventory & secure all test materials immediately after receipt • Send the test materials to the SACs in a secure manner • Ensure SACs inventory test materials immediately after receipt • Ensure test materials are locked and securely stored in a single location at the central district office or at a school • Ensure proctors are trained on standardized test administration to help monitor testing • Ensure SACs arrange for proctors to monitor students

9. List of Responsibilities at DAC Level • Monitor each school’s testing schedule. Make sure that the SAC takes appropriate measures to ensure that the each session is administered in one sitting. • Ensure that students are supervised during testing sessions. • Make sure that you have a local school board policy in place for handling the personnel issues relating to test security breaches and report to DPI/OSA. • Report all testing irregularities to the Office of Student Assessment (OSA) via the Test Security Incident Report Form

10. Prior to Testing • School Assessment Coordinators (SACs) • Read the Test Security Manual, District/School Assessment Coordinators Guide (DAC Guide), Test Administration Manual (TAM), and the Accommodations Guidelines • Sign the confidentiality agreement form and send it to DAC which will be retained at the district level. • Collect confidentiality agreement forms from appropriate school staff and test administrators/proctors who will be working with the assessments • Inventory all test materials immediately after receipt from DAC • Provide training to appropriate school staff and proctors • Arrange for more proctors to help monitor testing

11. List of Responsibilities at SAC Level • Ensure test materials are locked and securely stored in a single location • Monitor security of test booklet before, during and after assessment • Ensure the teacher or test administrators have been informed of test security breaches • Follow district procedures for reporting test security • Monitor the standardization of test administration • Report all testing irregularities to the district test coordinator via the Test Security Incident Report form

12. During Testing • DACs • Ensure test materials are locked and securely stored in a single location at the central district office or at a school • Supervise and, if necessary, help coordinate the schools’ daily handling and security of test materials.

13. During Testing • DACs & SACs • Ensure that students are supervised by trained proctors during testing sessions.(proctors are employed district staff including administrators, teachers, and paraprofessionals employed by the school or district, and may also include the student teachers who have responsibility for supervising students. Parent volunteers should not be allowed to proctor examinations) • Make sure that standardized test administration practices are followed • Each session in a content area should be administered in one sitting • Follow testing policies for electronic devices including calculators and cell phones. • Secure all tests daily

14. Calculator Policy • The use of calculators varies by grade. There are clear directions for the use of calculators in the Test Administration Manual and the Policy Manual both of which can be accessed at http://oea.dpi.wi.gov/oea_publications. • It is important to review these policies carefully as inappropriate use of calculators during test administration may result in invalidation of test results.

15. Appropriate Use of Test Accommodations • For use of allowable accommodations, please refer to the assessment matrix available at http://oea.dpi.wi.gov/oea_accommtrx • In the event that an accommodation is not on the matrix but necessary for a student to demonstrate their knowledge & skills in a content area , a non-standard accommodations request form should be submitted to DPI for consideration. This form is available at http://oea.dpi.wi.gov/oea_accommtrx • If DPI agrees that the requested accommodation does not affect the validity of the test, it will be approved. • If it does impact test validity, the school may use the accommodation but the student will be counted as “not tested”.

16. After Testing • After testing, all test books—those to be scored and those not to be scored—are to be returned to CTB • Missing test materials should be reported to DPI immediately

17. Test Book Retention • All test books must be returned to the testing vendor after testing • Test books are no longer allowed to be retained in schools / districts • A copy of the test book at each grade level will be kept at each CESA to meet the Public Access statutory requirement only

18. Data Retreats • WKCE Item Analysis Reports are available in the secure Online Reporting Site (ORS) • All DACs have passwords for this secure website • Data retreats should be conducted using these reports • Test books / Items must not be used during data retreats

19. DPI DAC - Send DAC signed form to DPI SAC - Send SAC signed form to DAC (Forms retained at the district level) Proctors, Teachers, and any school staff handling the test materials - Send signed forms to the SAC (Copies retained at the school level) Handling Confidentiality Agreement Forms

20. List of Responsibilities at Proctor Level • Read the Test Security Manual, and the Accommodations Guidelines • Read and follow the directions as stated in the Test Administrator’s Manual • View the Test Security PowerPoint Training for Proctors • Attend WKCE test administration training session prior to each test administration year • Review the Accommodation Guidelines • Remain in the room throughout the entire test administration

21. List of Responsibilities at Proctor Level • Follow the procedures established by the school assessment coordinator for returning all used and unused testing materials, blank paper, and supplemental materials • Report all testing irregularities to the school test coordinator such as • Student going back to the previous session • Student cheating • Unallowable accommodations

22. Test Security Violations to Avoid • Use of a non-allowed accommodation e.g. Reading the reading test. • Use of live test items for test preparation activities • Allowing the use of calculator for computation sections in Mathematics

23. Reporting Test Security Violations • Test Security violations / irregularities should be reported to DPI at 608-267-1072 • Submit a completed Incident report Form to the office of Student Assessment • Districts may be contacted to conduct further investigation • Districts might choose additional consequences as related to personnel contracts / issues

24. Initial Report Alleging Specific Violation A test security violation is reported and received by the Department of Public Instruction from any individual, school, or district alleging that a specific breach in test security has occurred in an individual district or testing site via telephone, email, or submission of the test security violation form. Initial Internal Review of Alleged Test Security Violation The Office of Student Assessment (OSA) reviews all reports brought to the team to determine how best to resolve the allegation by analyzing the severity of the alleged breach of test security and the scope of potential harm the breach may bring to the integrity of the assessment results. Telephone Assistance from OSA to the District Assessment Coordinator (DAC) Invalidation of Test Scores Letter from Director of OSA No Violation Determined/No Consequences Districts may choose additional consequences regarding personnel issues. Process for Handling Test Security Violations

25. Thank You! For additional information, please contact osamail@dpi.wi.gov