Kansas Test Security & Ethics

1. KansasTest Security & Ethics Kansas Assessment Program Refresher Training Course For Veteran District Test Coordinators 2019-2020

2. DTC Completion and Verification of Training • All District Test Coordinators (DTCs) in Kansas must participate in one online Test Security and Ethics training module yearly. • All DTCs must provide Verification of Training and Agreement to adhering to policies and practices outlined in the training using a secure website to obtain sign-off verification link. • All DTCs must complete the training module and sign off on or before November 8, 2019.

3. Online Training Options • Veteran DTCs – “refresher” version – this training is designed for those who have been a DTC for at least 3 years. • New DTC – complete training – this training is designed for DTCs who have 0 – 3 years experience as a DTC. • NOTE: An Optional Training Module Designed for DTCs to use with Educators is provided. This training can be adapted by the DTC for training in their district, but it does not fulfill the requirement for DTCs which are listed above. The slides for this training are provided at the end of this module.

4. Veteran (experienced) Training Module • You have selected the: • Veteran DTCs – “refresher” version – this training is designed for those who have been a DTC for at least 3 years. • If this training module description does not describe you, stop and download the training module for NEW test coordinators. • If you are an educator, training will be provided by your DTC or BTC in your district.

5. Materials Needed • Prior to beginning the training you will need to download or have access to the following materials from the KSDE and or KAP website: • 2019-2020 Test Security and Ethics Fact Sheet • 2019-2020 Appropriate Testing Practices Fact Sheet • Kansas State Test Security Guidelines

6. Materials Needed • Prior to beginning the training you will need to download or have access to the following materials from the Kansas Assessment Program website www.ksassessments.org • 2019 – 2020 Kansas Assessment Program Overview (Testing Window Calendar) • Kansas Assessment Examiner’s Manual (KAEM) – Available January 3, 2020

7. Kansas Assessment Examiner’s Manual • The Kansas Assessment Examiner’s Manual (KAEM) will be available the first week of January on the www.ksassessments.org • Any staff member who administers or supports the administration of the state assessment must read the KAEM prior to administering the assessment. • Since this document is not available until January you will need to build this into your training plans and do a careful review of the manual.

8. Purpose • Test security is essential to obtain reliable and valid scores for accountability purposes. • Accordingly, the Department of Education must take every step to assure the security and confidentiality of the state test materials.

9. Purpose • Everyone who is involved in student testing, communicates results, and/or receives testing information is responsible for test security.

10. Purpose • All Kansas assessment programs must abide by test security and ethical testing practices. These programs include: • Kansas assessment summative tests in ELA, math and science • Kansas assessment predictive interim assessments in ELA and math • Kansas English Language Proficiency Assessment (KELPA) • cPass • DLM • note: additional training modules provided for staff administering DLM assessments

11. Security/Ethics Yearly Training • All district and/or building staff who administer or assist with administration of a state assessment must be trained yearly! • Must be an employee of the school system. • No volunteers, parents, etc. may administer a state assessment.

12. Documentation of Agreement • Any staff member who administers a state assessment must sign an agreement to adhere to Test Security and Ethical Testing Practices. • Written verification is needed for the protection of each teacher/proctor and the district. Districts may use “The Agreement to Abide by Guidelines” found in the KAEM, or a district may customize a form to meet their own needs.

13. Trained Personnel • District and Building-level personnel include any staff member who administers a state assessment, including administrators, educators, para educators, etc. • Parent volunteers may not administer a state assessment.

14. Kansas State Test Security Guidelines • Please take time now to read the Test Security Guidelines.

15. KSDE Fact Sheets • Please take time now to read the: • 2019-2020 Test Security and Ethics Fact Sheet • provides an overview of the KSDE test security plan • indicates where to access the roles and responsibilities for the DTC, BTC, and test administrators in test security • tells how to report Testing Discrepancies and Potential Security Violations to KSDE • 2019-2020 Appropriate Testing Practices Fact Sheet • Acceptable practices for testing • Unacceptable practices for testing

16. District Test Coordinator Responsibilities • Oversee test security for the entire district. • Establish and implement test security and ethics procedures for the district. • Train district and building-level personnel before testing begins, which includes training regarding test security procedures, ethics of testing, and reporting/documentation of accommodations. Refer to the KSDE Test Security Guidelines document for a complete list of responsibilities.

17. Required Training Topics The following topics must be included in the training provided by the DTC to BTCs and educators in your district: • KSDE Test Security Plan • District test security procedures • Roles and Responsibilities for DTC, BTC and or Educator/Test Proctor • Reporting Testing Discrepancies and Potential Violations (share both district and state responsibilities) • Reporting Item Issues (and PII) • Appropriate and Inappropriate Testing Practices • Monitor visits • Test Security Agreement to Abide by Guidelines and Sign off Refer to the KSDE Test Security Guidelines document Appendix for list of Required Topics

18. What is PII? • Personally identifiable information (PII) is any data that could potentially identify a specific individual. Any information that can be used to distinguish one person from another and can be used for de-anonymizing anonymous data can be considered PII. 

19. Personally Identifiable Information (PII) Inform staff that personally identifiable information (PII) must not be conveyed when testing issues are reported. The documentation for Kansas regarding allowable identifiers in an email specify that only the Student State ID number and no other identifying details should be provided in an email.

20. When Contacting the Service Desk: Do not send any Personally Identifiable Information (PII) for a student via email. This is a federal violation of the Family Education Rights and Privacy Act (FERPA). PII includes such information as a student’s name, building name, or district name. Do send the student ID number, the test the students are taking (ELA, math, science, predictive interim, mini-test) and the error or concern you are reporting regarding the test taker.

21. Reporting Testing Discrepancies and Potential Security Violations to KSDE • It is the responsibility of the superintendent or their designee, on behalf of any and all school principals, to report in writing, all discrepancies in test material delivery and collection, as well as issues and concerns regarding potential violations of the Kansas State Department of Education’s test security procedures, to Lee Jones, Assessment Coordinator, Kansas State Department of Education, 785.296.4349.

22. Reporting Testing Discrepancies and Potential Security Violations to KSDE In consultation with staff from KSDE upon breach of security, appropriate consequences will be put in place at the district level. Because each case is unique in nature a variety of steps could take place, but are not limited to the following suggestions: • No action taken, discussion with KSDE indicated the breach was not severe in nature to warrant any action • KSDE Action: Written letter and/or phone call to Superintendent, District Test Coordinator stating concerns and processing of action steps • Retesting of students • Removal of test proctors from testing rooms • KSDE Monitor Visit follow-up the next testing year to check for validation that changes to inappropriate practices have been made

23. Sample Data Used to Examine Potential Irregularities • The Assessment Achievement Institute (AAI) provides data to KSDE that examines potential areas of test irregularities throughout testing. • DTC training log (spreadsheet) – this validates that training was completed by the DTC in each district in Kansasand who participated in the training. • Test Reactivations – frequency of reactivations • Click History for responses and ending tests • Tests taken “after” school hours (i.e. with students who attend a virtual school test after the end of typical school day is allowed)

24. DTC Responsibilities:Daily Access Code • During summative testing, students must use a daily access code to enter the Kite Student Portal. • This code is provided in the Educator Portal and is not directly available to teachers and test proctors. As the DTC your must: • Establish and describe the system used for sharing Daily Access Codes with staff. This plan should include the secure transmission of the information each day.

25. DTC Responsibilities:Reactivating Tests • When reactivating tests, you will not be able to view any student answers. Instead, you will be able to see which students have started the test and whether or not they have completed various sections of the test. • You must first end the test session and then click reactivate. • DTCs must keep records of reactivations and “why”

26. Monitoring Tests and District Testing • When monitoring tests, you will not be able to view any student answers. Instead, you will be able to see which students have started the test and whether or not they have completed various sections of the test.

27. Dashboards • The Dashboard provides key metrics that are critical to state and district stakeholders during testing. • Daily monitoring of the dashboard by DTCs and BTCs is essential. • Each tab on the Dashboard allows you download an extract for your school and/or district. • Testing Summary • Scoring Summary • Reactivations • Testing Outside School Hours • Kite Error Messages • DTCs should review the Dashboard on a daily basis to assist with internal monitoring of testing.

28. Monitor Visit: Purpose • KSDE staff and the members of the Kansas Assessment Advisory Council visit about 10% of Kansas schools during test administration yearly for the purpose of monitoring test security.

29. Monitor VisitsDistrict and School Selection • a representative sample of districts across Kansas, across all state BOE regions including both large and small districts are selected for monitor visits every year in Kansas

30. Projected Testing Dates (EP) • The Projected Testing and scoring tab within Manage Tests is available.  • Information can be entered or uploaded by DTC and/or BTC. • This helps ATS understand projected system testing loads by day.  It helps KSDE see testing schedules in the field for assistance with monitor visits. • It is also an easy way for DTCs to see when buildings are testing in case you have a monitor visit! • Pages 42- 49 Not required, but is an extremely helpful and easy way to manage testing schedules! However, if you are selected for a monitor visit you must be able to provide an up-to-date schedule.

31. Monitor Checklist • Posted on the KSDE website – assessment page, also included in the Test Security Guidelines Appendix. • Completed by visiting team member(s)and shared with the school upon completion of the visit • KSDE reviews information provided and looks at the good things that are happening and for ways to enhance test security and ethics in the future.

33. Kansas State Test Security and EthicsQuick Check

34. Kansas State Test Security and EthicsQuick Check

35. Kansas State Test Security and EthicsQuick Check

36. Kansas State Test Security and EthicsQuick Check - KEY • True • True • False – Parents may not administer the assessment. • True • False – you may not read questions or passages from the screen. • True • True • True • True • False – Report only the student id, test being taken, session number and item number and the issue with the item.

37. DTC Validation of Training • Once you have completed this training please go the HELP tab inside the EP. • Open the document that titled: Test Security Validation • This document will provide you access to the link for completion of training and agreement to abide by. • You must complete this by November 8, 2019.

38. Questions • If you have specific questions please contact: • Lee Jones, KSDE ljones@ksde.org • Mary Matthew, AAI mmatthew@ku.edu

39. Test Security and Ethics Kansas Assessment Program Training Course For Educators This section of the PowerPoint is designed for use by DTC to modify and/or adapt to meet the needs of their district.

40. Agenda • KSDE Test Security Plan • District test security procedures • Roles and Responsibilities for DTC, BTC and or Educator/Test Proctor • Reporting Testing Discrepancies and Potential Violations (share both district and state responsibilities) • Reporting Item Issues • Appropriate and Inappropriate Testing Practices • Monitor visits • Test Security Agreement to Abide by Guidelines and Sign off

41. Verification of Training • All District staff who administer a state assessment must provide Verification of Training by signing an agreement to abide by form and sign off on training. • District and Building-level personnel include any staff member who administers a state assessment, including administrators, educators, para educators, etc. • Parent volunteers may not administer a state assessment.

42. Verification • Any staff member who administers a state assessment must sign an agreement to adhere to Test Security and Ethical Testing Practices. • Written verification is needed for the protection of each teacher/proctor and the district.

43. Materials Needed • Prior to beginning the training you will need to download or have access to the following materials from the KSDE and or KAP website: • 2019-2020 Test Security and Ethics Fact Sheet • 2019-2020 Appropriate Testing Practices Fact Sheet • Kansas State Test Security Guidelines

44. Testing Window • Share your district testing dates • Prior to beginning the training you will need to download or have access to the following materials from the Kansas Assessment Program website www.ksassessments.org • Testing Window Calendar • Kansas Assessment Examiner’s Manual (KAEM) – Available January 3, 2020

45. Kansas Assessment Examiner’s Manual • The Kansas Assessment Examiner’s Manual (KAEM) will be available the first week of January on the www.ksassessments.org • Any staff member who administers or supports the administration of the state assessment must read the KAEM prior to administering the assessment. • Highlight text that is important to you when administering a state assessment.

46. Kansas State Test Security Guidelines • Please take time now to read the Test Security Guidelines. • This training will reference key points in the document that are critical for staff who administer a state assessment to understand. • Highlight text that is important to the role you serve when administering a state assessment.

47. Fact Sheets • Please take time now to read the: • 2019-2020 Test Security and Ethics Fact Sheet • provides an overview of the KSDE test security plan • indicates where to access the roles and responsibilities for the DTC, BTC, and test administrators in test security • tells how to report Testing Discrepancies and Potential Security Violations to KSDE • 2019-2020 Appropriate Testing Practices Fact Sheet • Acceptable practices for testing • Unacceptable practices for testing

48. Purpose • Test security is essential to obtain reliable and valid scores for accountability purposes. • Accordingly, the Department of Education must take every step to assure the security and confidentiality of the state test materials.

49. Purpose • Everyone who is involved in student testing, communicates results, and/or receives testing information is responsible for test security.

50. Purpose • All Kansas assessment programs must abide by test security and ethical testing practices. These programs include: • Kansas assessment summative tests in ELA, math and science • Kansas assessment predictive interim assessments in ELA and math • Kansas English Language Proficiency Assessment (KELPA) • cPass • DLM • note: additional training modules provided for staff administering DLM assessments