1 / 15

Test Security Guidebook

Test Security Guidebook. West Virginia: A State Perspective. An Important Addition. A compilation of “Best Practices” 3 Key Areas Prevention Detection Investigation Key Implications: Potential source to conduct a gap analysis Preparation for any test security requirements .

heidi
Download Presentation

Test Security Guidebook

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Test Security Guidebook West Virginia: A State Perspective

  2. An Important Addition • A compilation of “Best Practices” • 3 Key Areas • Prevention • Detection • Investigation • Key Implications: • Potential source to conduct a gap analysis • Preparation for any test security requirements

  3. State Awareness Timeline • Test security has always been of interest to SEAs • Security breaches have thrust assessment issues into the spotlight • SEAs, LEAs, and schools now have a dedicated interest in test security and assessment integrity

  4. Assessment Integrity Ensuring the validity and reliability of assessment results through standardized and secure assessment conditions. ®

  5. A State’s Potential Context • The 3 Ps of Assessment Integrity • Policy • Politics • Practical Implications (i.e., reliability of results) • What is the driver? • Timing + Severity + Pervasiveness + Climate = • Crapshoot

  6. A State’s Potential Question • How often have people in testing programs been asked to engage in a potentially controversial decision in advance of clear and distinct policy or practice? • Drives the need for solid guidance to drive best practice.

  7. WV’s Approach Greatest Area of Emphasis

  8. Primary Focus • Prevention • Training • Security of Test Materials • Policy-based Definitions • Code of Ethics • Signed Agreements

  9. Secondary Focus • Investigation • Allegations • Pattern Analyses • Gains Analyses • Qualitative Analyses • Documentation • Interviews • Written/oral complaints or reports

  10. Secondary Focus Cont’d • Detection • Erasure Analyses • Reporting Protocols • Investigation Protocols

  11. Newest Areas of Focus(West Virginia) • Detection • Staff assigned to troll: • Twitter • Pinterest • Facebook • New Technologies • Snapchat • http://www.snapchat.com/#What-is-snapchat? • Unmonitored photos that are automatically deleted

  12. Result and Implications • Uncovered more instances of test administrator violations • Kids sleeping • Student tweets (positive and negative) • A few cases of administrators sleeping • What’s next? • Documenting assigned roles and responsibilities, as well as the process.

  13. Where are we now? • Waiting for the next AJC article • (Quality?) Information everywhere about test security practices, audits, and requirements. • The guidebook providing a comprehensive look at the three major categories • Taking recommendations to create actionable information that practitioners can use to revise practice and policy

  14. Using the Guidebook • Prevention • Documentation that can be used for a “best-practices check” • Detection • Potentially a weak area for states • Need defensible analyses to mitigate Type 1 and 2 error • More sources for triangulation • Follow-up Investigations • Establish policies and procedures to have something to reference (e.g., invalidations)

  15. Thank you Contact Information Juan D’Brot West Virginia Department of Education Executive Director Office of Assessment and Accountability Office of Research jdbrot@access.k12.wv.us

More Related