1 / 12

Test Security Company Perspective

Test Security Company Perspective. Presented by: John Fremer, President, Caveon Consulting Services. NCSA – June 2014. Overview of Presentation. Cannot Let Security For “Non-mainstream " Children Be A n “Afterthought”

chesmu
Download Presentation

Test Security Company Perspective

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Test Security Company Perspective Presented by: John Fremer, President, Caveon Consulting Services NCSA – June 2014

  2. Overview of Presentation • Cannot Let Security For “Non-mainstream" Children Be An “Afterthought” • Our Goal is Meaningful Scores – We Have to Do Many Things RightAt Every Stage • Prevention • Detection • Investigations • Special Challenges Of On-Line Assessment • Sharing What Is Known Is A Key Step

  3. Test Security at Every Stage • Prevention & Planning • Communicate Zero Tolerance • Clear & Consistent Messages • Qualified Personnel – For All Accommodations • Training • Monitoring

  4. Prevention & Planning (Cont.) • Test Security Manager • External Test Security Audit • Formal Test Security Standards • Security Vulnerabilities Identified • Recommendations for Correcting

  5. DETECTION • Use Multiple Data Forensics Methods • Unusual Gains • Similarity • Erasures (Answer Changing) • Person Fit Analyses

  6. DETECTION (cont.) • Adhere to Legal and Regulatory Requirements • Importance of “test user” agreement • Clarify potential consequences of not following testing rules • May want to seek changes to laws or regulations

  7. TEST SECURITY INVESTIGATIONS • Areas Needing Attention • Level of evidence warranting an investigation • Roles for state, district, and other staff • Time lines • Model investigations kit

  8. Test Security Investigations (cont.) • Focus Primarily on Improving Security in the Future • Follow “Innocent Until Proven Guilty” approach, but be firm in your questioning • Give most attention to the “Worst of the Worst” • Consider other possible explanations for results

  9. Special challenges of on-line assessment • Involvement of Readers or Scribes • Selection • Training • Additional Access to Test Materials • May Need to Reproduce Test Materials • Timing • Controls & Monitoring

  10. Special challenges of on-line assessment (Cont.) • Absence of Formal Policies • Lack of Experience • Availability Of Additional Presentation Features • Facilitates large type • System design may interfere with needed accommodations • Need experienced assistance

  11. SHARING WHAT IS KNOWN • Among and Across States • Operational Best Practices • TILSA Guidebook • Possible Additional Material • Learning From Others • ETS, College Board, ACT • Certification Programs • NCEO

  12. For More Information: John Fremer Caveon Consulting Services Caveon LLC 215-805- 3007 (cell) John.fremer@caveon.com

More Related