1 / 18

Unproctored Internet Based Testing

Discover the advantages of unproctored internet-based testing for recruitment streams and job-specific applications. Our flexible and scalable solution allows for global access, while ensuring security and mitigating risks.

billings
Download Presentation

Unproctored Internet Based Testing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Sep 2018 Unproctored Internet Based Testing ATP- SIG (Brussels)

  2. Unproctored internet-based testing https://assessments.un.org

  3. Background 400 000 2 000 1 : 200

  4. Challenges Austerity Application Growth 300% 65% “Do more with less”

  5. Recruitment streams Applications Stream Selections Job specific Up 1,200 1 40 Multiple jobs Up 12,000 50 Up 20,000 Reserve lists

  6. Types of tests • Job knowledge • Case studies • Essay items • General knowledge • Translation • Multiple Choice • Drafting • Cognitive ability • Situational judgement

  7. Delivery requirements • Available anywhere, anytime • Scalable to cover peaks • Cost effective • Record applicants’ action • Flexible solution to evolve • Accessible for a disability or impairment • Use by different entities under one roof • Branded for our org

  8. Solution Just one tool in the selection process • Online • Unproctored • On open source • Developed in-house

  9. Concerns Global access System reliability • Online Applicants’ readiness • Unproctored Security of material/data Equivalence paper/online • On open source Dishonesty • In- house solution In-house capabilities Accommodation

  10. Mitigating risks – online (1/3) Advanced Notice • Global access IT requirements Sample Tests • Applicants’ readiness Applicants’ responsibilities

  11. Mitigating risks – online (2/3) Conducted equivalence studies (comparable means and SDs) • Equivalence paper/online Ensured equivalent test-taker control (such as the ability to skip or review items) as on the manual version

  12. Mitigating risks – online (3/3) Load tests Cloud hosted • System reliability UN IT security infrastructure • Security of material/data Website remediation • Accommodation Test design considers accommodations

  13. Unproctored- issues • The use of test-taking proxies Dishonesty • Use of illicit aids • Pre-knowledge of test items obtained from previous test takers • Post on social media • Studies on performance differences between proctored and unproctored test takers inconclusive

  14. Mitigating risks - unproctored • Username and password • Remotely proctored verification test • Test timer Dishonesty • Clear instructions • Web patrol • Data forensic – plagiarizing software • Randomized questions • Type of questions • Adaptive tests

  15. Mitigating risks – open source • Access to large network of Moodle developers In-house capabilities • Number of UN learning platforms use Moodle

  16. Our Experience so far… Competitive Exam • Hours-long online constructed response and MCQs • Large volumes • Global applicant pool Regular Vacancies • Shorter constructed response/essay • Global applicant pool • All levels (incl. senior) Unproctored Internet-based Testing Roster exercises • Constructed response and MCQs • Large volumes • Global applicant pool

  17. Our Experience so far… Advantages • Low cost per applicant • Open-source communities of support • Flexible Disadvantages Unproctored Internet-based Testing • Infrastructure required • IT Specialist required • Live Test-taker support required

  18. Considering IBT, consider this.. Infrastructure? Test Content? Test-Takers? Unproctored Internet-based Testing Communications?

More Related