1 / 28

Agenda

Agenda. What is On Demand Testing? Types of Tests Available Uses and Benefits of On Demand Testing Progress Tests Linear Test Reports (Progress Tests) Computer Adaptive Tests Interpretation of On Demand Test Outcomes Software Upgrades Future Directions Contacts.

vincent-petty
Download Presentation

Agenda

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Agenda • What is On Demand Testing? • Types of Tests Available • Uses and Benefits of On Demand Testing • Progress Tests • Linear Test Reports (Progress Tests) • Computer Adaptive Tests • Interpretation of On Demand Test Outcomes • Software Upgrades • Future Directions • Contacts

  2. What is On Demand Testing? • The VCAA Assessment Online System delivers online tests from a central repository to student PCs via the Internet and a school’s local network. • Teachers may use the resource when, where and how they choose. • It is optional, time-saving and able to be administered to a single student and/or a whole class.

  3. Type of Tests Available Computer Adaptive Tests English Mathematics (30 or 60 question tests) Linear Tests English Mathematics Progress Tests (30 question tests) and Standard Linear Tests (15 to 25 question tests)

  4. Uses of On Demand Testing • LIT Program pre-testing and post-testing students (168 schools, 500 teachers) • Teaching and Learning Coaches Initiative (382 Schools, 1500 teachers - Mathematics and Science) • NMR Zones Improvement Project (55 schools) • Assisting in forward planning of teaching programs • Corroborating teacher judgments • Online trials of new items/tests

  5. Benefits of On Demand Testing • Identifying strengths or weaknesses of individual student’s learning outcomes (Linear/Progress Tests) • Testing the general range a student can perform in (Adaptive Test) • Reporting on performance and student progress tracking

  6. Progress Tests • All questions and tests are created by the VCAA P-10 Unit, and are referenced to the Victorian Essential Learning Standards (VELS). • Progress tests have been designed to provide an estimated VELS Progression Point outcome for students. • Progress tests’ results are limited to a given VELS range eg 2.0 to 2.5 • To confirm results for students who achieve close to zero or perfect scores on these tests it is recommended that an additional test at a higher or lower level be administered.

  7. Progress Tests • Mathematics: Number (six tests) • English: Reading (six tests) • VELS 2.0 to 2.5 • VELS 2.5 to 3.0 • VELS 3.0 to 3.5 • VELS 3.5 to 4.0 • VELS 4.0 to 4.5 • VELS 4.5 to 5.0

  8. Progress Tests

  9. Linear Test Reports (Progress Tests) • Student Raw Score by Question Standard Level Report • Class Raw Score by Question Standard Level Report • Student Percentage Correct by Question Standard Level Report • Student Percentage Correct by Key Area Report • Student Skills Report • Class Skills Report

  10. Computer Adaptive Tests • All questions correspond to a curriculum outcome • Selected from a large pool of Mathematics and English questions downloaded to the school • Test adapts to each student’s ability • 30 question single dimension CAT 60 question general CAT across a domain • Tests take about 15 - 30 minutes • Variable timing for questions that timeout (i.e. 60, 90, 120 secs etc)

  11. Computer Adaptive Tests • Students cannot return to previous questions • Students will get more challenging questions as they answer • Paper & pencil/pen are allowed • No calculators allowed during the test

  12. 4M 4L 4H 5L 3H 4M 5M 3M 4L 4H 3L 3H 5H 4M 5L 3M 4L 4H 5M Computer Adaptive Tests Sample Answer Roadmap (Individual Student)

  13. Adaptive Test Report

  14. Interpretation of On Demand Test Outcomes • VELS Translation Table • Progress Test Student Data • Adaptive Test Report • Comparing Progress Test and Adaptive Test Standard Scores

  15. VELS Translation Table (Excerpt)

  16. Progress Test Sample Data

  17. Adaptive Test Report

  18. Progress Tests Vs Adaptive Tests

  19. Software Upgrades • The On Demand system is packaged with Virtual Machine (VM) Ware. • The On Demand VM Ware package is distributed on CASES 21 to Government schools. • Upgrades to the School Server are important. Upgrades include new features and system maintenance.

  20. Future Directions • Review of the VCAA Assessment Online system • On Demand usage survey • Program rebuild • Adaptive Test expansion • Extend to Years 9 and 10 (English and Mathematics) • Top up Years 2 to 8 to 200%

  21. VCAA ASSESSMENT ONLINE CONTACTS • WEB • http://www.aimonline.vic.edu.au/ • Helpdesk • Freecall Number 1800 827 721 • Email • vcaa.ondemand.support@edumail.vic.gov.au

More Related