120 likes | 305 Views
Using Authorware to Implement a New Assessment Strategy. Presenter: Kay Fenton UNITEC Institute of Technology Auckland, New Zealand. Background. English, Maths & General required for entry to our Programmes
E N D
Using Authorware to Implement a New Assessment Strategy Presenter: Kay Fenton UNITEC Institute of Technology Auckland, New Zealand
Background • English, Maths & General required for entry to our Programmes • Project implemented in 2002 to investigate possible On-Line delivery of the aptitude test • Current CBT software packages evaluated – not flexible enough Paper based test
Criteria • Real-time control to make sure all participants complete test in given time limit • Fast and easy reporting of scores • Reliable and robust system • Consistent explanation of test tasks • Alternate versions of test to be delivered
Software Implementation • Macromedia Authorware chosen for creating interactive test material • On-Line delivery • Real time control mechanism based on Microsoft Exchange Service
Test Formats • Divided into four sections • Section 1 – English test, uses free format therefore marking done manually • Section 2 & 3 - multiple choice comprised of maths and reasoning questions • Section 4 – logic diagrams with multiple choice questions
Supervisor Control Panel • Easy way to control testing process • Sends all instructions and demos to participants machines
Marking and Reporting • At the end of each section participants results stored on server • Marking and reporting are quick and efficient • Reports classified by entry criteria
Advantages • Cost effective • Saves time • Avoids cheating • Reliable and robust architecture • Multimedia presentation • Flexible capacity • Ease of use
Performance Review • Participants found on-line test quicker and this method improved their task focus • Easier for participants to manage the test process • Minor changes made as a result of participants’ feedback Student Feedback Paper based Test Student Feedback On-Line Test Timer
Student Feedback “Doing the test on-screen is easier because the user doesn’t need to flip pages and hold papers” “Easier to concentrate with fewer people in the room” “Easier to change answers if you think they are wrong” “Quicker doing it on-line” “I prefer using computers for tests” “I didn’t feel under so much pressure doing the test on a PC” “Liked having 2 ways to move around – keyboard or mouse”
Summary • We have now used this new test environment in a real situation and have had positive feedback from participants and staff • The On-Line Aptitude Test has provided us with a frame work that could be used to deliver material in another subject area in the future The On-Line Test