180 likes | 295 Views
Moving to E Assessment. Robert A Bullivant Deputy Director General Chartered Insurance Institute. AGENDA. 1. Why bother? 2. Making the business case. 3. Selecting a partner 4. Centre issues 5. Compiling the test – fixed form or random? 6. Implementation 7. Communication issues.
E N D
Moving to E Assessment Robert A Bullivant Deputy Director General Chartered Insurance Institute
AGENDA • 1. Why bother? • 2. Making the business case. • 3. Selecting a partner • 4. Centre issues • 5. Compiling the test – fixed form or random? • 6. Implementation • 7. Communication issues
Why Bother ????????? • Why Bother???????? • Better candidate experience • Competitive issues • Regulatory encouragement • A better way to train and test.
Candidates take an exam when they are ready NOT when we say they have to be ready.
MakingThe Business Case • On line is more expensive • Business case must look at: • Competitive position • Candidate experience • Candidate expectation • Potential to increase entries
Making the Business Case Look very closely at cost base and aggressively identify savings that will be made as a result of going on line.
Potential Cost Savings • Printing • Centre costs • Invigilation costs • Couriers and postage • Less regular moderation meetings • Staff both in exam and support areas
Selecting a Partner • Note the word partner – not supplier • Experience of running on line exams • Which system is being used • Security arrangements • Support arrangements • Costs • Availability of Centres
Centre Issues • How many • Where • Corporate centres • Mobile testing
Compiling the Test Moderation • Has to be done in advance • Essential to take advice • Two possible routes: • Fixed form • Random selection
Fixed Form A number of tests are compiled in their entirety and the system allocates a test at random
Fixed Form Issues • System must allocate a different paper at re-sit to those who fail. • Paper needs to be pre moderated • Everything is done up front • Accuracy is essential - GRFT
Random Selection The question bank is held in the system which selects at random the questions to be used by reference to the test specification
Issues with Random Selection • Size of question bank • Facility values • Test specification and syllabus • Introducing new questions • Enemies • Frequency of change of paper
Implementation Project structure
Communication Issues • Early research with customers • Keep customers aware of progress • Give dates you can meet • Put a trial test on your web site
Topical Tips • Research the cost benefit implication with great care • Select your partner with care • Understand how your business will change • Make sure it will change for the better • Research the issues around random and fixed form carefully – there is scope for a false start.
You have to get it right first time. Are your procedures and controls up to it????????????