Welcome to the MaLT CAT demo network, multi-user version

1. Welcome to the MaLT CAT demo network, multi-user version This demo shows you how to get the best out of the MaLT CAT version 2developed by ReLabs for Hodder Education www.hoddereducation.co.ukwww.hoddertests.co.uk

2. What is MaLT CAT? MaLTstands for Mathematics Assessment for Learning and Teaching. It combines standardised, summative year-on-year assessment with formative assessment, opening up a new dimension of individual diagnostic error analysis and group performance evaluation. CAT stands for Computer-Adaptive Testing. MaLT CAT can be used as soon as a pupil can read and respond independently to the questions on screen (typically from about age 8), and covers the full spectrum of ability to age 14+. (A single-user version of MaLT CAT, without the group reporting facilities, is also available for individual learning support.)

3. What is computer-adaptive testing? • Computer-adaptive testing (CAT) is sensitive to each pupil’s answers – automatically selecting and presenting new questions that are optimally matched to actual performance. • If a question is answered incorrectly, a slightly easier question is offered; if a question is answered correctly, a slightly harder question follows, until a picture of the pupil’s ability emerges. • Adaptive testing ensures that the questions are neither too easy nor inappropriately difficult – ideal for assessing mixed-ability groups. • Adaptive testing probes each pupil’s maths understanding and skills at the cusp of their own ability, giving a clear profile of what the pupil can and cannot do. • MaLT CAT also makes for highly efficient assessment which yields meaningful results and significantly reduces teacher workload.

4. What does MaLT CAT do? • MaLT CAT tests are taken fully on-screen: the program automatically matches questions to each pupil’s performance, and records errors as well as correct answers. • MaLT CAT lets you create Progress Tests and Diagnostic Tests across a wide age (from about 8) and ability (from NC level 2) range. • MaLT CAT Progress Tests draw on the complete question bank and give standardised scores, percentiles and NC levels…… or you can define your own test parameters to create your own Diagnostic Tests. • MaLT CAT tests all provide diagnostic analysis of errors, to pinpoint misunderstandings, misconceptions and individual learning needs.

5. MaLT CAT … • is purpose-designed for on-screen, standardised assessment of mathematics • enables accurate assessment and instant results, in 30 minutes or less • automatically matches questions to each pupil’s own ability, and captures errors as well as correct answers • is ideal for mixed-ability class screening and individual progress tracking • covers an exceptionally wide age and ability (NC levels 2 to 7) range …

6. MaLT CAT … • can be used at any time during the school year • allows regular re-testing, drawing on the large question bank • automatically calculates standardised scores, percentiles and National Curriculum levels • generates detailed pupil reports, plus comprehensive class and whole yeargroup listings and performance analyses • enables individual progress monitoring through the school.

7. Let the computer do all the work! • All pupil details can be imported from your school information management system • Intuitive navigation and attractive presentation engages the pupil and makes the test accessible • The questions are clearly presented on-screen, and answered by clicking, typing or dragging and dropping, using a mouse • If the question allows the use of a calculator, an on-screen calculator is available • Timing and scoring are fully automatic • All reports and performance analyses are immediately available • Your data can be printed or exported at the touch of a button

8. Progress or diagnostic test? – you choose CAT Progress Tests draw upon the full question bank and are designed to be taken termly or yearly. Pupils’ results on previous tests can be compared with their current results, to see trends and evaluate progress. Allow pupils up to 45 minutes to complete a test – but most will finish in 20–30 minutes. CAT Diagnostic Tests, created by the teacher, let you focus in on particular attainment targets, and can be defined more narrowly to NC level. For each question there is only one right answer – but there may be up to four ‘diagnostic errors’. Each one may reveal something different about the pupil’s understanding of mathematical concepts.

9. Setting up a test –1 It couldn’t be easier to create a new test – in the Set up/Assign Tests screen you can: • decide whether to include three practice questions • select whether you want to show the timer • select your assessment criteria (for a Diagnostic test) • set the stopping password (this prevents pupils from ending the test prematurely) • name the test, and save it. This is also where you can delete a test – but remember, that will delete all related test performance data too.

10. Setting up a test –2

11. Assigning a test –1 Every Progress Test draws on the full item bank, with over 400 carefully calibrated questions available. You assign one test on each occasion – to an individual pupil, a class or a whole yeargroup. By default, the program will select all the pupils in a class. To de-select one or several pupils – for instance, if they have already taken the test – just click their names. Pupils only take a given test once: you re-test by creating and assigning a new test, as often as you wish.

12. Assigning a test –2

13. Taking a test –1 Tests can be taken yearly, termly or even more frequently. Each pupil logs in using their unique username and password, and takes the test assigned by their teacher. Because the program responds to performance – presenting a similar or easier question if the previous answer was incorrect, or vice versa – pupils cannot go back to previous questions. Allow pupils up to 45 minutes to complete a test – but most will finish in 30 minutes or less.

14. Taking a test –2 A series of three practice questions is available to introduce the test – but these can be skipped if the pupils have taken these tests before.

15. Taking a test –3 Every test starts with an easy question (relative to the pupil’s age) and each question is presented individually, one per screen:

16. Taking a test –4 Clicking ‘Next’ takes the pupil on to the next question.

17. Reports As well as the individual Pupil Report and Progress Report, you can run a number of group performance analyses and listings.

18. Pupil Report – 1 The Pupil Report gives a standardised score, percentile and NC level, and much more …

19. Pupil Report – 2 The Pupil Report lists all of the questions presented to that pupil, and shows his or her answers. It also shows the time taken for each question, and for the test as a whole.

20. Performance Map Each pupil’s Performance Map shows any unusual pattern of errors – ‘easy’ questions a pupil got wrong, and ‘difficult’ questions they got right …

21. Pupil Progress Report The Pupil Progress Report compares current performance with scores on all previous MaLT CAT Progress tests …

22. Class Report The Class Report analyses overall performance data and lists each pupil’s standardised score, NC level, etc, together with class average scores …

23. Cohort Report The Cohort Report compares two or more classes within a yeargroup, giving a range of useful comparative data, including NC level distributions and class and cohort averages …

24. Pupil Performance listings Comprehensive performance listings – generated in Excel, by class or cohort, and ready to take into any spreadsheet – let you make the performance comparisons YOU want.

25. Error Descriptions and National Marking Codes Reports The Error Descriptions Report, also generated in Excel, summarises your own pupils’ answers and diagnostic errors, with descriptors, enabling you to pinpoint particular problem areas. The National Marking Codes Report lets you relate your own pupils’ answers, and errors, to those made by over 12000 pupils in the national standardisation sample.

26. Getting started When you first run the program, you’ll need to set up your school name. Then set up the school’s cohorts, typically by year of intake – for instance, 2010 for the September 2010 intake. Next, you record which classes are attached to those cohorts. Finally, you register the pupils. The quickest and easiest way is to import pupil data from an Excel spreadsheet, but you can also key in pupil details. Whichever route you choose, all your pupils are now there in the database, ready for you to create and assign a test. You can review individual pupil information at any time, as well as change passwords and usernames.

27. Technical details MaLT CAT is fully networkable for whole-school use and comes with a two-year licence. A comprehensive User’s Manual (supplied as a pdf file on the CD-ROM) gives full information on how to install, use and get the most out of the system. Installation requires system administrator access: we strongly advise that your network administrator undertakes the program installation and initial set-up. This program is a 32-bit Windows® application that requires the .Net framework 2.0 (or later) to be installed on your PC in order to run: this will checked during installation and you will be prompted to install it if necessary. To run the framework and application, you require a PC running Windows® Server 2003, XP, Vista™ or Windows 7, with a Pentium or faster processor, with at least 256 Mb of memory (512 Mb recommended) and approximately 200 Mb of disk space to install the program (and an extra 150Mb if you need to install the .Net framework) and 100 Mb to run it. For quicker results you will need a PC with a faster CPU and more RAM. If you are working through a server, this may have an additional effect on the perceived speed. You will also need a mouse and SVGA monitor, set to a screen resolution of 1024 x 768 or higher. e-support@hodder.co.uk technical support helpline: 020 7873 6448

28. Thank you for your interest in MaLT CAT You can find out more at www.hoddertests.co.uk To order, go to www.hoddereducation.co.ukor telephone 01235 827827 You may also email orders to us on education@bookpoint.co.uk Note: the list price quoted is for a larger secondary school or college with 800+ students on roll, and is for a two-year site licence. Discounts are available to smaller secondary schools, and to primary schools: for a quotation, ring 01235 827827 now. www.hoddereducation.co.ukwww.hoddertests.co.uk