280 likes | 375 Views
Extending Standards-Based e-Assessment Tools to Meet the Needs of Mathematics and Science. Sue Milne, Consultant - FETLAR Project Paul Neve, Kingston University Leslie Fletcher, Liverpool John Moores University September 2010. The FETLAR Project.
E N D
Extending Standards-Based e-Assessment Tools to Meet the Needs of Mathematics and Science Sue Milne, Consultant - FETLAR Project Paul Neve, Kingston University Leslie Fletcher, Liverpool John Moores University September 2010
The FETLAR Project • FETLAR is the MSOR community’s project in the Open Educational Resources Subject Centre Strand funded by JISC and HEA • May 2009 – April 2010 • Project website http://fetlar.bham.ac.uk/
Outline • E-learning, maths and OER • FETLAR outputs • Content • Tools • The FETLAR VM • The future...
E-Learning in Maths • Culture of using online resources • Well-established and plentiful learning materials • Need for formative assessment • - Maths is like swimming... • VLE assessment tools are rarely maths-friendly
MathAssess and FETLAR • Open source, open standards, Creative Commons licensing, • E-assessment and on-line resources • Significance of open standards e.g. QTIv2.1, LaTeX • Partners active in developing QTI standard
FETLAR Repository • Collected resources from • MathCentre • Just the Maths • METAL • CALMAT • HELM • DIAGNOSYS • ...and others
Metadata and Licensing • Over 1600 resources contributed • Video, images, documents • Questions, tests • Some entire systems • Source code, applications,... • Searching for resources: • JORUM metadata set • QTI metadata for questions and tests • Maths taxonomy
End-to-End E-Assessment • E-Assessment not new in Maths, e.g. CALMAT from 1992 to now... • 2 systems in FETLAR Toolkit: MathAssess Tools, STACK • Both open source • MathAssess conforms to QTIv2.1 specification – interoperability • STACK has its own standard
STACK • Well known, successor to AIM • Existing user community • Designed for maths • Uses Maxima computer algebra • LaTeX for composing equations • Not constrained by standards
MathAssess Tools • Developed in JISC MathAssess project • Standards compliant • QTIv2.1 • Interoperability, many question types • Improved usability under FETLAR • Question authoring • Test construction • Assessment setting • Rendering/delivery in Moodle
Where are we now? • Large collection of openly licensed resources, including CALMAT • End-to-end QTI2.1-conformant assessments • Display maths expressions • Manipulate maths expressions • Create randomised items • Compare input and expected answer algebraically • All in a readily available, easily deployable package
FETLAR virtual appliance • Virtual appliance toolkit downloadable from http://aqurate.kingston.ac.uk/files/fetlar-vm.zip • Content then downloaded by virtual appliance • Mathqurate and Spectatus are desk-top applications downloadable from http://aqurate.kingston.ac.uk/mathqurate http://aqurate.kingston.ac.uk/spectatus • This installs all FETLAR outputs on a laptop • Details for institutional installation available • Beware – there is a lot of it!
What now? • More experience of OER/FETLAR in use • Maths support • Alongside conventional delivery of (credit-bearing) modules • Entirely on-line delivery of modules • Pre-entry consolidation, Summer Schools, ... • Evaluation of OER/FETLAR in use • The biggest challenge is Sustainability
Demonstration of tools • Slidecast at http://www.screencast.com/t/OTgzYTYzYWI • Live Demo follows....
QTI Question Structure Variable definitions Input – responseVariables Judging – outcomeVariables Randomisation – templateVariables templateProcessing Optional Randomisation itemBody All the stuff that shows up on the screen - question - input box - buttons for Hint/Solution - feedback responseProcessing Working out what feedback and score should be
Stage 1 – MathQurate Wizard • Editing a choice
Stage 2 – Feedback • All feedback • can be seen • simultaneously • if required
Stage 3 – MathEntryInteraction • Changes needed • to variable types • and in • responseProcessing
Stage 4 – Randomised Can use and display randomised variable names