Dr. Terence Etchells t.a.etchells@ljmu.ac.uk

1. Generating Online Assessment QuestionswithDerive and Perception Dr. Terence Etchells t.a.etchells@ljmu.ac.uk Computing and Mathematical SciencesLiverpool John Moores University, UK.

2. Important (Videos) • In order that you can view the videos in this presentation you will need the TechSmith Video Codec that can be found at: http://download.techsmith.com/tscc/tscc.exe Alternately, you can find the tscc.exe on this CD. Simply run the exe file from the CD or the internet download.

3. Where LJMU is!

4. Where LJMU is!

5. Where LJMU is!

6. Liverpool John Moores University

7. Liverpool John Moores University My office

8. What is Perception? • A Package for Delivering Assessments over the internet. • Assessments can take many forms. • e.g. multiple choice, text matching, numerical values.

9. What is Perception? • A Package for Delivering Assessments over the internet. • Assessments can take many forms. • e.g. multiple choice, text matching, numerical values.

10. What is Perception? • A Package for Delivering Assessments over the internet. • Assessments can take many forms. • e.g. multiple choice, text matching, numerical values.

11. What is Perception? • A Package for Delivering Assessments over the internet. • Assessments can take many forms. • e.g. multiple choice, text matching, numerical values.

12. What is Perception? • 4 Main parts to Perception • Authoring the Questions • Constructing Assessments • Selecting groups of questions • Setting Schedules • dates, how many attempts, who? • Reporting • What scores did they get.

13. What is Perception? • 4 Main parts to Perception • Authoring the Questions • Constructing Assessments • Selecting groups of questions • Setting Schedules • dates, how many attempts, who? • Reporting • What scores did they get.

14. What is Perception? • 4 Main parts to Perception • Authoring the Questions • Constructing Assessments • Selecting groups of questions • Setting Schedules • dates, how many attempts, who? • Reporting • What scores did they get.

15. What is Perception? • 4 Main parts to Perception • Authoring the Questions • Constructing Assessments • Selecting groups of questions • Setting Schedules • dates, how many attempts, who? • Reporting • What scores did they get.

16. What is Perception? • 4 Main parts to Perception • Authoring the Questions • Constructing Assessments • Selecting groups of questions • Setting Schedules • dates, how many attempts, who? • Reporting • What scores did students get.

17. What is Perception? • The software is well developed and used all over the world in Education and Business. • It is very secure. • Detailed info on Perception can be found at http://www.questionmark.com

18. What is Perception? • The software is well developed and used all over the world in Education and Business. • It is very secure. • Detailed info on Perception can be found at http://www.questionmark.com

19. What is Perception? • The software is well developed and used all over the world in Education and Business. • It is very secure. • Detailed info on Perception can be found at http://www.questionmark.com

20. Why Use Perception? • Large Classes, NO MARKING! • Students can do assessments in their own rooms/home. • Students can do assessments in their own time.

21. Why Use Perception? • Large Classes, NO MARKING! • Students can do assessments in their own rooms/home. • Students can do assessments in their own time.

22. Why Use Perception? • Large Classes, NO MARKING! • Students can do assessments in their own rooms/home. • Students can do assessments in their own time.

23. Why Use Perception? • Large Classes, NO MARKING! • Students can do assessments in their own rooms/home. • Students can do assessments in their own time.

24. What are the pitfalls? • Authoring the questions is VERY time consuming. • Perception has Wizards for constructing the questions, but only one at a time. • There are large databases to manage.

25. What are the pitfalls? • Authoring the questions is VERY time consuming. • Perception has Wizards for constructing the questions, but only one at a time. • There are large databases to manage.

26. What are the pitfalls? • Authoring the questions is VERY time consuming. • Perception has Wizards for constructing the questions, but only one at a time. • There are large databases to manage.

27. What are the pitfalls? • Authoring the questions is VERY time consuming. • Perception has Wizards for constructing the questions, but only one at a time. • There are large databases to manage.

28. What are the pitfalls? • There are many aspects of the software that need to be mastered. • A steep learning curve. • Servers can go down! No support at Midnight!

29. What are the pitfalls? • There are many aspects of the software that need to be mastered. • A steep learning curve. • Servers can go down! No support at Midnight!

30. What are the pitfalls? • There are many aspects of the software that need to be mastered. • A steep learning curve. • Servers can go down! No support at Midnight!

31. Overall • Positives out way the Negatives. • Students like the instant non judgemental (by a human) feedback. • Students know their scores and can see their grades for all assessments attempted.

32. Overall • Positives out way the Negatives. • Students like the instant non judgemental (by a human) feedback. • Students know their scores and can see their grades for all assessments attempted.

33. Overall • Positives out way the Negatives. • Students like the instant non judgemental (by a human) feedback. • Students know their scores and can see their grades for all assessments attempted.

34. Overall • Positives out way the Negatives. • Students like the instant non Judgemental (by a human) feedback. • Students know their scores and can see their grades for all assessments attempted.

35. What has this to do with Derive? • For large classes there must be many different questions. • Students network solutions if there are only a few questions. • Must generate many copies of template questions with different values and solutions.

36. What has this to do with Derive? • For large classes there must be many different questions. • Students network solutions if there are only a few questions. • Must generate many copies of template questions with different values and solutions.

37. What has this to do with Derive? • For large classes there must be many different questions. • Students network solutions if there are only a few questions. • Must generate many copies of template questions with different values and solutions.

38. What has this to do with Derive? • For large classes there must be many different questions. • Students network solutions if there are only a few questions. • Must generate many copies of template questions with different values and solutions.

39. What has this to do with Derive? • It is possible with Derive that we can generate many different questions and solutions from a set template. • However, interfacing Derive with Perception is not trivial . • We must be inventive .

40. What has this to do with Derive? • It is possible with Derive that we can generate many different questions and solutions from a set template. • However, interfacing Derive with Perception is not trivial . • We must be inventive .

41. What has this to do with Derive? • It is possible with Derive that we can generate many different questions and solutions from a set template. • However, interfacing Derive with Perception is not trivial . • We must be inventive .

42. How Do We Connect? • Perception Questions are written in a mark-up language, QML, which is text. • Perception has wizards for producing questions in QML. • QML can be imported in Perception Question Databases.

43. How Do We Connect? • Perception Questions are written in a mark-up language, QML, which is text. • Perception has wizards for producing questions in QML. • QML can be imported in Perception Question Databases.

44. How Do We Connect? • Perception Questions are written in a mark-up language, QML, which is text. • Perception has wizards for producing questions in QML. • QML can be imported in Perception Question Databases.

45. How Do We Connect? • Perception Questions are written in a mark-up language, QML, which is text. • Perception has wizards for producing questions in QML. • QML can be imported in Perception Question Databases.

46. So what do we do? • Create a Template Question with the Perception Wizard. • Extract the QML text and place in a WORD document. • Get Derive to generate random values and the solution for the question.

47. So what do we do? • Create a Template Question with the Perception Wizard. • Extract the QML text and place in a WORD document. • Get Derive to generate random values and the solution for the question.

48. So what do we do? • Create a Template Question with the Perception Wizard. • Extract the QML text and place in a WORD document. • Get Derive to generate random values and the solution for the question.

49. So what do we do? • Create a Template Question with the Perception Wizard. • Extract the QML text and place in a WORD document. • Get Derive to generate random values and the solution for the question.

50. So what do we do? • Use Word’s mail merge facility to merge the values into the template making hundreds of different versions of the same question. • We must Program Derive to produce the values and the solutions. • It is not possible to save our values and solution in a form that Word’s mail merge can work with.