The Examination process - a determinant of learning

1. The Examination process- a determinant of learning Bo Bergman SKF Professor Quality Sciences Division of Quality Sciences Chalmers University of Technology SE-412 96 Gothenburg, Sweden Phone: +46 31 772 8180 E-mail: bo.bergman@mot.chalmers.se

2. Performance measurements • Often, you get what you ask for! • And what you deserve! • Waiting times in pharmacies in Sweden • Waiting times in hospitals (0, 7, 90, 90) • What about learning outcomes in education? • Grading

3. How does yourexamination processlook like! • Questionnaires? • Asking for the only right Answers?

4. True knowledge?

5. “To know that we know what we know, and that we do not know what we do not know, that is true knowledge.”    Confucius (551 - 479 BC)

6. A Grook by Piet Hein Knowing what thou knowest not is in a sense omniscience.

7. Probabilistic Questionnaires • A number (say n=10) of statements (S1,…,Sn) • With truth-values 0 or 1 (T1,…,Tn) • State your probabilities that these statements are “true” (P1,…,Pn) • Losses Li = (Ti- Pi)2 • Total Loss L=Sum Li

8. Your subjectiveprobabilities

9. 1a Easy question which everyone who has taken the course should be able to answer ....................................................................................................................................................... ...................................................................................................................................................... ....................................................................................................................................................... ....................................................................................................................................................... 1b Argue why this is a good question ....................................................................................................................................................... ....................................................................................................................................................... ....................................................................................................................................................... ....................................................................................................................................................... 2a Semi difficult question which most of the course participants should be able to answer ....................................................................................................................................................... ....................................................................................................................................................... ....................................................................................................................................................... ....................................................................................................................................................... 2b Argue why this is a good question ....................................................................................................................................................... ....................................................................................................................................................... ....................................................................................................................................................... ....................................................................................................................................................... 3a. Difficult question, one which you barely can answer yourself ....................................................................................................................................................... ....................................................................................................................................................... ....................................................................................................................................................... ....................................................................................................................................................... 3b.Argue why this is a good question ....................................................................................................................................................... ....................................................................................................................................................... ....................................................................................................................................................... .......................................................................................................................................................

10. Dialogue • How does the examination process affect the learning outcome? • Kinds of examination forms? • Suggestions • And • Conclusions

11. Conclusions?

12. The changing perspective of the customer. (After Norrman,2001.)