PeerWise Student Contributed Assessment System 28 May 2013

1. PeerWise Student Contributed Assessment System 28 May 2013 Gita Sedghi Department of Chemistry g.sedghi@liv.ac.uk

2. What is PeerWise? • PeerWise is an online repository of multiple-choice questions that are created, answered, rated and discussed by students. • peerwise.cs.auckland.ac.nz • Which courses is PeerWise for? • Any course for which it is beneficial to students to author their own questions and to explain their understanding of a topic could benefit from using PeerWise.

3. Benefits to students: • Designing questions • Choosing distracters • Writing explanations • Answering questions • Evaluating quality

4. Benefits to instructors: • Early feedback • Large test banks • Large classes • Little staff involvement

5. An example of questions authored by students: The "Morning Rooster" is a coffee cocktail made via a steady state process. Coffee, milk and tequila are mixed in a machine and cocktail exits the machine at a mass flow rate of 2.4 kg/hr. The coffee input stream has a mass flow rate of 1.6 kg/hr. The specific enthalpies of the inputs and output are listed in the table: By assuming the heat losses from the machine are negligible, use the information in the table and the mass flow rate of the coffee stream and output stream to calculate the mass flow rate of the milk and the tequila. A)m·milk = 6 g/hr *B)m·milk = 0.06 kg/hr m·tequila= 74 g/hrm·tequila= 0.74 kg/hr C) m·milk= 0.6 kg/hr D)m·milk = 0.74 kg/hr m·tequila= 7.4 kg/hrm·tequila= 0.06 kg/hr

8. Participation summary

9. Student scores

10. Total score is composed of individual scores for authoring questions, and answering & rating others’ questions. To increase the total score, students should: • write high-quality questions with clear explanations • answer questions thoughtfully • rate questions fairly and leave constructive feedback • use PeerWise early as the score increases over time based on contribution history

11. Recommendations for incorporating PeerWise into your course • Allocatea percentage of course mark for participation. • Suggestion: 2-5% for participation • Asking students to write and answer too many questions may be perceived negatively and may lower the overall quality of the repository. • Suggestion: 2 or 3 questions / 20 answers per term • Using very good PeerWise questions in formal examinations is a way to motivate students. Adding some of your own questions can also encourage students to participate and give them examples of well designed questions. • Suggestion: use of PeerWise questions on formal examinations

12. Evaluation

13. Correlation between question authoring and exam mark

14. Correlation between answering questions and exam mark

15. Thanks for your attention