Group quizzes as an assessment that supports learning

1. Group quizzes as an assessment that supports learning Joss Ives – Department of Physics, University of the Fraser Valley (Abbotsford, BC) joss.ives@ufv.ca Blog: http://learnification.wordpress.com Twitter: @jossives

2. After an exam, students will often hang out in the hallway to discuss the exam

3. After an exam, students will often hang out in the hallway to discuss the exam Which equation should I have used for question 3?

4. After an exam, students will often hang out in the hallway to discuss the exam I totally nailed number 2. I have got to tell these guys what I did.

5. After an exam, students will often hang out in the hallway to discuss the exam Now that I’m saying it out loud, I realize where I went wrong on #1

6. I see group quizzes as a way to bottle that moment Now I get it!

7. My implementation OUTLINE Strengths & weakneses My findings

8. My implementation(weekly quiz)

9. The individual quiz has 4 to 6 items and takes 20 minutes to write Multiple- choice questions Ranking tasks Short problems

10. All quiz questions are converted to multiple-choice and the the group component takes 10 minutes A! B! C!

11. They receive immediate feedback thanks to the scratch cards [Other methods to provide immediate feedback include LMSs, online homework systems and some clickers] • $85 / 500 card • $0.17 / card • (or chop up the cards with 50 questions each and the cost drops below $0.05 / card) http://www.epsteineducation.com

12. Their overall quiz grade is 75% from their individual score and 25% from their group score

13. Strengths&Weaknesses

14. Both students benefit when one explains an idea to the other   ?  !

15. The group quiz is the highest level of student engagement I have observed in anyof my courses VS. Even the shyest students participate

16. My students really like the format Group midterm?Please!!! [Note: I have used these in my intro calculus-based courses as well as my 3rd-year Quantum Mechanics I course and the feedback from students has been overwhelmingly positive]

17. My students feel that the group quizzes make a large contribution to their learning? “How much do you feel that group quizzes have contributed to your learning so far in this course?” [W2012, PHYS112] A) A large contribution to my learning.B) A small contribution to my learning.C) They don’t contribute to my learning.

18. Immediate feedback means that they learn the correct answer when they are most receptive

19. Anecdotally, they are not satisfied when they find the correct answer through guessing • CAN YOU EXPLAIN TO US WHY E IS THE CORRECT ANSWER?

20. The most obvious weakness is that this format requires extra time  [For people already using quizzes in their courses, the extra 10 minutes required to add the group component is worth whatever 10 minutes needed to come out]

21. Writing the individual quiz first moderates worries about social loafers receiving free marks FREEMARKS(bwahaha)

22. Scratching tends to be very democratic, which means that the loudest person doesn’t usually dominate C A! C

23. There is no compelling evidence that answering first individually improves group performance or learning [Note: This suggests a lack of evidence for the best practice suggestion for Mazur’s Peer Instruction (and Think-Pair-Share) that it is crucial that the students vote first individually before they have group discussions] [C. Singh, AJP 73 (5), May 2005]

24. My Findings

25. The questions are reasonably challenging for the students  

26. Correct individuals are infrequently led astray   

27. The group usually outperforms its strongest individual

28. The results for incorrect individuals are consistent with them being in a group with a correct individual  

29. Groups composed of only incorrect individuals show good evidence of learning Gilley Singh Me Me [B. Gilley, S. Harris, Poster, GSA 2012] [C. Singh, AJP 73 (5), May 2005]

30. Half of the time incorrect groups will the find correct answer on their second try  

31. And this is significantly better than chance

32. 2. Students like them 1. Learning takes place In summary: group quizzes 3. Take extra time but worth it (stay tuned for results from this past year)

33. Group exams pros from other literature [1] Stearns, S. (1996). Collaborative Exams as Learning Tools. College Teaching, 44, 111–112. [2] Yuretich, R., Khan, S. & Leckie, R. (2001). Active-learning methods to improve student performance and scientific interest in a large introductory oceanography course. Journal of Geoscience Education, 49, 111–119. [3] Cortright, R.N., Collins, H.L., Rodenbaugh D.W. & DiCarlo, S.T. (2003). Student retention of course content is improved by collaborative-group testing, Advan. Physiol. Edu. 27: 102-108. [4] Gilley, B. & Harris, S. (2010). Group quizzes as a learning experience in an introductory lab, Poster presented at Geological Society of America 2010 Annual Meeting. Acknowledgement: The references, discussion of group exams pros/cons and some of the analysis borrow heavily from Ref. [4] (thanks Brett!). Development of collaboration skills [1]. Students enjoy them and there is an increase in overall enjoyment of course [1]. Promote higher-level thinking [2]. Increase in student retention of information [3] (Note that Ref. 3 did not control for time on task). Improved student learning [2,4].