Effect of Paper Color on Students’ Physics Exam Performances

1. Discussion & Conclusion Objectives Background Experiment & Data Acknowledgements • All results were null. As such, we conclude that use of the colors tested here in similar exam settings will most likely not yield differential performances. • As no concrete claims regarding causality can be made concerning this null result, this conclusion may or may not be generalizable to all possible colors and shades thereof. • We speculate on mechanisms for this null result (as compared to the results observed elsewhere) in the associated proceedings article. • Prior work has • Established the existence of a color-performance relationship in achievement contexts1,2. • Demonstrated the presence of such a relationship in some undergraduate course examinations. Results, however, have been inconsistent3,4,5. • Since papers of various colors can be used to distinguish exam versions (as is done at CSM), the possibility that different colors may lead to measurable differences in performance raises an issue of basic fairness in educational practice. • For three regular examinations in an introductory E&M course (Spring 2012, N~400), we printed each exam version on a different color of paper. • We conducted analysis involving measures of performance and other data. • Analysis of performance included students’ total exam scores, scores on different types of question (conceptual vs. mathematical), and different question formats (free response vs. multiple choice). • Analysis of other, non-performance, measures included students’ completion times, confidences, and perceptions of performance. • Examine the manifestation of a color-performance relationship in an introductory E&M course. • Discuss findings in the context of prior studies’ arguments and claims. • Address the implications of results for current institutional practices. Thanks to the NSF TUES grant 0836937 which funded this study and to the rest of the Physics II teaching staff. David R. Schmidt, Todd G. Ruskell, and Patrick B. Kohl Effect of Paper Color on Students’ Physics Exam Performances Students’ total exam scores differentiated by exam and paper color. Error bars represent 95% confidence intervals based on standard errors of the means. For each exam, performances associated with each color were within error of one another. Performance Results from ANOVA testing on students’ total, multiple choice, free response, conceptual, and mathematical performances on Exams I, II, and III. For the purposes of this study, a question was categorized as “Conceptual” if it did not require any manipulation or numerical evaluation. All other questions were categorized as “Mathematical.” All tests yielded null results, and we did not observe any trends consistent across all three exams. Other Results from ANOVA testing on the time students’ required in completing their exams, their initial levels of confidence, their self-perceptions of performance, and their confidence gains for Exams I, II, and III. “Initial Confidence” and “Perceived Performance” were measured by questions placed at the beginning and end of each exam asking students to self-evaluate on a 1-5 scale. For Exam II, only time was measured. All tests yielded null results, and we did not observe any trends consistent across all three exams. • A.S. Soldat, R.C. Sinclair, and M.M. Mark, “Color as an environmental processing cue: External affective cues can directly affect processing strategy without affecting mood,” Soc. Cognition 15(1), 55-71, 1997. • A.J. Elliot, M.A. Maier, A.C. Moller, R. Friedman, and J. Meinhardt, “Color and psychological functioning: The effect of red on performance attainment,” J. Exp. Psychol. Gen.136(1), 154–168, 2007. • R.C. Sinclair, A.S. Soldat, and M.M. Mark, “Affective cues and processing strategy: Color-coded examination forms influence performance,” Teach. Psychol. 25(2), 130-132, 1998. • N.F. Skinner, “Differential test performance from differently colored paper: White paper works best,” Teach. Psychol., 31(2), 111–112, 2004. • I.R. Tal, K.G. Akers, and G.K. Hodge, “Effect of paper color and question order on exam performance,” Teach. Psychol. 35(1), 26-28, 2008.