1 / 12

Peer review in an economics writing course: the Pen is still mightier than the SWoRD

Peer review in an economics writing course: the Pen is still mightier than the SWoRD. Jennifer Imazeki Department of Economics jimazeki@gmail.com http://economicsforteachers.blogspot.com. SWoRD. Scaffolded Writing and Reviewing in the Disciplines Students submit papers

katima
Download Presentation

Peer review in an economics writing course: the Pen is still mightier than the SWoRD

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Peer review in an economics writing course: the Pen is still mightier than the SWoRD Jennifer Imazeki Department of Economics jimazeki@gmail.com http://economicsforteachers.blogspot.com

  2. SWoRD • Scaffolded Writing and Reviewing in the Disciplines • Students submit papers • Students review papers of 4-6 peers • Comments and 7-point numeric rating • Students ‘back evaluate’ reviews they receive • 5-point numeric rating

  3. What makes SWoRD different? • Student review and backevaluation scores  grades for both writing and reviewing • Reviewing grade: “Accuracy” + “Helpfulness” • Accuracy: Consistency compared to other reviewers • Helpfulness: Back evaluation ratings • Writing grade: adjusted average of numeric ratings from reviewers • Scoring algorithm to remove bias

  4. Econ 449W: Economic Literacy • “The goal of this course is to make you better economists by making you better writers… This course will focus on how to apply and use [economic] knowledge, by incorporating economic material and the economic way of thinking into writing for a more general audience.”

  5. Econ 449W: Structure 2010: • 6 peer-reviewed papers, exchanged in class • 1 reviewer for each paper, plus instructor feedback • No feedback for reviewers, participation points only

  6. Potential benefits of SWoRD(vs. other peer review tools) • Students read multiple papers, receive feedback from multiple reviewers • Back evaluations provide incentive to take reviews seriously, give students feedback for improving reviews (without requiring instructor intervention) • Rubric scores converted to grades with adjustment for bias

  7. Econ 449W: 2010 vs. 2011 2010: • 6 peer-reviewed papers, exchanged in class • 1 reviewer for each paper, plus instructor feedback • No feedback for reviewers, participation points only 2011: • 4 peer reviewed papers, all online submission • 4-5 reviewers for each paper, no/less instructor feedback on draft 1 • Writers back-evaluate reviewers, reviewing score based 50% on those back evaluations

  8. 5 days 5 days 5 days Assignment timeline 9pm Monday 9pm Sunday 9pm Friday 9pm Wednesday First Draft Final draft Final reviews (5) Reviews (5) Back reviews by Thurs Back reviews by Wednesday

  9. Issues • Lack of flexibility • Lack of transparency • Scoring algorithm questionable

  10. Peer review in an economics writing course: the Pen is still mightier than the SWoRD Jennifer Imazeki Department of Economics jimazeki@gmail.com http://economicsforteachers.blogspot.com

More Related