1 / 16

Blinded or open review ? Ana Marušić editor in chief , Journal of Global Health

Workshop : Editorial Process. Blinded or open review ? Ana Marušić editor in chief , Journal of Global Health editor emerita, Croatian Medical Journal University of Split School of Medicine, Split, Croatia. resubmission …. Peer review : Inside the black box. Submission.

moana
Download Presentation

Blinded or open review ? Ana Marušić editor in chief , Journal of Global Health

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Workshop: EditorialProcess Blinded or open review? Ana Marušić editor inchief, Journalof Global Health editor emerita, CroatianMedicalJournal University of Split School of Medicine, Split, Croatia

  2. resubmission … Peerreview: Insidetheblack box Submission Acknowledgment Final decision Editor’s evaluation Rejection Acceptance Review process: Reviewer 1 Reviewer 2 Reviewer 3 …. …. Author: revision Courtesy of A. Flannagin, JAMA

  3. Three types of peer review • Double Blind review • Author identifying information removed from manuscript; authors and reviewers’ identities blinded • Blind (Anonymous) review • Reviewers know authors’ names and affiliations, but reviewers do not sign reviews and reviewer identities are not made known to authors • Open review • Reviewers sign their reviews; both author and reviewer identities are known to each other

  4. Types of peer review • Double blind review is commonly used by psychology, nursing, and some pharmacy journals • Double blind review is used by journals in some narrow specialties, journals in some smaller countries • Blind (anonymous) review is commonly used by many journals in medicine and other sciences • Few journals are using open review – for now? (BMJ, PLoS journals, Nature experiment)

  5. There is no single standard for the peer review process • But there are generally accepted norms and conventions • internal review by editor(s) plus review by external experts = “peers” • 1 to 3 reviewers • reviewers selected from small panel or board and/or reviewers selected from large database/community • reviewers asked to return reviews within stated period of time

  6. Usualpractices: ALPSP 2000 survey • 200 journals, 40% from biomedicine • 60% traditional • 40% doubleblind • A few journal have open peerreview(BMJ, JAMA, BMC)

  7. Reviewerssuggestedbyauthors? BMC Med. 2006 May 30;4:13. Are reviewers suggested by authors as good as those chosen by editors? Results of a rater-blinded, retrospective study. Wager E, Parkin EC, Tamber PS. CONCLUSION: • Author-nominated reviewers produced reviews of similar quality to editor-chosen reviewers but were more likely to recommend acceptance during the initial stages of peer review.

  8. Reviewerssuggestedbyauthors? JAMA. 2006 Jan 18;295(3):314-7. Differences in review quality and recommendations for publication between peer reviewers suggested by authorsor by editors. Schroter S, Tite L, Hutchings A, Black N. CONCLUSION: • Author- and editor-suggested reviewers did not differ in the quality of their reviews, but author-suggested reviewers tended to make more favorable recommendations for publication. Editors can be confident that reviewers suggested by authors will complete adequate reviews of manuscripts, but should be cautious about relying on their recommendations for publication.

  9. Reviewerssuggestedbyauthors? PLoS One. 2010 Oct 14;5(10):e13345. Do author-suggested reviewers rate submissions more favorably than editor-suggested reviewers? A study on atmospheric chemistry and physics. Bornmann L, Daniel HD. CONCLUSION: • Our results agree with those from other studies that editor-suggested reviewers rated manuscripts between 30% and 42% less favorably than author-suggested reviewers. Against this backdrop journal editors should consider either doing without the use of author-suggested reviewers or, if they are used, bringing in more than one editor-suggested reviewer for the review process (so that the review by author-suggested reviewers can be put in perspective).

  10. Reviewerssuggestedbyauthors? J Am Soc Nephrol. 2011 Sep;22(9):1598-602. Epub 2011 Aug 18. Effect of recommendations from reviewers suggested or excluded by authors. Moore JL, Neilson EG, Siegel V; Associate Editors at Journal of American Society of Nephrology. CONCLUSION: • Author-suggested reviewers, as a group, make more positive recommendations than editor-suggested reviewers • Author-excluded reviewers impart significantly more negative recommendations than other reviewers of the same manuscript • Editorial decisions on manuscripts reviewed by author-suggested or author-excluded reviewers do not differ from those decisions on manuscripts assigned but not reviewed by them • JASN's policy of editors making decisions independent from individual reviewer recommendations minimizes the effect of selection bias on publication decisions.

  11. Reviewing submissionsfromeditors? Conflict of interest – publishingin own journalWho shouldreview?Who shoulddecide?

  12. Example: Editor El Naschiepublishedover 300 single-authored articles in Chaos, Solitons & Fractals attributed to him (e.g. 5 of his own papersinthe same issue of the journal) Editor retired, the journal put a stop to submissionsandlaterresumedpublishingwith clear policy for editorialsubmissions.

  13. 7% editors published >5 original research papers in their own journal Only one journal had a published policy on editorial submissions Only 8.6% journals had reference to the guidelines of any professional or publishing association or organization.

  14. Obrigada! ana.marusic@mefst.hr http://www.phd2published.com/wp-content/uploads/2012/05/peer_review_james_yang.jpg

More Related