1 / 7

Introduction The Comparative Assessment of Peer Review Robert Frodeman J. Britt Holbrook

EU/US Workshop on Peer Review: the broader impacts of grant applications. Introduction The Comparative Assessment of Peer Review Robert Frodeman J. Britt Holbrook Carl Mitcham Center for the Study of Interdisciplinarity (CSID ) University of North Texas December 13 and 14, 2010

zonta
Download Presentation

Introduction The Comparative Assessment of Peer Review Robert Frodeman J. Britt Holbrook

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EU/US Workshop on Peer Review: the broader impacts of grant applications Introduction The Comparative Assessment of Peer Review Robert Frodeman J. Britt Holbrook Carl Mitcham Center for the Study of Interdisciplinarity (CSID) University of North Texas December 13 and 14, 2010 Brussels

  2. -the future of peer review? • Funded by NSF’s SciSIP program (2008-2011) • - and associated partners • Examines the peer review of grant proposals at 6 science agencies • National Science Foundation • National Oceanographic and Atmospheric Administration • National Institutes of Health • Natural Sciences and Engineering Research Council of Canada • European Commission Framework Programs • Dutch Technology Foundation (STW) EU/US Workshop Brussels, DC Dec 13-14, 2010

  3. CAPR – the Comparative Assessment of Peer Review • -Funded by NSF’s SciSIP program (2008-2011) • OSTP Director John Marburger’s 2005 call for a ‘science of science policy’ • SciSIP: ‘Science of Science and Innovation Policy’ (2007) • -CAPR: examines peer review of grant proposals at 6 science agencies • National Science Foundation • National Oceanographic and Atmospheric Administration • National Institutes of Health • Natural Sciences and Engineering Research Council of Canada • Dutch Technology Foundation (STW) • European Commission Framework Programmes EU/US Workshop Brussels, DC Dec 13-14, 2010

  4. CAPR – the Comparative Assessment of Peer Review • -Outgrowth of our work on NSF’s broader impacts criterion (BIC;1997) • 2007 workshop, “Making Sense of the ‘Broader Impacts’ of Science” • 2009 special issue of Social Epistemology: ‘US National Science • Foundation's Broader Impacts Merit Review’, Holbrook, ed. • -BIC: the interdisciplining of peer review • a project of CSID – a case study approach to interdisciplinarity • the rise of an accountability culture (GPRA, 1993; goals, metrics, gap analysis), & expansion of neoliberal assumptions. • Questions re: BIC: • different types of broader impact? • can broader impacts be counted? • are there experts of broader impacts? • who counts as a peer? EU/US Workshop Brussels, DC Dec 13-14, 2010

  5. Peer Review, Past, Present Future • -VannevarBush’s Platonism • Who guards the guardians? Cf. Polanyi’s ‘Republic of Science’ • Daryl Chubin and Ed Hackett (1990): scientists “implacable in • sequestering this process from public view” • In contrast with – • -PR in the Age of Google • Growth of Mode 2 knowledge • Loss of authority via new media • Web 2.0 – everyone is a peer (‘youcut’ the ‘youtube’ of PR) • YochaiBenkler (2006): Peer review outdated by peer production EU/US Workshop Brussels, DC Dec 13-14, 2010

  6. Digital Repository: a collection of PR documents from/relating to each agency, plus more general materials • Survey instrument and interviews: of stakeholders concerning the PR process • Workshops in the US and EU on the changing nature of PR • Publications in different venues, for a variety of audiences • Next steps: deeper, wider, and the philosophy of metrics (bibliometrics, societal impact metrics, sustainability metrics, etc.) The Elements of CAPR EU/US Workshop Brussels, DC Dec 13-14, 2010

  7. Workshop Themes • NB the multiple valences of ‘(broader) impact’, ‘innovation’, ‘transformative’ • multiple policy contexts, strategies, and institutional forms • possibilities for the metrics of broader impact (cf. SIAMPI, STAR Metrics) • workshop outcomes?

More Related