380 likes | 536 Views
Improving Openness of Scientific Research. Brian Nosek University of Virginia Center for Open Science. Mission. Improve Openness, Integrity, and Reproducibility of Scientific Research. Central issue. Incentives for individual success are not necessarily aligned with doing best science.
E N D
Improving Openness of Scientific Research Brian Nosek University of Virginia Center for Open Science
Mission Improve Openness, Integrity, and Reproducibility of Scientific Research
Central issue Incentives for individual success are not necessarily aligned with doing best science Nosek, Spies, & Motyl, 2012, PPS
Primary Incentive Publish
Barriers • Perceived norms (Anderson, Martinson, & DeVries, 2007) • Temporal construal (Trope & Liberman, 2003) • Motivated reasoning (Kunda, 1990) • Minimal accountability (Lerner & Tetlock, 1999) • I am busy (Me & Everyone else, 2013)
Two Strategies (1) Work with existing incentives (2) Nudge the incentives
Implementation Principles • Leverage existing values • Support workflow across entire lifecycle • Low barrier to entry • Enable openness and other good practices
Open Science Framework Jeff Spies
Open Science Framework (OSF) • For collaboration, documentation, archiving, sharing, registration • Respects and integrates workflow • Replaces ad hoc archiving with shared solution • Merges private and public workflows • Incentivizes openness
Conduct a study Design a study Analyze data New research inspired Draft article Article published Submit for publication Peer Review
Grant applications IRB submission Creating materials Personal file-system Collaboration Data collection Analysis tools Figure creation Data storage Manuscript preparation Review/publishing system Article and material discovery
http://centerforopenscience.org/ http://openscienceframework.org/
OPEN GATE Do Research Write Report Publish Report Add to Knowledge
#1 Solve existing documentation, archiving and sharing problems
#2 Version control
#3 Registration
#5 Integrate services into single workflow
#6 Incentives for openness
Incentives for openness Bottom-up – slow, but comprehensive • Researcher’s workflow part of the public record • Methods of reputation building with openness Top-down – fast, but narrow • Funders: require disclosure of grantees • Journals: badges for openness, registration, disclosure
#8 Search, filter, aggregation, discovery