180 likes | 192 Views
Terrence Bennett, The College of New Jersey Joel Herndon, Duke University Shawn Nicholson, Michigan State University Robert O’Reilly, Emory University. DATA SHARING ACROSS THE DISCIPLINES:. An empirical study. Data Sharing in the Social Sciences. An Introduction/Overview.
E N D
IASSIST: May 27, 2009 Terrence Bennett, The College of New Jersey Joel Herndon, Duke University Shawn Nicholson, Michigan State University Robert O’Reilly, Emory University DATA SHARING ACROSS THE DISCIPLINES: An empirical study
Data Sharing in the Social Sciences IASSIST: May 27, 2009
An Introduction/Overview • What is “Data Sharing”? • Measures of Data Sharing • Barriers/Obstacles to Data Sharing • [Context – Data Associated with Individual Researchers and Their Publications] IASSIST: May 27, 2009
What is Data Sharing? Source : Toothpaste for Dinner 8/12/08 http://www.toothpastefordinner.com/081208/online-privacy-advocate.gif IASSIST: May 27, 2009
What is Data Sharing? • The Data Themselves • The Documentation/Metadata (alas, not always forthcoming!) • Code/Procedures Used to Assemble the Data, Transform Them, and Perform the Published Analysis • Necessary for Quantitative Research to be Replicable IASSIST: May 27, 2009
Data Sharing and Replication • “Authors of quantitative empirical articles must make their data available for replication purposes … Required material would include all data, specialized computer programs, program recodes, and an explanatory file describing what is included and how to reproduce the published results.” • [taken from statement on “Minimum Replication Standards for International Relations Journals,” International Studies Perspectives (2003) 4, p. 105] IASSIST: May 27, 2009
Measuring Data Sharing • Our Approach – Academic Journals and Archives for Publication-Related Data • Journals – Major Journals in the Social Sciences • Archives – ICPSR Publications-Related Archive and Harvard DVN ScholarVerses IASSIST: May 27, 2009
Social Science Journals • Economics • International Relations • Political Science • Sociology • Examine Data-Sharing Policies in 2003 and in 2009 • Journals Selected Based on JCR Citation Rankings, Following Approach of Gleditsch and Metelits (2003) IASSIST: May 27, 2009
Data Sharing Index for Journals • Does journal have an explicit policy? • Terms of Policy • Materials Required • Description of Data • Data Themselves • Code for Analysis and for Transformation of Data • Timeframe for Submission • Location for Sharing IASSIST: May 27, 2009
Findings: Social Science Journals IASSIST: May 27, 2009
Examples of Journal Policies • American Political Science Review – authors should describe data in sufficient data so that readers can “understand and evaluate” what authors have done, but no requirement to share actual data • International Organization – authors are “strongly” encouraged to share data and code, but not required to do so • Review of Economic Studies – reserves right to refuse publication if policies are not met IASSIST: May 27, 2009
The Many Forms of Data Sharing • Citation as Sharing • Informal Sharing By Request • Personal/Faculty Website • Institutional Repositories • Journal Archives/Sites • Data Archives IASSIST: May 27, 2009
Scholarly Data Archives • IQSS DVN • “Scholar Dataverses” Created Each Year Since 2007 • 139 ScholarVerses, Including 2 Not Yet Public • ICPSR • Publications-Related Archive and New Deposits Each Year • 36 New Deposits Since 2007 (353 Studies in Total) IASSIST: May 27, 2009
Findings: Scholar Data Archives IASSIST: May 27, 2009
Barriers/Obstacles to Sharing • Data Sharing in the Social Sciences is Not Necessarily the Norm • Reasons: • Confidential Data • Proprietary Data • Incentives – Time/Effort • “Documentation, for instance, is often thought of as a waste of time” (Gleditsch and Metelits (2003), p. 73) • Incentives – Professional Considerations IASSIST: May 27, 2009
Selected Bibliography • http://library.duke.edu/data/files/iassist09/sources.pdf IASSIST: May 27, 2009
Acknowledgements • Special Thanks to the Following People: • Kevin Condon, Harvard-MIT Data Center • Jared Lyle, ICPSR • Amy Pienta, ICPSR • Various Journal Editors in Economics • Various Journal Editors in Political Science • Various Journal Editors in Sociology IASSIST: May 27, 2009
Questions From the Audience? IASSIST: May 27, 2009