1 / 23

6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014

OA Publishing Community Standards: Article Level Metrics A Funder’s perspective. 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014. Kevin Dolby Wellcome Trust. Outline O. The Wellcome Trust - H ow we use Article Level Metrics Why they are important to us

erma
Download Presentation

6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OA Publishing Community Standards: Article Level Metrics A Funder’s perspective 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust

  2. OutlineO The Wellcome Trust - How we use Article Level Metrics Why they are important to us Current sources of data (and the problems with them) Initiatives and collaborations changing the landscape

  3. Set up in 1936 under the will of Sir Henry Wellcome. Our vision is to achieve extraordinary improvements in human and animal health. Our mission is to support the brightest minds in biomedical research and the medical humanities. We spend approximately £650 million on research per year. The Wellcome Trust

  4. Current grant portfolio

  5. Monitoring progress: WT’s key indicators

  6. Article level metrics vs. Journal level metrics • Cited 2904 times; • Normalised Citation Impact = 327; • ActaCrystal D JIF = 7.232

  7. Alternative metrics – beyond citations

  8. Engagement and Influence • MEP • Centre for Bioethics • MEP • Professor of EBM • Journal editor • Health journalist • NGO • Health, Population & Nutrition @ The World Bank

  9. Monitoring progress: WT’s key indicators

  10. Sources of data • We need article-level data which is consistent in its source and meaning in order to enable sensible comparisons between outputs of different schemes • Differences between publisher-provided data mean that, primarily, we use third-party data providers: • Thomson Reuters Web of Knowledge • Altmetric

  11. Citation data

  12. Differences in citation data

  13. Differences in citation data • For a sample of 358 Wellcome-associated papers, on average: • WoS had 10 cites per paper • Scopus 12 cites per paper • Google Scholar 18 cites per paper

  14. NISOAltmetrics project • Aim to “undertake a two-phase initiative to explore, identify, and advance standards and/or best practices related to a new suite of potential metrics in the community” • First meeting in October 2013 • The first phase identified areas for potential standardization; a consultation period has sought to prioritise these areas; phase two will advance and develop these standards. • Final report due in November 2015

  15. Shared sources – the ALM app

  16. CrossRef DOI Event Tracker (DET) Pilot • Pilot group of publishers and potential users of this data • Aim is to test the feasibility of developing and running an industry­-scale infrastructure to track, store and propagate DOI-­related “events”. • These “events” may be come from a wide range of sources including: • scholarly publications • professional or grey literature • scholarly tools • mainstream media • social media.

  17. CrossRef DOI Event Tracker (DET) Pilot • Looking to establish that it’s possible (and important) to separate out the infrastructure needed for tracking common information about the events from the value–added services (e.g. analysis and visualization) • So there will be the basic data available for all, with potential “premium” services on top. • More to follow…

  18. Key points If ALM data is to be useful we have to understand where it comes from and what it means Consistency would be good, transparency even more important Availability is vital

  19. thank youk.dolby@wellcome.ac.uk 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014

More Related