1 / 16

Traditional Bibliometrics and Alternative Metrics in Research Program Assessment

Traditional Bibliometrics and Alternative Metrics in Research Program Assessment. Lorrie Johnson U.S. Department of Energy Office of Scientific and Technical Information (OSTI) ICSTI Technical Activities Coordinating (TACC) Meeting October 2013. Scientific and Technical Publication Metrics.

osbourne-olsen
Download Presentation

Traditional Bibliometrics and Alternative Metrics in Research Program Assessment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Traditional Bibliometrics and Alternative Metrics in Research Program Assessment Lorrie Johnson U.S. Department of Energy Office of Scientific and Technical Information (OSTI) ICSTI Technical Activities Coordinating (TACC) Meeting October 2013

  2. Scientific and Technical Publication Metrics • Scientific and technical publications, such as journal articles, are the primary products of scientific research, and the means by which new knowledge is created and transferred. • Publication metrics can provide useful insight into research productivity, and into the impact and influence of research within particular fields of science.

  3. Analysis of Joint Genome Institute Publications

  4. Aggregate JGI Citation Data(from Web of Science) JGI publications were cited 51,590 times (through April 2013) Average citations per article = 56 H Index = 113 (113 articles have been cited more than 113 times) Average citations per year = 4,299 Citations for JGI publications are continuing to grow over time.

  5. Top Journals for JGI PublicationsComparison of Citation Rates for JGI Articles versus Other Articles in Journal

  6. Citation Rates for 2008 JGI Articles in Nature Compared to Average Citation Rate

  7. Citation Rates for 2009 JGI Articles in Science Compared to Average Citation Rate

  8. Analysis of Individual Publication:The genome of black cottonwood, Populustrichocarpa… Paper was published in 2006; citations peak in 2009-2011. Indicators of Impact and Influence within Research Field Primary citations = 1,218 Secondary citations = 24,058 Research Areas of Citing Articles = 40 Unique Authors of Citing Articles = 5,149 Distinct Institutions Represented in Citing Articles = 1,112

  9. Analysis of Individual Publication:The genome of black cottonwood, Populustrichocarpa… Top 10 Journals Citing this Article Top 10 Research Areas of Articles Citing this Article

  10. Alternative Metrics for JGI Article in PLOS One:“Direct Comparisons of Illumina vs. Roche 454 Sequencing Technologies on the Same Microbial Community DNA Sample” Article Metrics provided by PLOS One: Other Alternative Metrics Measurements: Total article views = 23,384 Total PDF downloads = 4,403 4 Tweets 4 Facebook posts 15 bookmarks on CiteULike 20 cites on CrossRef Mendeley readers = 212 (89% in the Biological Sciences; 25% of readers from the U.S.) Cited by 17 articles in PubMed Central 46 citations in Google Scholar Altmetric score = 21

  11. NISO Alternative Assessment Metrics (Altmetrics) Project • Sloan Foundation grant to undertake two-phase initiative to explore, identify, and advance standards and/or best practices for new assessment metrics, including: • Usage-based metrics • Social media references • Network behavioral analysis • Will also explore potential assessment criteria for non-traditional research outputs, such as data sets, visualizations, software, and other applications.

  12. NISO Alternative Assessment Metrics (Altmetrics) Project • First phase – in person and virtual meetings to solicit input and collaboration from community. • ICSTI members are encouraged to participate: • Washington, DC – December 11, 2013 • Philadelphia, PA – January 23-24, 2014

  13. NISO Alternative Assessment Metrics (Altmetrics) Project • Outcome from Phase 1 – white paper describing outcomes, recommendations, and action items identified during the meetings. • Phase 2 and Final Outcome – Published standards or recommended practices regarding alt metrics. • For more information, see NISO project website: • http://www.niso.org/topics/tl/altmetrics_initiative/ • Or contact Todd Carpenter: • tcarpenter@niso.org

More Related