1 / 26

Tell your impact story: Beginners guide to quality & impact metrics

Tell your impact story: Beginners guide to quality & impact metrics. CURTIN UNIVERSITY LIBRARY. July 2014. Curtin University is a trademark of Curtin University of Technology CRICOS Provider code 00301J. This Session. Understand the when, how and why: Research impact and quality

abla
Download Presentation

Tell your impact story: Beginners guide to quality & impact metrics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Tell your impact story: Beginners guide to quality & impact metrics CURTIN UNIVERSITY LIBRARY July 2014 Curtin University is a trademark of Curtin University of Technology CRICOS Provider code 00301J

  2. This Session Understand the when, how and why: • Research impact and quality • Four-sector assessment • Scholarly • Industry • Government • Societal

  3. Introduction Evaluation of research quality and impact: • Quality vs Impact • Prestige • Funding • Promotion

  4. Scholarly / Journal metrics Using journal metrics for quantitative analysis: • Journal Citation Reports - Web of Science (Thomson product) • SJR (SCImago Journal Rank) - Scopus (Elsevier product)

  5. JCR JCR JCR > Search for a specific journal > Journal title search > (Journal Rank in Categories) Journal Ranking

  6. SJR SJR SCImago website > Journal rankings> Subject area Business, Management & Accounting/Accounting > Journal Ranking

  7. Scholarly / Author metrics Using the H- index to determine citation counts of individual authors, groups of researchers etc: • The h-index is determined by calculating where h number of articles have been cited h or more times • Found in citation databases e.g. Scopus or Web of Science, Publish or Perish from Google Scholar • Influencing factors/cautions

  8. H-index Web of Science H-index - Web of Science

  9. Scholarly / Article metrics Average numbers of citations per discipline Essential Science Indicators > Baselines > (By Averages) View the average citation rates table

  10. Scholarly / Qualitative measures Using qualitative measures to determine impact: • Who is citing you • Measures of esteem • Editor of a prestigiouswork of reference • Fellowship of a learned academic society • Recipient of an AustraliaCouncilgrant

  11. Industry & Government Demonstrating return on investment: • Measures of impact beyond academic • Locate evidence • How research is being applied

  12. Industry & Government Impact narrative: • An effect on, change or benefit to • Developing a framework • Case study approach

  13. Industry & Government Socio-economic Objectives (SEO): http://www.abs.gov.au/Ausstats/abs@.nsf/Latestproducts/CF7ADB06FA2DFD69CA2574180004CB82?opendocument

  14. Industry & Government Impact narrative: • EIA case-study approach • Link between research and impact • Validation of impact • Other examples

  15. Industry & Government

  16. Industry & Government http://www.csiro.au/Portals/About-CSIRO/What-we-do/Impact-case-studies/BodyArmour.aspx

  17. Societal Sources for detecting potential influence Exploring the boundaries: How altmetrics can expand our vision of scholarly community and social impact Mike Taylor Information Standards Quarterly Summer 2013 Vol. 35 Iss. 2

  18. Societal Measures of impact • Article-level metrics & Altmetrics Altmetrics in Evolution: Defining and redfiing the ontology of article-level metrics Jennifer Lin & Martin Fenner Information Standards Quarterly Summer 2013 Vol. 35 Iss. 2

  19. Societal Measures of impact • Article-level metrics & Altmetrics

  20. Societal Impact narrative: • Altmetrics hinges on the very prevalence of its own diversity. Its raison d’etre is to provide a more expansive view of a research artefact's impact Lin and Fenner (2013) • Levels of engagement

  21. Societal Levels of engagement: Lin and Fenner (2013)

  22. Societal Levels of engagement: Lin and Fenner (2013)

  23. Societal Controversies or problems SCIENTISTS DON’T COUNT: WHY YOU SHOULD IGNORE ALTMETRICS AND OTHER BIBLIOMETRIC NIGHTMARES D Colquhoun & A Plestedhttp://www.dcscience.net/?p=6369 • Impact vs popularity

  24. Societal Future of altmetrics Clearly now is the time to capitalise on the interest and attention to finally bring assessment of research out of the systems belonging to the print era and into a more modern, multifaceted system that takes advantage of the flexibility and scale of the web Social signals reflect academic impact: What it means when a scholar adds a paper to Mendeley William Gunn Information Standards Quarterly Summer 2013 Vol. 35 Iss. 2

More Related