140 Characters in Search of a Meaning Incorporating Motivation into Altmetrics

1. 140 Characters in Search of a MeaningIncorporating Motivation into Altmetrics Mike Taylor Research Specialist http://orcid.org/0000-0002-8534-5985

2. The formulation and development of altmetrics has hitherto largely been rooted in computer science, with the early issues being the collection and presentation of social citations. However, there is a disconnect between the straightforward counting of mentions, and the interpretation of academic motivation and meaning. As altmetrics evolves into a sub-discipline, it is important for academics of all fields to engage with the debate, the emerging literature, and altmetrics’ adoption into the lingua franca of academic discourse and evaluation. Questions on the motivation and the value of public sharing require input from the social sciences: there will be cross-cultural and cross-discipline differences, gender issues and network bias. However altmetrics develops over the course of the next few years, these issues should be discussed in order to correctly position the debate within the scholarly community and to ensure benefits for all parties.

3. Observer bias • Degree in psychology, mostly social • Most work is computer science • An explanation of privatesocialcitation: to create a bookmark / reference on a networked application without awareness that this is public data

4. Changing nature of scholarly communications 1940s to present: • Publication • Discussion in institutions, conferences, labs • Citation • On-going private discussion => bibliometrics 2008 to present: • Publication • Discussion in institutions, conferences, labs, social networks • Citation • On-going public and private discussion / activity => “altmetrics”

5. A brief background to altmetrics • Four years old • Collection and analysis of bookmarks, social media references, mass media references, recommendations, blog posts, videos that link to an article (mostly via a DOI) • Sometimes includes page views and downloads (article level metrics)

6. Altmetrics… …is a very broad term • Detection • Collection • Measurement • Analysis • Presentation • Interpretation

7. The scope of altmetric data • Distinctly scholarly: Mendeley, Citeulike, Zotero • Re-use: Figshare, Data Dryad • Technical: Github • Wider social: Twitter, Facebook, Delicious • Mass media: BBC, NY Times • Publisher usage data: ScienceDirect, Plos

8. What does it all mean? • Meaning is not correlation • Altmetrics is not yet a big data problem (review of 5 years of papers show only 17% have accrued altmetric data, very few get 1000s of mentions) • Some research using correlation, very little theory • Validity, accuracy, applicability? • Not well suited for ‘simple’ search ranking algorithm – ‘best paper’ concept would be absurd

9. A brief statement of the new problem • We don’t know what people intend when they socially cite a paper

10. A brief statement of the old problem • We don’t know what people intend when they socially cite a paper …except…

11. Lessons from ancient history(1940s-present) • There’s a lot of research into why people cite! • What do citation counts measure? A review of studies on citing behavior (2008) Lutz Bornmann, Hans-Dieter Daniel • Great review of motivating literature from 1960s onwards • 150+ citations, none of them focused on altmetrics • http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.83.4737&rep=rep1&type=pdf

12. Déjà vu all over again • Literature, reviews, methodological approaches, data sets, theoretical frameworks • Normative theory vs Social constructivist • “Scientists give credit to colleagues whose work they use by citing that work” vs • “Scientific knowledge is socially constructed through the manipulation of political and financial resources and the use of rhetorical devices”

13. Garfield’s early postulations (1962) 1. Paying homage to pioneers; 2. Giving credit for related work (homage to peers); 3. Identifying methodology, equipment, etc.; 4. Providing background reading; 5. Correcting one’s own work; 6. Correcting the work of others; 7. Criticizing previous work; 8. Substantiating claims; 9. Alerting to forthcoming work; 10. Providing leads to poorly disseminated, poorly indexed, or uncitedwork; 11. Authenticating data and classes of fact (physical constants, etc.); 12. Identifying original publications in which an idea or concept was discussed; 13. Identifying original publication or other work describing an eponymic concept or term (...); 14. Disclaiming work or ideas of others (negative claims); and 15. Disputing priority claims of others (negative homage)

14. Research over 40+ years… • Good evidence for normative behaviour • Cronin (2005) “The weight of empirical evidence seems to suggest that scientists typically cite the works of their peers in a normatively guided manner, and that these signs (citations) perform a mutually intelligible communicative function”

15. Lots of solid observations • Affirmational citation - 10% to 90% • Assumptive type - 5% to 50% • Conceptual type - 1% to 50% • Contrastive type - 5% to 40% • Methodological type - 5% to 45% • Negational type - 1% to 15% • Perfunctory type - 10% to 50% • Persuasive type / ceremonial - 5% to 40%

16. Enormous variation in % • Methodological (citation context analysis, author interview, author survey) • Many disciplines • Classification variation

17. Formal citation vs social citation • Formal citation is slow, and is part of academic culture (“show your reading…”) • (Public) social citation is fast and derived from popular culture • Formal citation is a good tool to understand scholarly impact • Some altmetric data might be good for scholarly impact, some might be good for social impact

18. Characteristics of social citation • Adding a paper to Mendeley (a reference manager with a ‘social’ network) • Writing a blog • Posting a tweet • Anonymous vs named, absent vs trivial vs substantial context, variation in author connection strength (etc), speed of responsiveness

19. Expanding social constructivist view • Rhetoric is in real-time environment • Public citation is visible, findable, reference-able • Explicitly builds a tangible network – “I’m your follower, follow me” • Manipulative rhetoric?

20. Social constructivist andnormativist • Public social citation will be both (how much personal value would need to accrue to positively tweet something useless) • Private social citation more like to be solely normative • Requirement for a theory of social media?

21. The anatomy of a tweet • Commentary / context • Author awareness • Network approval • Network construction • Passing on / retweets • Recommending • Informational

22. Context within an existing network • But if the author is a colleague, a lover, a friend, a foe, a boss, an assistant… • Social citation is intimate and social networks are curated • Power, cultural, gender issues

23. Focus on the normative elements • Reasonable implication that a cited paper has been read • Social citation cannot have this implication: • “I have read”, “I intend to read”, “I might read”, “I read other works by the authors”, “the abstract looks useful”, “I might skim read when looking for a citation”  • All are additional to other normative behaviour

24. Altmetric impact is not purely scholarly impact • After 40+ years we can make some conclusions about formal citation • After 4 years we can make no such conclusion about social citation • Probably normative plus constructivist

25. Value-free classifications • Social noise • Scholarly action • Scholarly commentary • Mass media • Re-use • Looking for events, researching for a narrative

26. Altmetrics has many functions • Prediction of ultimate citation • Measuring / recognizing component re-use / preparatory work / reproducibility • Hidden impact ( impact without citation ) • Real-time filtering / real-time evaluation • Platform / publisher / institution comparison • Measuring social reach / estimating social impact

27. A matrix of data against function Guesswork that needs verification and data!

28. The more data we can see Data from altmetric.com (c.100 articles since pubdate -2) • The bigger the picture

29. We really need the meaning to progress our understanding • Altmetrics needs social scientists • Altmetrics is a bag of measurements of human activity • Altmetrics cannot be solely left to computer scientists • This is more than maths and code • Please: engage, research (willing research partner: mi.taylor@elsevier.com)