1 / 18

The use of bibliometry for evaluation in Physics

The use of bibliometry for evaluation in Physics. D. Jérome Université Paris XI-CNRS, Past Editor in Chief of Europhysics Letters Académies des Sciences. Colloque de l’Académie des sciences "Évolution des publications scientifiques - Le regard des chercheurs" des 14-15 mai 2007 .

janet
Download Presentation

The use of bibliometry for evaluation in Physics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The use of bibliometry for evaluation in Physics D. Jérome Université Paris XI-CNRS, Past Editor in Chief of Europhysics Letters Académies des Sciences Colloque de l’Académie des sciences "Évolution des publications scientifiques - Le regard des chercheurs" des 14-15 mai 2007 AS 14-15 Mai

  2. The need for evaluation Basic Research activity is supported to a large extent by States Decide for support: positions, equipment, running money Evaluation (for individuals, labs, domains, universities, research organisms,..) of the past (recognition, ranking of scientists) and of the future (positions, grants,..) Evaluation committees, peer reviews analysing scientific output Use of bibliometry, What and how?. AS 14-15 Mai

  3. Databases Existence of web-databases with inverted bibliographic data for citation analysis Google Scholar scholar.google.com free Scopus (Elsevier) scopus.com NASA ADS adsdoc.harvard.edu free ISI Thomson http://portal.isiknowledge.com Web of Sciences JCR ISI---> Journals, Google scholar--->Books, conferences (Belew 2005) AS 14-15 Mai

  4. 10% most cited articles 2000-02up to now Squew distribution AS 14-15 Mai

  5. Impact factor of journals IF (year n)= means that on average each of the papers for years n-1 and n-2 are cited IF times in the year n. Calculated every year in JCR. 2007 will give IF(2006) Arbitrariness of the two years period for the IF Are all journals listed? 6000 in Science and Technology IF is an indicator for editors Misuse of IF for the evaluation of individuals AS 14-15 Mai

  6. Physics papers at Science/Nature Time span 1975-2007 IF=30.92 IF= 29.27 First 100 papers Mostly Bio and Medicine, a small minority of physics papers AS 14-15 Mai

  7. 68 cit/art Distribution of citations Nature:1852 Science:1713 >2/3 of the papers are below average citations AS 14-15 Mai

  8. 17 cit/art Distribution of citations at Phys.Rev.Lett Papers 2003-2004 6972 papers 2/3 are below average AS 14-15 Mai

  9. 5.5 cit/art Distribution of citations at Europhysics.Lett 1054 < 2/3 below average AS 14-15 Mai

  10. Need for other indicators IF informs about the popularity of a journal. Ban IF factor for evaluation. What is needed is an indicator related to the importance, quality, influence, impact of the scientific work, not to the popularity of a journal Physicists publish in a small number of journals nearly all listed in WoS (test done with four major labs at University Paris XI) May not be true for other domains (language problem) Use of h and g indicators AS 14-15 Mai

  11. 60 h articles with h citations 50 40 30 Citations number 20 10 0 1 10 20 30 40 50 60 Number of the article Definitions for h and g J.Hirsch, 2005 L.Egghe, 2006 g h AS 14-15 Mai

  12. Citations profile for the anonymous researcher ! h =41 g = 83 G/H=2.02 AS 14-15 Mai

  13. Pros h: -- is smoothing big hits and review articles -- Problem when a small number of papers even if they are brillant -- Good correlations between h and total production -- Extension to journals or domains is possible -- Time dependence for comparison of different seniorities is possible g: -- Allows cumulative advantages on bright papers even with a small number of papers -- Reveals precursor papers,’’sleeping beauties’’ AS 14-15 Mai

  14. and cons Caution: Technical problems : Homonymy for common names, hyphened names Self citations ( no dramatic changes) Team work (the normalized h factor) Negative citations to incorrect works Cronyism, network of friends, circle of citations Must be handled by scientists AS 14-15 Mai

  15. Examples (ISI database 1950-2007) AS 14-15 Mai

  16. AS 14-15 Mai

  17. Conclusions • Database are rather exhaustive in Physics • Use bibliometry with much caution and expertise (by scientists) • Results must be validated and agreed by persons being evaluated • Ban on the use of IF for assessment of individual performance • Use several indicators related to citations, h, g, g/h AS 14-15 Mai

  18. Solving the problem of evaluation should solve the crisis of publications AS 14-15 Mai

More Related