Latest Developments in Research Performance Evaluation

1. Latest Developments in Research Performance Evaluation 研究產出 競爭力剖析 洞悉全球趨勢 Yasushi Adachi Regional Manager, Asia Pacific Elsevier

2. Agenda • Background - Use of research performance measurement by researchers, administrators and policy makers • Trends in Taiwan’s research output • Application of latest search tools in biomedical research

3. Increasing need to measure research performance • Impact factor, H index, peer comparisons, and Retrovirology: is it time to individualize citation metrics?(Retrovirology 2007, 4:42) Dr. Kuan-Teh JeangNational Institutes of Health(Editor-in-Chief, Retrovirology) “…a couple of things are clear about scientists. First, we like functions that are easy to use; and second, we like to be able to compare or rank ourselves against colleagues. Because the world is not a place of unlimited resources and positions, rankings become very important for career development and job promotions.”

4. THES Top 200 Ranking 2007 – Scopus replaces WoS

5. Policy makers and Administrators Researchers at large Research Performance Measurement (RPM) • Grant Allocations • Policy Decisions • Benchmarking • Promotion • Collection management • Funding allocations • Research Country Institution Research groups Researchers

6. Taiwan – Research Output Global : 5.5% Source: http://www.info.scopus.com/researchtrends/index.htm

7. < 0% Article Output Growth per Subject Area(2002 ~ 2006) 0~10% > 10% > 20%

8. Biochemistry, Genetics and Molecular Biology(Output from Taiwan) percentage No of articles Number of articles in top 5% Percentage of articles in top 5%

9. Immunology and Microbiology(Output from Taiwan) percentage No of articles Number of articles in top 5% Percentage of articles in top 5%

10. Neuroscience(Output from Taiwan) percentage No of articles Number of articles in top 5% Percentage of articles in top 5%

11. Summary of trends • Article output growth in Taiwan is at 16% - three times higher than global increase. • Growth in biomedical sciences is strong in the comparison made in this study.  increased productivity • Percentage of articles published in Taiwan appearing in the top 5% highly cited have been steadily increasing over the years. (for the selected three areas in biomedical science)  improvement in impact

12. What is Scopus? • 15,000 titles from more than 4,000 publishers • 1,000+ Open Access journals • 500 Conference Proceedings • 400M web pages • 21M patents • Repositories • Digital Archives Scopus covers:

13. Example search : Keyword  “biochip” 6,835 patents 22,312 web pages Depends on source selected 903 articles

14. Taiwan 66 articles Top 3 journals Proceedings of SPIE the International Society for Optical Engineering Sensors and Actuators B Chemical Journal of Micromechanics and Microengineering Top 3 prolific authors Chen, P.H. Tsai, C.Y. Lee, G.B. Japan 43 articles Top 3 journals Polymer Preprints Japan Biomaterials Japanese Journal of Applied Physics Part 2 Letters Top 3 prolific authors Ito, Y. Tamiya, E. Ishihara, K. Country comparison (keyword “biochip”)

15. Highest cited author in Scopus on biochip research

16. Detailed analysis of Dr. Cheng’s output No of articles No of citations h-index plot

17. Summary • Driven by strong demand, the use of metrics for research performance measurement (RPM) will continue to increase in the future. • Significant improvements were made during the recent years in terms of bibliometric data retrieval and the invention of new analysis tools. • Technology will enable performance benchmarking at all levels and effective post processing of results. • Elsevier will continue to invest in the development of RPM tools for both research administrators and researchers.

18. Thank you.