Research Institute’s CRIS as a Source of Data for Assessing Research Results

1. Research Institute’s CRIS as a Source of Data for Assessing Research Results Sergey Parinov, CEMI RAS Socionet project

2. How we can develop CRIS to provide … • complex, detailed and accurate data for better assessing research results and researchers by: • Higher Attestation Commission (VAK) experts • Research Foundations, e.g. Russian Foundation for Basic Research to evaluate proposals • Managers of research organizations to make right motivations of scientists • CRIS has to be a part of research e-infrastructure

3. What we can develop in CRIS and in research e-infrastructure: • Tools for electronic depositing of research results to give experts full and accessible set of research results • Tools and services for linking relative research materials and maintaining networks of such relationsto give experts complexity of data • Tools and services for better research results usage and its monitoring to give experts more accurate and realistic data for research assessments

4. Full and accessible data on research results • CRIS provides a tool for electronic depositing by researchers of all their research results (as articles) • Research e-infrastructure provides an integration mechanism to build an unified information space from local CRISs’ data • Interactions between local CRISs and integration mechanism can based on OAI-PMH protocol and CERIF data format • Current problem: lack of motivation for researchers

5. Electronic depositing tools • There are many systems, which support OAI-PMH protocol (Eprints, Dspace, Socionet Personal Zone, etc.) and few of them supporting CERIF format (e.g. SPZ) • UsingSocionet Personal Zone (spz.socionet.ru) services a researcher can: • Deposit his/her single materials in thematic series of Socionet Open Archive • Create and maintain any number of different types own series (preprints, postprints, personal and institution profiles, news, comments, projects, thesis, etc.) collecting any number of materials/articles

6. Institutional Repository (IR) Tools • Using Socionet Personal Zone a research institute can integrate all types series created by different people from their staff as IR with OAI-PMH/CERIF features • Many people from the institute can create and maintain their thematic collections of research materials and institute’s admin can integrate it as IR • By this way research institutes of Social Science Section of RAS built 21 IR, and as a result Russia moved to 14 position in an international rating

7. IRs in Russia (October 2008)

8. Russia in IRs international rating (September 2008) Страна кол-во ОА • United States225 • United Kingdom108 • Germany86 • Brazil55 • Japan46 • Canada44 • France40 • Sweden35 • Australia34 • Spain32 • Italy31 • India28 • Netherlands23 • Russian Federation 20 Source: http://roar.eprints.org/index.php?action=browse

9. Leading Russian Research Institutes by IR’s characteristics

10. Example of series structure of IR(for IEIE SB RAS)

11. Example OAI-PMH{CERIF} support for IR at Socionet

12. Complexity of data on research results • CRIS provides a tool to make thematic links between relative materials located at any part of unified information space • Research e-infrastructure provides a service to support such links and tools to maintain networks of such relations • Basic information objects for linking are: • a research article or a material • personal profile of a researcher • institution profile

13. Example of types of linking for a research article

14. Links as a graph

15. Example of types of links for a personal profile

16. Example of types of links for an institution profile

17. Needed development • Adding to CERIF a set of specifications for global thematic links between information objects: • how to provide global unified ID for objects from local CRIS • open format for specifying links between objects • open list of links types

18. Accurate and realistic data for research results usage assessment • CRIS provides a tool to use (cite) research results in advanced and improved form located in any other CRIS • Research e-infrastructure provides a service to support such advanced citations • A focus on building a new advanced model to make electronic citations in deposited research articles/materials

19. Electronic citation tool • To make citation as a one of thematic links between fragments of articles located in any CRIS • Each citation link includes a set of quality attributes of usage type and a field for notes • Making a citation an author specifies linked fragments of texts, selects usage type and can fill in a note

20. Quality attributes of electronic citation Making a citation an author should select one or many of quality attributes to specify how (s)he uses the cited research result. Suggested usage types: • «grounds for receiving my results», which means direct scientific use of cited result by the author; • «proof of cited result», i.e. the result of the author proves the cited one; • «cited result proves result, obtained by the author previously», i.e. the author states his/her priority with regard to independently obtained cited result; • «similar or related result», meaning that the author in a certain sense repeated the cited result; • «illustration of my conclusions», implying certain logical link between the result of the author and the cited one; • «object for criticism», means that the author doubts the cited result.

21. Electronic citation output: new data for research assessment • who and how uses certain research results as the basis for own scientific argument; these cases mean direct utilization of results and increase indicator of its using; • which results prove or are proved by other results, which should enhance the indicator of the proved results’ credibility; • which results repeat the existing ones, which should increase the degree of both results credibility; • which results use as general illustrations than means a case of weak usage of results; • who criticizes which results

22. Needed development • Adding to CERIF a “citation” type of links with a set of quality attributes and a “note” field • Provide an open list of quality attributes for citation links