1 / 27

Evaluation in OpenAIRE

Evaluation in OpenAIRE. 8 th euroCRIS Strategic Seminar, September 13 th – 14 th , 2010, Brussels | Mikael K. Elbæk , Technical University of Denmark. OpenAIRE - factsheet. Open Access Infrastructure for Research in Europe Programme: FP7 – Research Infrastructures

zelia
Download Presentation

Evaluation in OpenAIRE

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation in OpenAIRE 8theuroCRIS Strategic Seminar, September 13th – 14th, 2010, Brussels | Mikael K. Elbæk, Technical University of Denmark

  2. OpenAIRE - factsheet • Open Access Infrastructure for Research in Europe • Programme: FP7 – Research Infrastructures • Starting date: December 1, 2009 • Duration: 36 months • Budget: 4.1 Million • 38 partners covering all European member-states • To be reached at www.openaire.eu

  3. FP7 OA Pilot • The European Commission launched the open access pilot in August 2008 in seven thematic research areas and  it will run until the end of FP7: • Energy • Environment (including Climate Change) • Health • Information and Communication Technologies (Cognitive Systems, Interaction, Robotics) • Research Infrastructures (e-infrastructures) • Science in society • Socio-economic sciences and the humanities • Special clause 39 : • “In addition to Article II.30.4, beneficiaries shall deposit an electronic copy of the published version or the final manuscript accepted for publication of a scientific publication relating to foreground published before or after the final report in an institutional or subject-based repository at the moment of publication.“

  4. ERC OA guidelines • The ERC Scientific Council's Statement on Open Access of December 2006 stressed the fundamental importance of peer-review in ensuring the certification and dissemination of high-quality scientific research, as well as the importance of wide access and efficient dissemination of research results. In December 2007, the ERC Scientific Council followed this up with Guidelines for Open Access. These Guidelines state that: • The ERC requires that all peer-reviewed publications from ERC-funded research projects be deposited on publication into an appropriate research repository where available, such as PubMed Central, ArXiv or an institutional repository, and subsequently made Open Access within 6 months of publication. • The ERC considers essential that primary data - which in the life sciences for example could comprise data such as nucleotide/protein sequences, macromolecular atomic coordinates and anonymized epidemiological data - are deposited to the relevant databases as soon as possible, preferably immediately after publication and in any case not later than 6 months after the date of publication.

  5. European Helpdesk • Promote FP7-pilot and ERC OA guidelines • National Open Access Desks (27 countries) • Provide OA “toolkits” for • Researchers • Institutions • Repository managers • Setup 24/7 portal for deposit, search of OA publications • Liaison with • Other European OA initiatives • Publishers • CRIS systems

  6. Reaching out to EC members Region 4 West(UGENT) Region 2 South(UMINHO) Region 3 East(eIFL) Region 1 North(DTU) Denmark (TechnicalUniversity of Denmark) Cyprus (UniverstityofCyprus) Czech Republic (Technical University of Ostrava) Bulgaria (BulgarianAcademyofSciences) Austria (University of Wien) Finland (University of Helsinki) Greece (National Documentation Center) Hungary (HUNOR) Estonia (University of Tartu) Belgium (Universtiyof Gent) Sweden (National Library ofSweden) Italy (CASPAR) Lithuania (Kaunas Technical University) Latvia (University ofLatvia) France (Couperin) National Open Access Desks evaluating and disseminating policies & best practices Norway • (University of Tromsoe) Malta (Malta Council for Science & Technology) Romania (Kosson) Poland (ICM – University ofWarsaw) Germany (University ofKostanz) Portugal (University ofMinho) Slovakia (university Library of Bratislava) Slovenia (University ofLjubljana) Ireland (Trinity College) Spain (FECYT) Netherlands (Utrecht University) UK (SHERPA)

  7. OpenAIREinfrastrucure basics • Builds on European OA Repository infrastructure • Researchers deposit once • Harvest from OpenAIRE compliant repositories • OpenAIRE provides “Orphan” repository • Extend DRIVER guidelines for repository managers • Based on DRIVER developed D-NET software toolkit • Access to scientific publications • Search, browse • Visualization tools • Provide monitoring tools for • Document/depositing statistics • Usage statistics from repository infrastructure • Interoperation with other infrastructures

  8. OpenAIRE in a nutshell OpenAIRE overall overview: functionalities and domains served

  9. CERIF Data Model

  10. OpenAIRE Data Model

  11. OpenAIRE Controlled Vocs nationality Authors Nationalities Articles license_kind LicenseKinds language Languages Organizations country_of_origin Countries DataSources typology DataSource Typologies Projects Projects _FP7subjects FP7Subjects

  12. OpenAIRE Guidelines • DC DRIVER guidelines +: • projectID – dc:relation • accessRights – dc:rights • embargoEndDate – dc:date

  13. Measuring success of OA in FP7 • Document statistics for OA deposition • % rate of OA deposition • Usage statistics on FP7 OA publications • Impact of OA deposited publications One WP dedicated in development of usage statistics service

  14. Funders requirements (EC) • Open Access evaluation: the following stats will be broken down by research area, programme, ERC, contract type (NoE, IP, etc.) country, institution, • total number of articles published in FP7 after August 2008 • total number of open access articles • average number of articles per project • total/average number of articles of SC39 projects • number of articles still in embargo period (those in 6 months embargo, those in 12 months, those with no embargo, i.e., gold) • Project evaluation based on OA publication, broken down by research area, programme, funding (e.g., big vs. small projects), maturity of project (how long has it been going for), etc. • number of projects that have not published any articles • number of projects in the pilot that have not published any articles • Overall compliance with the mandate (how many are, how many are not) – this in relative numbers

  15. Usage statistics Davichi / David Oliva, http://creativecommons.org/licenses/by/2.0/

  16. Strategy for recording usage • Based PRIUS model slightly adapted to OpenAIRE • Basically the normalization will be done centrally • When • What • Who • Which

  17. Usage statistics service for FP7 publications

  18. Usage statistics service components • Harvester/aggregator from OpenAIRE compliant repositories • Service for processing usage data and produce meaningful statistics • Provide web and graphical tools for • Managers • Funders • Researchers • Service can easily be adopted to non FP7 publications (e.g. in DRIVER, …)

  19. OpenAIRE compliant repositories • Definition of OpenAIRE compliant repositories • OpenAIRE guidelines for usage statistics • Align with current initiatives • Support major usage data formats • Interoperability is important • Support multiple transfer protocols • OpenAIRE orphan repository (Invenio/CERN) to comply with guidelines

  20. OpenAIRE partners expertise • UNIBI, UGOE, SURF • National initiatives – OA-stat • PEER project • Knowledge Exchange • Univ. of Minho • DSpace statistics plugin • University of Athens • Processing of web server & application logs • Usage statistics application in TELPlus • Personalized applications in DRIVER & TELPlus

  21. Services to repository managers & funders

  22. Web graphical tool Statistics provided by publication

  23. Web graphical tool Statistics provided by publication

  24. Other article level stats • Citations • Web usage • Expert ratings • Social bookmarking • Community rating • Media/blog coverage • Commenting activity • More sophisticated types of usage metrics • Tracking ‘conversations’ outside of the publisher • Reputation metrics for users • Tagging • and more… Mark Patterson – PLoS.org - www.ape2010.eu/ppt_wednesday/15_Patterson.pdf

  25. Thank you http://creativecommons.org/licenses/by/2.0/ by ky_olsen

  26. Open Issues • Unique/persistent identifiers of publications • Publications on different repositories • Capture different versions/formats of same publication • Exclusion of robots • Repository platform specific implementations • Uniform approach? When? • What happens in thematic repositories? • Volume of usage stats – OpenAIRE sets?

  27. OpenAIRE workplan & timeline • May-July, 2010 • OpenAIRE internal specifications for usage data and transfer specs • November, 2010 • Usage data exchange guidelines for OpenAIRE compliant repositories • Harvester, aggregator service • July, 2011 • Usage statistics service • Web usage statistics graphical tools

More Related