Holdings Information in Electronic Content Access: NISO’s IOTA Working Group

1. Holdings Information in Electronic Content Access:NISO’s IOTA Working Group January 8, 2011 Oliver Pesch, EBSCO Information Services

2. Overview • Background on iota – why focus on OpenURL quality • Current focus – what is the problem space being tackled by the working group • Status • Looking forward • Getting involved

3. Background • Item-level linking became part of our vocabulary a decade ago as librarians worked to link users from the point of discovery to the content that was discovered. • OpenURL and link resolvers provide a scalable solution to item level linking. • Things don’t always work as well as they should… …this is the subject of a 2008 study led by Adam Chandler investigating issues with his institution’s link resolver. *Chandler, Adam. 2009. Results of L’Année philologique online OpenURL Quality Investigation: Mellon Planning Grant Final Report. http://metadata.library.cornell.edu/oq/files/200902%20lannee-mellonreport-openurlquality-final.pdf.

4. Item Level Linking: Before OpenURL Sources (discovery points) Targets (appropriate full text)

5. Item Level Linking: With OpenURL Sources (discovery points) Targets (appropriate full text) LinkResolver

6. Item Level Linking: With OpenURL Sources (discovery points) Targets (appropriate full text) LinkResolver TargetLinks OpenURL Knowledge base

7. Item Level Linking: With OpenURL Sources (discovery points) Targets (appropriate full text) Full text LinkResolver TargetLinks Citation OpenURL 1 Citation details in OpenURL Target link created often using citation data 3 Knowledge base 2 Citation details matched against collection to find appropriate link

8. Item Level Linking: With OpenURL Citation: A, Bernand, et al. "A versatile nanotechnology to connect individual nano-objects for the fabrication of hybrid single-electron devices." Nanotechnology 21, no. 44 (November 5, 2010): pg. 201. Academic Search Complete, EBSCOhost (accessed October 24, 2010). Sources (discovery points) Targets (appropriate full text) Full text Target Link: http://www.content.com/0957-4484/21/44/201 OpenURL: http://ps4ps6lm2r.search.serialssolutions.com/?issn=0957-4484&volume=21&issue=44&date=20101105&spage=201&title=Nanotechnology&atitle=A+versatile+nanotechnology+to+connect+ Individual+nano-objects+for+the+fabrication+of+ hybrid+single-electron+devices.&aulast=Bernand LinkResolver TargetLinks Citation OpenURL 1 Citation details in OpenURL Target link created often using citation data 3 Knowledge base 2 Citation details matched against collection to find appropriate link

9. OpenURL Linking Errors:Non-standard OpenURL 1 OpenURL is not standard Sources (discovery points) Targets (appropriate full text) 2 Request Rejected! 3 Full text No LINKS! X LinkResolver TargetLinks Citation OpenURL Citation details in OpenURL Target link created often using citation data Knowledge base Citation details matched against collection to find appropriate link

10. OpenURL Linking Errors:Data elements missing 1 OpenURL missing data elements Sources (discovery points) Targets (appropriate full text) 3 Links missing or broken because of missing pieces Full text X LinkResolver TargetLinks Citation OpenURL Citation details in OpenURL Target link created often using citation data 2 Knowledge base Item may not match knowledge base. OR elements missing for target link Citation details matched against collection to find appropriate link

11. OpenURL Linking Errors:Mistakes in data elements 1 OpenURL has errors in data elements Sources (discovery points) Targets (appropriate full text) Links missing or broken because of bad data or WRONG links. 3 Full text X LinkResolver TargetLinks Citation OpenURL Citation details in OpenURL Target link created often using citation data 2 Knowledge base Item may not match knowledge base. OR target links are invalid; OR, false matches Citation details matched against collection to find appropriate link

12. Summary of possible problems:Current focus for iota • Structure -- Bad OpenURL • Completeness -- Data elements missing • Accuracy -- Data elements wrong

13. IOTA Working Group • Improving OpenURL Through Analytics (iota) • Created in 2010 • Basic Assumptions: • Results are achieved through an analytical investigation of how OpenURL links work. • Practical: Address the links generated by the OpenURL standard, not the standard itself. • Selective changes to OpenURLs will lead to significant improvement in linking success rate. • Motto: "small changes. big improvements"

14. Desired Outcomes • Develop community-recognized index for measuring the quality of OpenURL links generated by content providers. • Produce qualitative reports that will help OpenURL providers quickly compare their OpenURL quality to that of their peers. • Method: • fair; • transparent; • scalable across all OpenURLs and their providers.

15. Focus • Core elements: • Contained in IOTA's OpenURL reporting system; • 9 million OpenURLs from libraries and providers.  • Scoring system based on assumption: • Correlation exists between • # of core elements ("OpenURL completeness") & • ability of OpenURLs to link to specific content. • Weighting assigned to core elements: • Based on relative importance • spage vs atitle • issn vs jtitle • doi/pmid vs date, etc.

16. Work in Progress • Element weighting still in progress: • E.g., importance of identifiers (doi, pmid) vs bibliographic data (issn, volume, spage). • Currently, IOTA focuses on OpenURLs from citation sources only. OpenURL quality is also influenced by: • knowledge base, • resolver, • full-text provider (target). • High "completeness" score of OpenURLs not always indicative of "success" in linking to full texts • Combination of multiple indexes along linking nodes may provide more complete picture.

17. IOTA Project Site

18. IOTA Project Site

19. Report Types

20. Report Types

21. Source Report: vendor or database

22. Source Report: Elements (vendor)

23. Element & Pattern Frequency Report

24. Element & Pattern Frequency Report : Choose Metric

25. Element & Pattern Frequency Report : Metric = Issue

26. Click from Element & Pattern Frequency Report to Source Report

27. Documentation Wiki

28. Provides working definitions of terms such as… Elements Link-to / Target Patterns SID Vendor Glossary

29. IOTA Blog & Twitter http://openurlquality.blogspot.com/ Find us on Twitter Hash Tag   #nisoiota

30. Status • Web site created • 9 million+ OpenURLs loaded • Initial set of reports available for analysis of data – publicly available • Work underway on creating a completeness index • Exploring options with KBART and other groups for looking at other aspects of OpenURL quality

31. How can I get involved in IOTA? If you are a vendor -- • Look at IOTA data ... or... • Point your tech folks to our data • This data is meant to help make improvements in your openURL linking. If you are a librarian -- • Contribute data to IOTA • Help spread the word to vendors • More information on the IOTA project at:http://openurlquality.niso.org/

32. Group email: openurlquality@list.niso.org More info...   http://openurlquality.niso.org/ Questions?