140 likes | 246 Views
IOTA: Improving OpenURL Through Analytics. Nettie Lagace (@ abugseye ) NISO Associate Director for Programs CEAL Workshop on Electronic Resources Standards and Best Practices March 25, 2014. Thanks to Oliver Pesch of EBSCO for much of this slide material . Completeness Score...
E N D
IOTA: Improving OpenURL Through Analytics Nettie Lagace (@abugseye) NISO Associate Director for Programs CEAL Workshop on Electronic Resources Standards and Best PracticesMarch 25, 2014 Thanks to Oliver Pesch of EBSCO for much of this slide material.
Completeness Score... (Total for This OpenURL) Total Weights 5 / 8 = .625 1 1 1 1 1 5 Simple example assuming equal element weights
IOTA Recommended Practice Defines a technique for determining element weights Tested with real link resolvers and real OpenURLs Based on research which looked for a correlation with data elements on the OpenURL and “success” of the OpenURL
A Statistical Approach to Determining Element Weights • Select a set of “perfect” OpenURLs • include all key data elements and resolve to full text • Perform step-wise regression • Test failure rates for each element by removing that element • Use failure rates as basis for weights • Use weights to calculate Completeness Scores and to test for correlation between weights and success for larger sample
Failure Rates from 1500 OpenURL test sample Author’s last name is least important Date is surprisingly low Volume is most critical
Calculated Element Weights *Element weight calculation: log10 (failure-rate-per-10,000 OpenURLs)
Results Correlation Coefficient .80 Tests conducted on sample of 15,000 OpenURLs randomly pulled from IOTA database
IOTA Online Tool • 23.3+ million OpenURLs processed • Reporting interface • Analyze data elements (metrics) across vendors or database (Source) • Analyze (Source) for all data elements
How to use IOTA materials The Technical Report provides suggestions for improving OpenURLs The interactive tool offers a means to pin-point irregularities in data provided on OpenURLs The Recommended Practice describes how to create a Completeness Index Completeness Index allows OpenURL quality problems to be quantified
Why you should use IOTA Link resolver vendors can implement the Completeness Index in their products to help identify problematic OpenURL sources Librarians can use suggestions and Completeness Index to more effectively communicate quality problems to content providers Content providers can use the online interactive tool to identify problems with the data they provide
Thank you! Questions?nlagace@niso.org @abugseye I Want To Go To Magnolia Mountain by lilomooney is licensed under CC-BY 2.0