Advancing Libraries with Generation Library Services & Resource Discovery

1. Marshall Breeding Independent Consultant, Founder and Publisher, Library Technology Guides http://www.librarytechnology.org/ http://twitter.com/mbreeding Advancing Libraries through a new Generation of Library Services Platforms and Resource Discovery Services 20 May 2015 Lebanese Library Association Conference 2014

2. Description • Libraries and information centers in almost all sectors and geographic regions have experienced a fundamental shift where large proportions of electronic resources and digital materials complement, or even dominate, their print collections. This shift demands a response in the technical infrastructure for libraries so that they can effectively manage and provide access to these multi-faceted collections. • Breeding will describe the major changes in the realm of library automation, including the advent of a new generation of library services platforms which take a significant departure from the integrated library systems that previously dominated. A new generation of Web-scale index-based discovery services likewise provide powerful ways for library users to work with these complex and large-scale collections. These new genres of library systems take advantage of the scalability possible through cloud computing technologies and the extensibility and interoperability enabled through the services-oriented architecture.

3. Library Technology Guides www.librarytechnology.org

5. Library Technology Industry Reports American Libraries Library Journal • 2014: Strategic Competition and Cooperation • 2013: Rush to Innovate • 2012: Agents of Change • 2011: New Frontier • 2010: New Models, Core Systems • 2009: Investing in the Future • 2008: Opportunity out of turmoil • 2007: An industry redefined • 2006: Reshuffling the deck • 2005: Gradual evolution • 2004: Migration down, innovation up • 2003: The competition heats up • 2002: Capturing the migrating customer

6. Library Systems Report 2014

7. Library Systems Report 2014 Arabic

8. Library Systems Report Tables http://www.americanlibrariesmagazine.org

9. AppropriateAutomation Infrastructure • Current automation products out of step with current realities • Majority of library collection funds spent on electronic content • Majority of automation efforts support print activities • New discovery solutions help with access to e-content • Management of e-content continues with inadequate supporting infrastructure

10. Technology Shift • Client / Server > Web-based computing • Beyond Web 2.0 • Integration of social and academic identities and networks into core infrastructure • Local computing shifting to cloud platforms • Application Service Provider offerings standard • New expectations for multi-tenant software-as-a-service • Full spectrum of devices • full-scale / net book / tablet / mobile • Mobile the current focus, but is only one example of device and interface cycles

11. Strategic shift for Academic Libraries • Collection Shift from Print > Electronic + Digital • E-journal transition largely complete • Circulation of print collections slowing • Large-scale investment in e-books • Technical infrastructure support: • Need better tools for access to complex multi-format collections • Strong emphasis on digitizing local collections • Demands for enterprise integration and interoperability

12. New Metadata management WorkFlows • Moving away from individual record-by-record creation • Life cycle of metadata • Metadata follows the supply chain, improved and enhanced along the way as needed • Manage metadata in bulk when possible • E-book collections • Highly shared metadata • E-journal knowledge bases, e.g. • Great interest in moving toward semantic web and open linked data • Path emerging for linked data in resource management and discovery systems • AACR2 > RDA • MARC > BIBFRAME (http://bibframe.org/)

13. Multi Tennant SaaS is the modern approach One copy of the code base serves multiple sites Software functionality delivered entirely through Web interfaces No workstation clients Upgrades and fixes deployed universally Usually in small increments Software as a Service

14. SaaS provides opportunity for highly shared data models Bibliographic knowledgebase: one globally shared copy that serves all libraries Discovery indexes: article and object-level index for resource discovery E-resource knowledge bases: shared authoritative repository of e-journal holdings General opportunity to move away from library-by-library metadata management to globally shared workflows Data as a service

15. Traditional model of Automation • Oriented to Print collections • Single Library System • Includes branches or divisional facilities • Automation strategies often set when capabilities of automation systems were limited • Institutional solo of collection management

16. Fragmented Library Management • ILS for management of (mostly) print • Duplicative financial transactions between ILS Acquisitions and enterprise business systems (many shadow systems) • Proxy and Authentication services • E-book lending platform (multiple?) • Interlibrary loan (borrowing and lending) • Self-service and AMH infrastructure • Electronic Resource Management • PC Scheduling and print management • Event scheduling • Digital Collections Management platforms (CONTENTdm, DigiTool, etc.) • Discovery-layer services for broader access to library collections • No effective integration services / interoperability among disconnected systems, non-aligned metadata schemes

17. Reconceptualization of Automation • Current organization of functionality based on past assumptions • Possible new organizing principles • Fulfillment = Circulation + ILL + DCB + e-commerce • Resource management = Cataloging + Acquisitions + Serials + ERM • Customer Relationship Management = Reference + Circulation + ILL (public services) • Enterprise Resource Planning = Acquisitions + Collection Development

18. Academic Libraries need a new model of library management • Not an Integrated Library System or Library Management System • The ILSwas designed to help libraries manage print collections • Generally did not evolve to manage electronic collections • Other library automation products evolved: • Electronic Resource Management Systems – OpenURL Link Resolvers – Digital Library Management Systems -- Institutional Repositories

19. Policies $$$ Funds BIB Vendor Holding / Items CircTransact User Integrated (for print) Library System Public Interfaces: Staff Interfaces: Interfaces Circulation Cataloging Acquisitions Serials OnlineCatalog BusinessLogic DataStores

20. Policies LicenseTerms BIB Vendors Holding / Items CircTransact User Vendor E-JournalTitles $$$ Funds LMS / ERM: Fragmented Model Public Interfaces: Staff Interfaces: ` Application Programming Interfaces Circulation Cataloging Acquisitions Serials OnlineCatalog E-resourceProcurement LicenseManagement Protocols: CORE

21. BIB Holding / Items CircTransact User Vendor Policies $$$ Funds Informal management of Electronic Resources Public Interfaces: Staff Interfaces: Budget License Terms Application Programming Interfaces Circulation Cataloging Acquisitions Serials OnlineCatalog Titles / Holdings Vendors Access Details

22. Comprehensive Resource Management • No longer sensible to use different software platforms for managing different types of library materials • ILS + ERM + OpenURL Resolver + Digital Asset management, etc. very inefficient model • Flexible platform capable of managing multiple type of library materials, multiple metadata formats, with appropriate workflows • Support for management of metadata in bulk • Continuous lifecycle chain initiated before publication

23. Library Services Platform • Library-specific software. Designed to help libraries automate their internal operations, manage collections, fulfillment requests, and deliver services • Services • Service oriented architecture • Exposes Web services and other API’s • Facilitates the services libraries offer to their users • Platform • General infrastructure for library automation • Consistent with the concept of Platform as a Service • Library programmers address the APIs of the platform to extend functionality, create connections with other systems, dynamically interact with data

24. Library Services Platform Characteristics • Highly Shared data models • Knowledgebase architecture • Some may take hybrid approach to accommodate local data stores • Delivered through software as a service • Multi-tenant • Unified workflows across formats and media • Flexible metadata management • MARC – Dublin Core – VRA – MODS – ONIX • Bibframe • New structures not yet invented • Open APIs for extensibility and interoperability

25. New Library Management Model Unified Presentation Layer Search: Self-Check /Automated Return Library Services Platform ` Digital Coll Consolidated index Search Engine Discovery Service ProQuest API Layer StockManagement EBSCO … Enterprise ResourcePlanning Smart Cad / Payment systems JSTOR LearningManagement AuthenticationService Other Resources

26. Open Systems • Achieving openness has risen as the key driver behind library technology strategies • Libraries need to do more with their data • Ability to improve customer experience and operational efficiencies • Demand for Interoperability • Open source – full access to internal program of the application • Open API’s – expose programmatic interfaces to data and functionality

27. Moving legacy systems to hosted services provides some savings to individual institutions but does not result in dramatic transformation Globally shared data and metadata models have the potential to achieve new levels of operational efficiencies and more powerful discovery and automation scenarios that improve the position of libraries overall. Leveraging the Cloud

28. Changing models of Resource Sharing

29. Integrated Library System Branch 6 Branch 5 Branch 4 Branch 8 Branch 2 Branch 1 Branch 7 Branch 3 Main Facility Search: Holdings Patrons useCirculation featuresto request itemsfrom other branches Model: Multi-branchIndependentLibrary System Floating Collectionsmay reduce workload for Inter-branchtransfers BibliographicDatabase Library System

30. Library Consortia • Groups of libraries want to work together to share an automation system • Number of participants limited by the perceived capacities of the automation system

31. Shared Infrastructure • Common discovery • Retention of local automation systems • Technical complex with moderate operational benefits • Common discovery + Resource Management Systems • Shared Resource management with local discovery options

32. Shared Consortial ILS Library 6 Library 1 Library 8 Library 7 Library 10 Library 4 Library 3 Library 2 Library 9 Library 5 Search: Holdings ILS configured To support Direct consortial Borrowing throughCirculation Module Model: Multipleindependentlibraries in a Consortium Share an ILS BibliographicDatabase Shared Consortia System

33. Progressive consolidation of library services • Centralization of technical infrastructure of multiple libraries within a campus • Resource sharing support • Direct borrowing among partner institutions • Shared infrastructure between institutions • Examples: 2CUL (Columbia University / Cornell University) • Orbis Cascade Alliance (37 independent colleges and universities to merge into shared LSP)

34. 2CUL Collection Development Shared Services: Technical Services Shared Infrastructure?:

35. Orbis Cascade Alliance • 37 Academic Libraries • Combined enrollment of 258,000 • 9 million titles • 1997: implemented dual INN-Reach systems • Orbis and Cascade consortia merged in 2003 • Currently working on implementation of shared system

36. The Evolution of Library Resource Discovery

37. Challenge: More integrated approach to information and service delivery • Library Web sites offer a menu of unconnected silos: • Books: Library OPAC (ILS online catalog module) • Search the Web site • Articles: Aggregated content products, e-journal collections • OpenURL linking services • E-journal finding aids (Often managed by link resolver) • Subject guides (e.g. SpringshareLibGuides) • Local digital collections • ETDs, photos, rich media collections • Metasearch engines • Discovery Services – often just another choice among many • All searched separately

38. ILS Data Online Catalog Search: Scope of Search • Books, Journals, and Media at the Title Level • Not in scope: • Articles • Book Chapters • Digital objects • Web site content • Etc. Search Results

39. Next-gen Catalogs or Discovery Interface (2002-2009) • Single search box • Query tools • Did you mean • Type-ahead • Relevance ranked results (for some content sources) • Faceted navigation • Enhanced visual displays • Cover art • Summaries, reviews, • Recommendation services

40. Next-gen Catalogs or Discovery Interface • Single search box • Query tools • Did you mean • Type-ahead • Relevance ranked results • Faceted navigation • Enhanced visual displays • Cover art • Summaries, reviews, • Recommendation services • Scope of Search • Books, Journals, and Media at the Title Level • Other local and open access content • Not in scope: • Articles • Book Chapters • Digital objects

41. Discovery Interface search model ILS Data Digital Collections Search: Local Index ProQuest Search Results EBSCOhost Metasearch Engine … MLA Bibliography ABC-CLIO Real-time query and responses

42. Discovery from Local to Web-scale • Initial products focused on technology • Mostly locally-installed software • Current phase is focused on pre-populated indexes that aim to deliver Web-scale discovery

43. Web-scale Index-based Discovery ILS Data (2009- present) Digital Collections Search: Web Site Content Institutional Repositories Search Results Aggregated Content packages Consolidated Index Profile of Library Subscriptions Open Access … E-Journals CustomerProfile Usage-generatedData Reference Sources Pre-built harvesting and indexing

44. Bento Box Discovery Model Aggregated Content packages Search: Open Access ILS Data VuFind / Blacklight E-Journals Consolidated Index Search Results Web Site Content Digital Collections Institutional Repositories Pre-built harvesting and indexing

45. Web-scale Search Problem ILS Data Digital Collections Search: Web Site Content Institutional Repositories Consolidated Index Aggregated Content packages Search Results … E-Journals Pre-built harvesting and indexing ??? Non Participating Content Sources Problem in how to deal with resources not provided to ingest into consolidated index

46. Challenge for Relevancy • Technically feasible to index hundreds of millions or billions of records through Lucene or SOLR • Difficult to order records in ways that make sense • Many fairly equivalent candidates returned for any given query • Must rely on use-based and social factors to improve relevancy rankings

47. Evaluating Index-based Discovery Services • Intense competition: how well the index covers the body of scholarly content stands as a key differentiator • Difficult to evaluate based on numbers of items indexed alone. • Important to ascertain now your library’s content packages are represented by the discovery service. • Important to know what items are indexed by citation and which are full text • Important to know whether the discovery service favors the content of any given publisher

48. A&I Content in Discovery Services • Will discovery services eventually become powerful enough to displace need for abstracting and indexing services? • Specialized vocabulary and other metadata make positive contributions to the discovery process • Specialized and scoped search methodologies • Researchers value this tools

49. Challenge for Relevancy • Technically feasible to index hundreds of millions or billions of records through Lucene or SOLR • Difficult to order records in ways that make sense • Many fairly equivalent candidates returned for any given query • Must rely on use-based and social factors to improve relevancy rankings • Objectivity: Does relevancy reflect bias or publisher preferences

50. Socially-powered discovery • Leverage use data to increase effectiveness of discovery • Usage data can identify important or popular materials to inform relevancy engines • Identify related materials that may not otherwise be uncovered through keyword matching • Be careful to avoid introducing bias loops