Overview of the state of library automation: Framing the OLE Initiative

1. Overview of the state of library automation:Framing the OLE Initiative Marshall BreedingDirector for Innovative Technologies and Research Vanderbilt University http://staffweb.library.vanderbilt.edu/breeding http://www.librarytechnology.org/ Tuesday Sept 9, 2008 Duke University

2. Abstract • A brief overview and history of the problem space we are addressing through the OLE Project. • Address to an audience savvy regarding the library automation arena. • Summarize the state of the ILS world, key problems with commercial ILS, etc.

3. Part I. Broad Industry and Product Trends

4. Upheavals • Industry Consolidation • Abrupt transitions for major library automation products • Increased industry control by external financial investors • Demise of the traditional OPAC • Frustration with ILS products and vendors • Open Source alternatives hit the mainstream Breeding, Marshall: Perceptions 2007 an international survey of library automation. http://www.librarytechnology.org/perceptions2007.pl January 2008.

5. LJ Automation System Marketplace • Annual Industry report published in Library Journal • 2008: Opportunity out of turmoil • 2007: An industry redefined • 2006: Reshuffling the deck • 2005: Gradual evolution • 2004: Migration down, innovation up • 2003: The competition heats up • 2002: Capturing the migrating customer

6. Library Automation M&A History

7. Product and Technology Trends • Innovation below expectations • Conventional ILS less tenable • Proliferation of products related to e-content management • New genre of discovery-layer interfaces

8. Web 2.0 / Collaborative Computing • Currently implemented ad hoc • Many libraries putting up blogs, wikis, and fostering engagement in social networking sites • Proliferation of silos with no integration or interoperability with larger library Web presence • Next Gen: Build social and collaborative features into core automation components

9. Part II. A Mandate for Openness

10. Opportunities for Openness • Open Source • Alternative to traditionally licensed software • Open Systems • Software that doesn’t hold data hostage

11. Open Source Alternatives • Explosive interest in Open Source driven by disillusionment with current vendors and near-evangelical promotion of this software licensing model • Beginning to emerge as a practical option • TOC (Total Cost of Ownership) still roughly equal to proprietary commercial model • Still a risky strategy for libraries – traditional licensing also risky

12. A result of industry turmoil • Disruptions and business decisions to narrow options have fueled the open source movement • Benefit to libraries in having additional options • Traditionally licensed and open source ILS alternatives will coexist in the ILS arena

13. Open Source ILS enters the mainstream • Earlier era of pioneering efforts to ILS shifting into one where open source alternatives fall in the mainstream • Off-the-shelf, commercially supported product available • Still a minority player, but gaining ground

14. Open Source ILS options • Koha • Commercial support from LibLime • Evergreen • Commercial support from Equinox Software • OPALS • Commercial support from Media Flex • NewGenLib • Open Source ILS for the developing world

15. Observations on Open Source ILS • Current Open Source ILS products similar in modular organization and functionality to existing systems. Evolving to achieve the same level of features and capacity present in established commercial systems. • Initial wave of Open Source ILS commitments happened in the public library arena. Recent activity among academic libraries: • WALDO Consortium (Voyager > Koha) • University of Prince Edward Island (Unicorn > Evergreen) • Do the current open source ILS products provide a new model of automation, or an open source version of what we already have? • JISC – SCONUL study did not show strong interest in open source ILS in the UK.

16. Impact of Open Source ILS • Library automation industry cannot be complacent • Some libraries moving from traditionally licensed products to open source products with commercial support plans • Disruption of ILS industry • new pressures on incumbent vendors to deliver more innovation and to satisfy concerns for openness • New competition / More options

17. More Open Systems • Pressure for traditionally licensed products to become more open • APIs (Application Programming Interfaces) let libraries access and manipulate their data outside of delivered software • A comprehensive set of APIs potentially give libraries more flexibility and control in accessing data and services and in extending functionality than having access to the source code. • Customer access to APIs does not involve as much risk to breaking core system functions, avoids issues of version management and code forking associated with open source models.

18. A Continuum of Openness

19. Closed Systems End User Interfaces: No programmable Access to the system. Captive to the user Interfaces supplied by the developer Programmer access: Acquisitions Cataloging Circulation Functional modules: Data Stores: Staff Interfaces:

20. Standard RDBM Systems Database administrators can access data stores involved with the system: Read-only? Read/write? Developer shares database schema End User Interfaces: Programmer access: Acquisitions Cataloging Circulation Functional modules: Data Stores: Staff Interfaces:

21. Open Source Model End User Interfaces: Programmer access: Acquisitions Cataloging Circulation All aspects of the system available to inspection and modification. Functional modules: Data Stores: Staff Interfaces:

22. Open API Model End User Interfaces: Programmer access: Core application closed. Third party developers code against the published APIs or RDBMS tables. Acquisitions Cataloging Circulation Functional modules: Published APIs Data Stores: Staff Interfaces:

23. Open Source / Open API Model End User Interfaces: Programmer access: Core application closed. Third party developers code against the published APIs or RDBMS tables. Acquisitions Cataloging Circulation Functional modules: PublishedAPIs Data Stores: Staff Interfaces:

24. Depth of Openness • Evaluate level of access to a products data stores and functional elements: • Open source vs Traditional licenses • Some traditional vendors have well established API implementations • SirsiDynix Unicorn (API available to authorized customer sites that take training program) • Ex Libris: consistent deployment of APIs in major products, recent strategic initiative: “Open Platform Program” • Innovative Interfaces: Patron API

25. Universal open APIs? • Some progress on API to support discovery layer interfaces, but no comprehensive framework yet. • Many industry protocols work like APIs: • Z39.50, SRU/W, NCIP, OAI-PMH, OpenURL, etd • It would be ideal if there were an open set of APIs that were implemented by all automation system products. • Third party components and add-ons would then work across all products. • DLF ILS-Discovery Interface protocol. Targets interoperability between ILS and new genre of interfaces • AKA: Berkeley Accords

26. Opportunity out of the Upheavals • More options • Commercial + Open Source • More vendors • New open source support companies provide new competition • Traditionally licensed and open source automation systems will co-exist. We have an interest in the success of both alternatives. • More library involvement • Libraries re-energized to make significant contributions to the body of library automation software

27. Part III. Moving toward new generation of library automation

28. Rethinking the ILS • Fundamental assumption: Print + Digital = Hybrid libraries • Traditional ILS model not adequate for hybrid libraries • Libraries currently moving toward surrounding core ILS with additional modules to handle electronic content • New discovery layer interfaces replacing or supplementing ILS OPACS • Working toward a new model of library automation • Monolithic legacy architectures replaced by fabric of SOA applications • Comprehensive Resource Management “It's Time to Break the Mold of the Original ILS” Computers in Libraries Nov/Dec 2007

29. ILS: a legacy concept? • ILS = Integrated Library System (Cataloging + Circulation + OPAC + Serials + Acquisitions) • Focused on print and physical inventory • Electronic content at the Journal Title or collection level • Emerged in the 1960’s – 1970’s • Functionality has evolved and expanded, but basic concepts and modules remain intact • Note: Some companies work toward evolving the ILS to competently handle both print and digital content (e.g. Innovative Interfaces)

30. ILS: ever diminishing role • Many libraries putting much less emphasis on ILS • Just an inventory system for physical materials • Investments in electronic content increasing • Management of e-content handled outside of the ILS • Yet: libraries need comprehensive business automation more than ever. Mandate for more efficient operations. Do more with less.

31. Dis-integration of Library Automation Functionality • ILS -- Print and Physical inventory • OpenURL Link resolver • Federated Search • Electronic Resource Management Module • Discovery layer interface

32. Is non-integrated automation sustainable? • Major burden on library personnel • Serial procurement / installation / configuration / maintenance cycles take many years to result in a comprehensive environment • Inefficient data models • Disjointed interfaces for library users • Very long cycle to gain comprehensive automation

33. New genre of discovery layer interfaces • Traditional ILS OPAC inadequate for today’s Web-savvy library users • Scope too narrow • Complex, non-intuitive interface • Yet: Necessary for some types of research • Working toward a single point of entry for all the content and services offered by the library

34. Common Next-Gen Interface features • Decoupled interface • Advanced search engines • Relevancy ranked results • Faceted Navigation • Graphically enriched displays • Real-time interaction with ILS • Advanced user services and information delivery features

35. Current Products • Aquabrowser (Medialab, Bowker / Serials Solutions) • Primo (Ex Libris) • Encore (Innovative Interfaces) • WorldCat Local (OCLC) • BiblioCommons • Visualizer (VTLS) • eXtensive Catalog (University of Rochester) • VUFind (open source / Villanova University) • Scriblio (open source) http://www.librarytechnology.org/discovery.pl

36. Deep search • Entering post-metadata search era • Increasing opportunities to search the full contents • Google Library Print, Google Publisher, Open Content Alliance, Microsoft Live Book Search, etc. • High-quality metadata will improve search precision • Commercial search providers already offer “search inside the book” • No comprehensive full text search for books quite yet • Beginning to appear in library search environments • U of Mich (http://mblog.lib.umich.edu/blt/archives/2008/05/search_full-tex.html ) • Deep search highly improved by high-quality metadata See: Systems Librarian, May 2008 “Beyond the current generation of next-generation interfaces: deeper search”

37. Architecture and Standards • Need to have an standard approach for connecting new generation interfaces with ILS and other repositories • Proprietary and ad hoc methods currently prevail • Digital Library Federation • ILS-Discovery Interface Group http://www.librarytechnology.org/blog.pl?ThreadID=43 • Initial foray into a broader set of protocols that open up other aspects of the ILS

38. Moving toward a new Generation of Library Automation • Are Legacy ILS concepts sustainable? • New automation environment based on current library realities and modern technology platforms • Equal footing for digital and print • Service oriented architecture

39. Breaking down the modules • Traditional ILS • Cataloging • Circulation • Online Catalog • Acquisitions • Serials control • Reporting • Modern approach: SOA

40. Service Oriented Architecture http://www.sun.com/products/soa/benefits.jsp

41. Legacy ILS + e-content modules End User Interfaces: Federated Search OpenURL Linking Electronic Resource Mgmt System Circulation Acquisitions Functional modules: Cataloging Serials Data Stores: Staff Interfaces:

42. SOA model for business automation • Underlying data repositories • Local or Global • Reusable business services • Composite business applications

43. SOA for library workflow processes Composite Applications Reusable Business Services Granular tasks: Data Stores:

44. Comprehensive Resource Management • Broad conceptual approach that proposes a library automation environment that spans all types of content that comprise library collections. • Traditional ILS vendors: Under development but no public announcements • Open Source projects in early phases • Projection: 2-3 years until we begin see library automation systems that follow this approach. 5-7 years for wider adoption.

45. Open Library Environment (OLE) project • Andrew W. Mellon Foundation • Research in Information Technology program • Solicited proposal / Lead institution • Duke University selected to lead project • Core Participants: Kansas University, Lehigh University, National Library of Australia, Library and Archives Canada, University of Pennsylvania, Marshall Breeding • Advisory Participants: University of Chicago, Wittier College, University of Maryland, ORBIS Cascade Alliance, Rutgers University • Status: Proposal complete, pending formal approval from the Andrew W. Mellon Foundation http://oleproject.org

46. Preparing for next generation library automation • Reassess workflows • Separate streams for print and digital? • Integrated processing of print and digital? • Opportunities to take advantage of SOA-based composite business applications • Assemble a more ideal set of tools for managing serials and periodicals

47. Questions and Discussion