DODL, Digitization, & Digital Repositories Developments Driving 21 st -century Librarianship

1. DODL, Digitization, &Digital RepositoriesDevelopments Driving 21st-century Librarianship Michael A. Keller Stanford University Berlin, Amerika Haus 040430

2. A DODL is a • DISTRIBUTED • OPEN • DIGITAL • LIBRARY

3. Digital Library FederationMission Statement 950501 • The Digital Library Federation’s mission is to bring together--from across the nation and beyond - digitized materials that will be made accessible to students, scholars, and citizens everywhere, and that document the building and dynamics of America's heritage and cultures.

4. DLF Goal 1 • The implementation of a distributed, open digital library conforming to the overall theme and accessible across the global Internet. This library shall consist of collections - expanding over time in number and scope - to be created from the conversion to digital form of documents contained in our and other libraries and archives, and from the incorporation of holdings already in electronic form.

5. DLF Goal 2 • The establishment of a collaborative management structure to coordinate and guide the implementation and ongoing maintenance of the digital library; to set policy regarding participation, funding, development and access; to encourage and facilitate broad involvement; and to address issues of policy and practice that may inhibit full citizen access.

6. DLF Developments • Founded Spring 1995 – 8 or 9 original members, no ~35 • Charge to “Technical Committee” • Technical Committee identifies tasks • Don Waters, Dan Greenstein, & David Seaman – executive directors • DLF Forums (1997 – a few dozen attending, short agenda) • DLF Forums today (150 attending, expansive agenda)

7. OAI METS E-resources management Registry of digital masters (through OCLC) Global digital formats registry Benchmarks for digital reproductions Archivists Workbench Digital Camera operators Interest Group Fedora Developers Forum Various publications & reports DLF Forums DLF Projects

8. Vision for 2013 Readers and researchers, students and teachers around the world search for words and phrases using Internet engines that perform federated and broadcast searches on multiple virtual memories. More than 15,000,000 books have been digitized and conversion completed of the backsets of virtually all scholarly journals. Government documents going back to the 18th-century have been converted to digital form as well. All of these texts are available as page images, and for most of them, there are versions coded using XML are available for searching. All books, journals, and other documents published since the turn of the 21st-century are available in digital form as well. Words, phrases, and even concepts can be searched in the virtual global collection as a result.

9. Contributing to the Vision • Plethora of born digital objects for research & teaching • Internet publishing • Many digitization projects • Widely distributed • Robots, improved work flow, & better conversion software; mass digitization capacity • Demand from professoriate

10. Distributed, Open Digital Library • Distributed • Lots of collections in lots of institutions • National, global • Service layers • Finding system • Open • Available to DLF, allies, partner institutional communities • DRM issues

11. Finding System – Federated Discovery & Navigation across many silos • Initial stage: Consolidation & expansion of OAI harvesting efforts • Development of more extensive finding system • Specfications based on best current practices • Prototyping • R&D work (NSF support?) • Iterative development & deployment

12. Finding System Ideas • Metadata • Full text • Taxonomic • Image analysis (?) • GUI navigation (?) • Alerting functions • Ontologies

13. Service Layers • Authentication • Authorization • Finding System • Digital Object Xfer • Specialized Searches • Extraction • Analysis • Preference ratings

14. Parallel Efforts • NSDL • TEL • Numerous institutional solos • Biblioteca Universalis • Biblioteca Alexandrina

15. Digitization • Cottage industry efforts widespread; • Book digitization robots available & effective • Conversion software gradually improving • Mass digitization possible • Industry partners • I.p. regime issues; must satisfy I.P. owners & authors • Church & state issues

16. Consequences of Mass Digitization • Improved penetration of texts for research & study • New opportunities for cultural custodianship • Leveling playing fields for smaller institutions & for developing world • Improved opportunities for marketing I.p. • Bootstraping society at large • New opportunities for managing assets, improving services

17. Imagine • Keyword and other simple searching across millions of books and subsets • Taxonomic searching • New wine from old bottles • More refined and subtle scholarship & teaching • More personal and continuous learning

18. Digital Repositories • Required to save cultural objects born digital • Required to save research products born digital • Required to continue & expand the benefits of the Information Age • Must be effective & efficient • Must be trusted and credible across long stretches of time

19. Repository Requirements • Effective functions (ingest, storage, retrieval, migration) • Nuanced digital rights management • Adaptation to changing I.T. conditions (operating systems, hardware, applications, data formats evolve rapidly) • Redundant operations and storage • Effective access

20. Projects • NDIIPP led by Library of Congress • UK national scheme led by British Library • The Netherlands KB • Mellon E-archive • Stanford Digital Repository & LOCKSS • Internet Archive (Internet Midden) • California Digital Library

21. Business Requirements • Self-sustenance or reliable funding otherwise • Transparent standards (operating, access, data & metadata) • Demonstrated fulfillment of functional requirements, first by simulation, then by experience • Peer review & external audits

22. Speculative Synergy • New R&D • Information retrieval • Use of information • Information & knowledge management • Requires new methods for achieving traditional library functions • Returned emphasis on service to readers • New possibilities for cultural custodianship

23. Finis, Terre

25. Next Steps • Appoint DODL Officer in DLF • Raise Money • Appoint Collections Development Working Group • Appoint “Technical Working Group” • A few institutions ready to learn by doing • Pioneers, adventurers, experimentalists

26. DODL working groups • The first working group is charged with strategic planning for content development (component 1), both the pooling of existing content, and the development of systemic collection development. • The second working group will focus on the technology and enabling infrastructure that will support DODL and plan for its extension and deepening of sharing (components 2 and 3). • Working together, the working groups will define the finding system.

27. Schedule NOW!

28. DODL Decision • DLF 5 year review completed 2001 • Strategic Planning session of Steering Committee February 2003 • “Research libraries & services offered in 2013” – March 2003 • Martha Brogan report Digital Library Aggregation Services • Appointment of DODL initiatives committee: Wendy Lougee, Carol Mandel, Dan Greenstein, Winston Tabb, MAK, David Seaman • Steering Committee accepts strategic plan for DODL October 2003

29. DLF Goal 3 • The development of a coordinated funding strategy that addresses the need for support from both public and private sources to provide the means to launch initiatives at our and other institutions.

30. DLF Goal 4 • The formation of selection guidelines that will ensure conformance to the general theme, while remaining sufficiently flexible and open-ended to accommodate local initiatives and projects; and to ensure that the digital library comprises a significant and large corpus of materials

31. DLF Goal 5 • The adoption of common standards and best practices to ensure full informational capture; to guarantee universal accessibility and interchangeability; to simplify retrieval and navigation; and to facilitate archivability and enduring access.

32. DLF Goal 6 • The involvement of leaders in government, education, and the private sector to address issues of network policy and practice that may inhibit full citizen access

33. DLF Goal 7 • The establishment of an ongoing and comprehensive evaluation program to study: --how scholars and other researchers, students of all levels, and citizens everywhere make use of the digital library for research, learning, discovery, and collaboration; --how such usage compares with that of traditional libraries and other sources of information; --how digital libraries affect the mission, economics, staffing, and organization of libraries and other institutions; and --how to design systems to encourage access by individuals representing a broad spectrum of interests.

34. Standing on the shoulders of giants

35. Night & Day – pre-history Waxing/Waning Moons Noting the Seasons Numeracy Sundials Candles, water clocks 1285 1st mechanical clock 1762 Chonometer …watches 2003 Complicated watches Digital Watches Atomic clocks/watches Self-winding, solar powered watches USB memory watches GPS watches Dick Tracy Watches Mickey Mouse Watches Telling time…a parable

36. Arts, crafts, science & engineering • Simple mechanics • Metallurgy • Metallurgical arts & crafts • Glass and gem arts & crafts • Leather • Radio broadcasting • Electrical engineering • Etc etc etc

37. Thus it has been with our DODL BUILDING ON THE ACCOMPLISHMENTS Of our professions & Of the DLF members