Digital archives from a (national) library’s perspective

1. Digital archives from a (national) library’s perspective Hans Jansen Director e-Strategy National library of the Netherlands New York, 3 September 2008

2. Digital archives

3. Digital archives Koninklijke Bibliotheek: facts and figures • medium sized national library • founded in 1798 • 3 million paper volumes • 12 million electronic items • annual budget M€ 42 • budget for projects M€ 40 • staff 350 (260 fte) • deposit library since 1974 • www.kb.nl

4. Digital archives

5. Digital archives European Project Partners 45 European national libraries - Bayerische Staatsbibliothek - Istituto Centrale per il-atalogo Unico, Italy (ICCU) -Eremo srl, Italy - Conference of European National Librarians (CENL) - Consortium of European Research Libraries - The International Association of Sound and Audiovisual Archives (IASA) - Association des Cinémathèques Européennes (ACE) - MENON, a European innovation and research network (België) - Helsinki University - Universität Innsbruck - Staats- und Universitätsbibliothek Göttingen - University of BathUKOLN - University of Salford - The State & University Library, Denmark - University of Cologne - University of Athens - University of Bielefeld - University of Freiburg - University of Warsaw, Interdisciplinary Centre for Mathematical and Computational Modelling - University Library Ghent - Goettingen State and University Library - University of Nottingham, Information Services - Humanities Advanced Technology and Information Institute (HATII) at the University of Glasgow - Vienna University of Technology - Uppsala University (Zweden) - Systems/National Technical University of Athens - The National Archive Service (Finland) - Bundesarchiv (Duitsland) - Landesarchiv Baden-Württemberg - National Archives of Sweden - Librairies and Archives Council (MLA) (Engeland) - The UK National Archives - The Swiss Federal Archives (BAR) - National Board of Antiquities (Finland) - Deutsches Museum - Senckenbergische Naturforschende Gesellschaft - Stiftung Preussischer Kulturbesitz - The Neumann House (Hongarije) - Regione Emilia-Romagna (Ibacn) - AcrossLimits (Malta) - Ministry of Culture of the Czech Republic - Ministry of Culture and Communication (Frankrijk) - Hellenic Ministry of Culture - Hungarian Ministry of Cultural Heritage - Ministry of Informatics and Communications (Hongarije)- Ministry for Cultural Heritage and Activities - Heritage Malta, the national agency of the Government of Malta - Ministry of interior and administration (Polen) - International Centre for Information Management Systems and Services (ICIMSS) (Polen) - Seretariat-General of the Ministry of Culture (Portugal) - Institute of Communication and Computer - Amitié, research centre (Italie) - Dédale, French research and production agency - ABBYY Production - IBM Israel, IBM Netherlands – Science and Technology Ltd - National Centre for Scientific Research "Demokritos" - Centrum für Informations- und Sprachverarbeitung, University of Munich - Austrian Research Centre Seibersdorf (ARCS) - Microsoft Research Limited - Tessella Support Services plc - The European Science Foundation (ESF) - European Space Agency (ESA)- CERN , the European Organization for Nuclear Research - Max Planck Gesellschaft - Centre National d'Etudes Spatiales - Science and Technology Facilities Council - Joint Information Systems Committee - International Association of Scientific, Technical and Medical Publishers - Centre Informatique National de l'Enseignement Superieur - Digital Preservation Coalition (UK) - NESTOR German Network of expertise in Digitallong-term preservation - Perennisation des Informations Numeriques – DigitalPreservationEurope (DPE) - Istituto di Scienza e Tecnologie dell'Informazione "A. FAEDO" (ISTI) Italian National Research Council (CNR)

6. Digital archives Koninklijke Bibliotheek: focus on digital • process born digital documents • digitize paper documents • preserve digital and digitized documents • create integrated access to digital, digitized and paper documents • share our data!

7. Digital archives which content streams do we have? (Master) files from digitized collections: Newspapers (8m pages, 2007-2010) Parliamentary papers (2,5m pages, 2006-2010) Books (1,3m pages 2008-2009) Microfilms (15m pages, 2009-2010) Images (400.000, 2001-2008) Deposited born digital publications: 11m international eJournal articles + 500.000 per year international eBooks (from 2009: thousands and growing?) 1500 Dutch websites (up to 4-5.000 in 2010) national voluntary deposit (‘donations’) And still some paper objects… 45.000 deposited items per year (national output higher than ever)

8. Digital archives which content streams do we have? Digitized collections

9. Digital archives digital library (or archive) Challenge: design, develop and implement a secure, reliable and scalable management system for the library’s digital content assets. Result: a system that can manage ingest, storage, long-term preservation, discovery of and controlled access to the library’s digital content assets.

10. Digital archives KB’s digital library • system components • resource discovery & access • preservation • people

11. Digital archives which system do we have? (1) e-Depot: long-term archive • developed with and by IBM (DIAS) • operational since 2003 • based on OAIS reference model • storage and preservation (in development)

12. Digital archives which system do we have? (2) e-Depot • ingest of digital content (characterization, validation, checks …): complicated ! • storage (70 Tb to 500 Tb in 2010): lots of data! • metadata (descriptive, structural, preservation, …) in external database: choices to be made ! • capable of handling preservation treatments (migration/emulation) : where are the tools?

13. Digital archives resource discovery and access (KB) Descriptive metadata will give the user access to the digital and digitised content (and the paper collections) OPAC (OCLC-Pica): access to KB paper collections Metalib (Ex Libris): access to digital materials (including licensed materials) KB Search: access to all metadata and content from digital/digitised collections; based on new data- architecture Deposited materials: restricted access on-site, unless open access

14. Digital archives resource discovery and access (Europe) The European Library (TEL): access to collections from 32 out of 48 national libraries in Europe (150 million titles) www.theeuropeanlibrary.org CENL Foundation Europeana: access to digital collections from libraries, museum, (audio-visual) archives in Europe Prototype: November 2008 (2 million objects) Demo version: www.europeana.eu European Digital Library Foundation > 100 partners; EC subsidy >M€ 25

15. Digital archives preservation (1) Focus on object (migration) Focus on environment (emulation) EU project Planets (www.planets-project.eu): • Preservation planning • Preservation characterization • Preservation actions • Interoperability framework • Testbed

16. Digital archives people Three teams are at work: Processing: part of acquisition and cataloguing division, ‘owner of the system’ Research: part of R&D division, preservation solutions IT: technical maintenance, outsourcing Plus: Strategies: Digital Library Programme Board

17. Digital archives people (2)

18. Digital archives Further observations • buy or build? What’s the market situation? • inhouse, share, outsource? • national infrastructure in place? • what to archive for the long-term and what not? • legal task • re-use expected; rescan costs higher than archival costs • original endangered

19. Sailing Letters Digital archives De overrompeling van een VOC-vloot in de Saldanhabaai in 1781. Uitsnede van een schilderij van de Engelsman Thomas Luny (1759-1837), Museum Africa, Johannesburg.

20. Sailing Letters Digital archives

21. Sailing Letters Digital archives

22. Sailing Letters Digital archives

23. Sailing Letters Digital archives

24. Digital archives Thank you !