1 / 15

Trends & Challenges in Digital Object Storage Infrastructure:

Learn about the collaborative effort of the NDSA to preserve a national digital collection for future generations. Explore current storage practices, access requirements, system functionalities, and challenges in digital preservation infrastructure.

jimenezp
Download Presentation

Trends & Challenges in Digital Object Storage Infrastructure:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Trends & Challenges in Digital Object Storage Infrastructure: Notes from the National Digital Stewardship Alliance (NDSA) Infrastructure Working Group Storage Survey MDOR Roundtable SAA Annual Meeting Wednesday, August 8, 2012 On behalf of the NDSA: Nancy McGovern, MIT Libraries Jefferson Bailey, Library of Congress

  2. Objective: • A collaborative effort among government agencies, educational institutions, non-profit organizations, and business entities to preserve a distributed national digital collection for the benefit of citizens now and in the future. • Membership: • 127 member organizations have joined the NDSA since it was founded in July 2010 • An initiative of the National Digital Information Infrastructure and Preservation Program (NDIIPP) open to any organization committed to the preservation of digital cultural heritage • http://www.digitalpreservation.gov/ndsa

  3. Working Groups NDSA members commit to participating in one of the five working groups of the Alliance Standards & Practices Content Infrastructure Innovation Outreach Infrastructure Working Group: Working to identify and share emerging practices around the development and maintenance of tools and systems for curation and preservation.

  4. NDSA Infrastructure Storage Survey • Goal: • Obtain a snapshot of current digital object storage practices within NDSA membership • Details: • Conducted between August and November 2011 • 58 responses from the (then) 74 NDSA members actively preserving digital content • Results: • Published in parts via the NDIIPP blog, The Signal http://blogs.loc.gov/digitalpreservation/ • Full report forthcoming

  5. Scope • The Storage Survey examined activities around 4 topics associated with digital preservation infrastructure: • Access – How do access requirements impact digital preservation infrastructure? • Distribution – How are institutions using cloud and distributed storage systems for preservation? • Fixity – How are institutions ensuring file fixity? • Administration – How are institutions currently ensuring and strategically planning for digital preservation storage infrastructure.

  6. Access: Modes of Access Percentage of NDSA Orgs Supporting Each Access Mode

  7. Access: Requirements & Systems SYSTEMS: 65% (37 of 58) reported providing separate systems for storage and access 35% (20 of 58) reported using the same system for storage and access REQUIREMENTS: 53% (31 of 58) reported having a single access requirement (e.g. on-line availability) for all the collections they are preserving. 33% (19 of 58) reported supporting two degrees of access requirements among their collections 14% (8 of 58) reported supporting three or more degrees of access among their collections.

  8. Distribution: Cooperative, Contract & Cloud Storage

  9. Distribution: Geographic & System Preferences • Priorities for storage system functionality: • More built-in functions like fixity checking • More automated inventory and retrieval • More storage space • Higher performance processing (tasks such as indexing)

  10. File Fixity: Current Practices

  11. File Fixity: Frequency of Checking

  12. Administration: Replication & Media

  13. Administration: Forecasting Storage

  14. Challenges • Access: • Supporting multiple modes of access can require customization of the preservation stack • Access modes largely “conditional” thus requiring tailored workflows • Distribution: • Cloud-storage emerging, but feature-poor • Greater automated features desired in future storage systems • Fixity: • Validation can be processing & I/O intensive • Multiple storage media types can complicate checking • Best practices for frequency of checking are unclear • Administration: • Cost of file and media redundancy • Results showed a bottom-up approach to storage, as opposed to the TRAC top-down approach, though over 60% planned on eventual TRAC compliance • Systems migrations still difficult, expensive

  15. More information about the Alliance is at www.digitalpreservation.gov/ndsa/ Standards & Practices Content Infrastructure Innovation Outreach Read about NDSA work on The Signal blogs.loc.gov/digitalpreservation/ Nancy McGovern, MIT Libraries Jefferson Bailey, Library of Congress THANKS!

More Related