1 / 8

Robust Tools for Archiving and Preserving Digital Data

This paper discusses the Transcontinental Persistent Archive Prototype (TPAP) and the ADAPT approach to digital archiving and preservation technology, highlighting the scalable and platform-independent tools developed and tested on TPAP. Additional technologies such as PAWN, ACE, and TPAP Replication Monitoring are also described.

fredericklindsay
Download Presentation

Robust Tools for Archiving and Preserving Digital Data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of Electrical and Computer Engineering University of Maryland, College Park

  2. Transcontinental Persistent Archive Prototype (TPAP) – ERA Project • Partnership between NARA, San Diego Supercomputer Center, and the University of Maryland. • A distributed testbed built on a set of heterogeneous grid bricks linked by the SRB data grid technology. • Our contributions: scalable, platform-independent tools and technologies tested and evaluated over TPAP.

  3. ADAPT – Approach to Digital Archiving and Preservation Technology • Layered digital object architecture and a set of modular tools built using open standards and web technologies. • Can easily accommodate emerging standards and policies. • will evolve gracefully as the underlying technologies change. • Evaluation and demonstration of tools on widely different collections.

  4. Monitoring and Preservation Services a t a d Metadata Management a t e M Administrative Preservation Descriptive Metadata Metadata Metadata Ingestion Workflow PAWN Search Access Data Management a t a D Deep Archive Data Grid Digital Library Storage Storage Storage Software Developed and Tested on TPAP:

  5. PAWN – Producer Archive Workflow Network • Software that provides a flexible and customizable ingestion framework • Handles the process in a reliable and secure fashion: • From package assembly • To archival storage • Simple interface for end-users • Flexible interface for archive managers • Designed for use in multiple contexts

  6. ACE – Auditing Control Environment • Software to ensure the long term integrity of digital objects. • Underpinnings are based on rigorous cryptographic techniques. • Automatic regular audits based on policies set by the archive manager. • Scalable, cost-effective, and can interoperate with any archiving architecture.

  7. TPAP Replication Monitoring • Portal that provides overview of a collection status over SRB zones. • Ensures that new objects are replicated to relevant sites. • Tracks files at master locations and periodically copy new files to replica sites. • Log actions on a collection and errors during replication

  8. Other Technologies • PAWN – Related: • APIs for different packaging technologies (METS and XFDU). • ICDL Book Builder – Interface to enable bulk ingestion of digital objects already managed by a database. • FOCUS (FOrmat CUration Service): a scalable, and secure registry for persistent information and services applied to formats.

More Related