1 / 16

Adding Metadata and Ingesting Large Born-Digital Archives with Archivematica

Adding Metadata and Ingesting Large Born-Digital Archives with Archivematica. Dina Sokolova and Jane Gorjevsky Columbia University. Archives of the Ford Foundation International Fellowships Program. Large-scale project funded by the Ford Foundation grant Key goals:

Rita
Download Presentation

Adding Metadata and Ingesting Large Born-Digital Archives with Archivematica

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Adding Metadata and Ingesting Large Born-Digital Archives with Archivematica Dina Sokolova and Jane Gorjevsky Columbia University

  2. Archives of the Ford Foundation International Fellowships Program • Large-scale project funded by the Ford Foundation grant • Key goals: • Permanently preserve IFP paper and electronic records • Provide access to IFP digital archives based on three types of user access: • publicly accessible • viewable onsite only • embargoed until 2075

  3. International Fellowships Program Overview • Program was active in 2001 – 2013 • Program offered fellowships for post-graduate study to social justice leaders from underserved communities in Asia, Africa, Latin America, Russia, and the Middle East

  4. Scope of Materials • 3.6 TB of electronic materials, received from 22 International partner organizations, New York Secretariat and CHEPS (Center for Higher Education Policy Studies): • Planning and administrative documents • Audiovisual materials • Databases • Email correspondence • Website content • Academic and personal records of fellows • Surveys, interviews and statistical reports • Datasets

  5. Challenges • About 350,000 files in 245 formats, 10 languages, 7 non-roman character sets • Filenames and directory paths as the only source of descriptive metadata • Long filenames/file paths (> 260 characters) • Multiple languages and non-Roman character sets: Original: Горбачев-Не хочу сдаваться.doc Normalized: __________ - _________ _________________.doc • Appraisal and Selection • Privacy and confidentiality concerns

  6. Preparing Content for SIPs • Submission Information Packages (SIPs) for each office are based on access restrictions (Unrestricted, Onsite, Restricted) • Content preparation: • Converting email from multiple formats (eml, mbx, msg, pst, sbd, Pegasus mail) to MBOX • Converting Microsoft Access databases to XML format • Outsourcing conversion of content of commercially produced video DVDs, audio CDs, and mini DV-tapes to preservation formats • Extracting data from ZIP and RAR archives • Establishing SIP size

  7. Archivematica • OAIS-compliant digital preservation system

  8. Archivematica at CUL • Dedicated Ubuntu virtual machine on CUL server with mounted network storage

  9. Submission Information Packages • Assign unique IDs • Verify content integrity • Perform virus check • Clean up filenames • Perform file format identification • Extract metadata • Generate METS.xml file

  10. Rights Metadata PREMIS rights at the SIP level

  11. Descriptive Metadata Dublin Core metadata at the SIP level

  12. Archival Information Packages • Normalize objects for preservation • Populate METS.xml file • Create and store AIP

  13. Filename Normalization Original Normalized

  14. Descriptive Metadata in METS • Original filenames are retained in METS file

  15. Storing AIPs • AIPs in Bagit format are ingested into Preservation Repository

  16. Thank you! Contact us:ds2057@columbia.edujg2138@columbia.edu

More Related