1 / 20

Managing Digital Storage

Managing Digital Storage. Sexto Seminario Internacional de Archivos Sonoros y Audiovisuales JUEVES 26 DE JUNIO DE 2014 MESA 6: El almacenamiento digital Richard Wright. 2006: EBU Tech Review. " holographic media could provide a long-awaited solution for broadcast archives". .

komala
Download Presentation

Managing Digital Storage

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Managing Digital Storage SextoSeminarioInternacional de ArchivosSonoros y Audiovisuales JUEVES 26 DE JUNIO DE 2014 MESA 6: El almacenamiento digital Richard Wright

  2. 2006: EBU Tech Review • "holographic media couldprovide a long-awaitedsolutionforbroadcast archives"

  3. ... • "Archive customersrequirenotonlystable and long-lived media with a minimum 50-year archive life, butalsorequireextremelyhighlevels of equipmentreliability and thesamemulti-generationbackwardreadcompatibilityofferedby tape. Random-access performance thatallowsrapidaccesstotheir data isanothercriticalneed."

  4. 2006: EBU Tech Review persistence – we want to get back what we put in; currency – we want to be able to use what we get back.

  5. What’s an archive? • The Archivists definition of Archive • Where data lives: a repository, ready and waiting to be accessed. • Where data lives: the archive is the application. The user of the archive expects to get to data within seconds, just like for any other application. However, the user of an audiovisual archive may be willing to wait longer for delivery of full-quality video and audio. • An archive is the place where people go to get archive content. • An archive is the application.

  6. Archive Requirements • Archive service requirements– what archives do for others; • Archive functional storage requirements– what archives want from storage; • Storage service requirements– technical requirements (size, speed, uptime ...); • Storage media requirements– how storage operates.

  7. Archive service requirements • Acquisition • Documentation • Access • Re-Use • Asset management, life-cycle management

  8. Digital Archives solve: • contention for the one tape that everybody wants at the same time; • circulation control; • chasing returns; • making extra copies; • getting material to distant places, quickly.

  9. Archive functionalstorage requirements • Persistence– the ability to get content out of storage; • Currency– the ability to use that content.

  10. Storage Service requirements • Size of the storage • Bandwidth of the access to the storage • Reliability: • Of the service (uptime) • Of the storage (failures)

  11. Storage Media requirements • Not interested ! • (which is why I wrote the paper, because I didn’t think holographic storage was ‘a long-awaited solution for broadcast archives’ [holographic storage never became a commercial product anyway]

  12. 2006: ancient history? Digitising Contemporary Art D6.2 Best practices for a digital storage infrastructure for the long-term preservation of digital files Henriksen, Seuskens, Wijers (LIMA) May, 2013 http://www.dca-project.eu/images/uploads/banners/DCA_D62_Best_practices_for_a_digital_storage_infrastructure_20130506_Version1.pdf

  13. What are the choices? • 3. Data tapes ................................................................................................... 9 • 3.1 LTO (Linear Tape Open) .............................................................................. 9 • 3.2 Autoloaders / tape libraries ...................................................................... 11 • 3.3 Preservation issues .................................................................................... 12 • 4. Hard disk drives ........................................................................................... 14 • 4.1 Connecting an external HDD ...................................................................... 14 • 4.2 SCSI and SATA technology recommended .................................................. 15 • 4.3 Server systems ............................................................................................ 15 • 4.4 Preservation issues ..................................................................................... 17 • 5. Solid State Drives ........................................................................................... 19 • 5.1 Single-Level Cell Flash recommended ......................................................... 19 • 5.2 Preservation issues ...................................................................................... 20 • 6. Optical disks ................................................................................................... 21 • 6.1 Blu-ray .......................................................................................................... 21 • 6.2 Preservation issues ...................................................................................... 21 • 7. Cloud storage ..

  14. What are the problems? • Media lifetime • Player lifetime • General technology ‘stack’ lifetime • Bit rot during storage • Errors when content is being moved • Changes when content is processed • ALL digital technology has these problems DREAM: a static situation where things last REALITY: continuous change of technology; continuous need to use content

  15. Survival need maintenance • Multiple copies • Fixity information (“checksums”) • Checking the files are correct • Checking the files are usable • Migration to maintain usability • Keep up with technology changes • Keep up with user requirement changes

  16. PrestoCentre models • For file checking • For file migration

  17. PrestoPRIME storage tool • Professional level • Requires knowledge of unit cost and reliability of storage devices • Allows prediction of total cost and total liklihood of loss, for various storage and backup systems • And for various amount s of file checking http://prestoprime.it-innovation.soton.ac.uk/

  18. Migration of File Formats ONCE ONLY!!!

  19. Migration with Emulation ONCE ONLY!!!

  20. Thank you Preservation Guide preservationguide.co.uk PrestoCentre prestocentre.eu Richard Wright preservation.guide@gmail.com

More Related