130 likes | 273 Views
Digital Storage Solutions. John Southall ESDS Qualidata, University of Essex Sounds Good Improving Sound Archives i n the East of England 19th November 2007. UKDA: sources of data. Data for research and teaching used in various sectors official agencies - mainly central government
E N D
Digital Storage Solutions John Southall ESDS Qualidata, University of Essex Sounds Good Improving Sound Archives in the East of England 19th November 2007
UKDA: sources of data Data for research and teaching used in various sectors • official agencies - mainly central government • international statistical time series • individual academics - research grants • market research agencies • public records/historical sources • qualitative and quantitative • access to international datavia links with other data archives worldwide
40 years of the UK Data Archive • 5,000+ datasets in the archive • 200+ new datasets are added each year • 6,500+ orders for data per year • 18,000+ datasets distributed worldwide per year • history data service in-house (AHDS History) • mainly quantitative but some qualitative • approaches to storage will differ • growth of audio elements
Storage: where to start? • Context of your digitisation programme • nature of digital media (active) • overall management strategy • agreement on goals and objectives • working procedures developed and agreed • procedures in place and workable • Fruits of your digitisation programme • preservation • conservation • access • usability • each one assures for the future?
Identifying potential issues • Large size of audio files • Complex storage structure • Preservation • Preserve a single master copy • Preserve playback / delivery copy • Multi-version copies of each? • Access to each of the above • Now and in the future • Future proof? • Data degradation / corruption • Malicious attack • If left alone, issues become problems
Solutions to consider • Review existing IT architecture and support • Assess size of current and probable future storage needs • Effective file management systems • Documentation and metadata considered in depth • Effective file labelling schemes • Internal version control • Assess online and offline needs • Master copies offline • Playback copies online
Solutions to consider • The problem of ‘unproven’ new media • Policy on proprietary and non-proprietary formats • Wisdom of multiple formats • Security and restricted access • Testing and re-mastering schedules • Migrate files when necessary • Exit strategy in place (ownership, responsibilities etc.)
Storage media • Proven and unproven standards • Multiple copies • Multiple locations • Backup and emergency planning • Documentation and metadata • Quality control checks • Standards WILL change • Responses to change • All integrated under the preservation • life-cycle
Storage Solutions Digital preservation and the preservation life-cycle Re-purposing
Digital storage models • Within your own organisations • Public sector advice and support • Commercial services • Hosting and storage service • Storage and delivery service • Whatever is used will need to be an ongoing commitment
Further advice and support • Within your own organisations • Public sector advice and support • The National Archives www.nationalarchives.gov.uk/ • Digital Preservation coalition www.dpconline.org/graphics/join/darp.html • Regional pilot project www.data-archive.ac.uk/news/publications/darp2006.pdf • UK Data Archive www.data-archive.ac.uk/