100 likes | 110 Views
Learn about Bristol's state-of-the-art research data storage facility - BluePeta. Explore how this facility addresses the growing demand for secure and resilient storage as researchers generate more data. Find out how to apply and the associated costs. Discover the future plans for the facility, including off-site storage and wider data management issues.
E N D
Storing data securely - Bristol’s Research Data Storage Facility 14 December 2011 Caroline Gardiner Academic Research Facilitator
Background - the “data deluge” • Within Bristol: • 2007 - initial demand identified among HPC researchers; requirements across all disciplines soon became apparent. • Recent survey of UOB researchers indicated storage requirements of 1 petabyte and growing. • Forecasting increase to 10-20 petabytes by 2015. • Beyond Bristol: • 1800 exabytes of data likely to be created worldwide in 2011 (10 times 2006 figure). • Storage vendors starting to produce exascale storage devices. • Research council and other funder data policies.
The problem… • Data currently held on range of devices - security and resilience need addressing.
…The solution • BluePeta • £2m funding to date; ongoing investment planned. • Available to all researchers - for RESEARCH data. • Petascale facility – expandable. • 3 machine rooms – resilience (tape archive 2012).
Management 5 Board Pro Vice-Chancellors (Research, Learning & Teaching), Deans of Science & Engineering,Deputy Finance Director, Director ITS, Chair and permanent members of HPC Exec Technical Advisory Board HPC SysAdmins Nominated HPC stakeholders Permanent members of Exec External HPC experts HPC Executive 2 permanent members (Director ACRC and senior CS/HPC academic), 5 rotating members from User Group, Director of Estates + non-exec member: Research Facilitator Research Data Storage and Management Board Directors ITS and ACRC, Research Facilitator, representatives from HPC Exec, 6 Faculties, Library and RED ACRC Director 2 x HPC SysAdmins 1 .5 x Storage SysAdmin Research Facilitator User Groups HPC Stakeholders Storage users
Applying to use BluePeta • Data Steward applies - has responsibility for the data; can then register one or more projects. • Academic peer review. • Storage policy, terms of use and FAQs. • 1st 5TB free per Data Steward then £400 per TB per annum for disk storage; tape backup £40 per TB. • Encouraging researchers to include costs in grant applications. • Developing costing model for tape archive.
Project Export (individual Data Steward) Very Large File Systems ACRC Servers Direct Attached Disk HA CIFS/NFS3 from ACRC
Faculty export (Faculty Data Steward) Faculty Servers Disk (32 TB Chunks) ACRC Servers Departmental Software File system by TCP/IP File system by TCP/IP Departmental Software
The future • BluePeta now providing secure, resilient storage for research data. • Ongoing media refresh/expansion planned. • Exploring options for off-site storage. • Annual asset holding review – is data still required and if so, in what format? • Preparing EPSRC road map. • Starting to address wider issues of data management…