IT Matters

1. Data Storage 2014 IT Matters

2. Topics • Current Storage Infrastructure • Backup and Restore • Handy Information and Techniques • Storage Future University of Adelaide

3. Current Storage Infrastructure • Mainly consists of NetApp Storage (www.netapp.com) • FAS 6240’s • Home/Shared Folders (U:\ and S:\) • Staff Email (Exchange Mailboxes) • TRIM Records Management • MyMedia Streaming Data • Majority Server Storage • Uptime is vital! • FAS 3250’s • Databases (Peoplesoft/Access Adelaide/MyUni) • Uptime is vital! • FAS 2240’s • Lower Cost Storage University of Adelaide

4. Current Storage Infrastructure • FAS 6240 University of Adelaide

5. Current Storage Infrastructure • FAS 3250 University of Adelaide

6. Current Storage Infrastructure • FAS 2240 University of Adelaide

7. Current Storage Infrastructure • How much data? • Total Capacity: 1000TB+ usable. • Data Transfer Rates: 880MB/s. • Usage Numbers: • 20TB of Email (Staff) – 128,368,337 emails. • 49TB of Home Folders – 84,763,414 files and folders. • 26TB of Shared – 39,266,782 files and folders. University of Adelaide

8. Current Storage Infrastructure • Enterprise Support – 24/7 • Substantial Cost • Proactive Maintenance • Guaranteed Compatibility • The storage system is guaranteed to integrate effectively with other components of our IT infrastructure. University of Adelaide

9. Current Storage Infrastructure • Data Efficiencies (Cost Benefits!) • Deduplication U:\ Drive Storage Duplication Enabled University of Adelaide

10. Current Storage Infrastructure • Data Efficiencies (Cost Benefits!) • Thin Provisioning Only going to buy enough storage to store actual data! This should do: Wow, so much storage! :D CRAP! Saved Data Money Saved! Storage Admin Users Saved Data University of Adelaide

11. Current Storage Infrastructure • Data Efficiencies (Cost Benefits!) • Thin Provisioning • Capacity on Demand (COD) Only going to buy enough storage to store actual data! This should do: Lets save all the data! Wow, so much storage! :D Crisis Averted! Saved Data Storage Admin Users Saved Data Data increasing.. Stress rising! Better enable COD. University of Adelaide

12. Current Storage Infrastructure • Data Protection • Has a whole topic coming next! • High Reliability • Hardware Redundancy (two of everything) • Plus many more.. • Performance • Manageability (Provisioning/Monitoring/Reporting) University of Adelaide

13. Backup and Restore What is a Backup? A second copy of data! Main purpose: Recover data from large scale corruption, equipment failure or disaster scenarios... University of Adelaide

14. Backup and Restore Disasters won’t happen to us? Think again! University of Adelaide

15. Backup and Restore Any other uses?! Alternate usage: Recover individual emails or files from particular points of time in the past. Alternate usage, but most common. University of Adelaide

16. Backup and Restore - Tape • Backup-To-Tape: • Long term retention. • Slow to restore data. University of Adelaide

17. Backup and Restore - Tape • Backup-To-Tape: • Long term retention. • Slow to restore data. Geographically Remote Data Centre 2 Data Centre 1 U:\ Drive S:\ Drive Email Tape Library Aged 8 weeks University of Adelaide

18. Backup and Restore – “Local” Disk • Backup-To-Disk: • Reduced disk cost and smart software making this possible. • Fast to access! • We utilise backup-to-disk in a couple ways, Local and Remote backups. “Local” Backups: Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept. Storage without Snapshots “Bugger” 10101 1010101 1010101011 110 101010111 110011 101010010 10100100 10101010100 10101001 10011 Time (Days) University of Adelaide

19. Backup and Restore – “Local” Disk • Backup-To-Disk: • Reduced disk cost and smart software making this possible. • Fast to access! • We utilise backup-to-disk in a couple ways, Local and Remote backups. “Local” Backups: Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept. Storage with Snapshots “Bugger” “Snapshots!” 10101 1010101 1010101011 110 101010111 110011 101010010 10100100 10101010100 10101001 10011 Snapshot 2 Snapshot 1 Snapshot 3 Snapshot 4 Snapshot 5 Snapshots protect the data! Time (Days) University of Adelaide

20. Backup and Restore – “Remote” Disk #1 “Remote” Disk Backups: Quick Disaster Recovery! Backup which is physically located some distance from Active Data, on a storage device in a secondary data centre. Data is a maximum of 24 hours out of date. Active Connections Active Connections Primary Data Centre Secondary Data Centre U:\ Drive U:\ Drive Changes made to Data are copied to Secondary Data Centre (Twice a day) S:\ Drive S:\ Drive FAS 6240 FAS 6240 University of Adelaide

21. Backup and Restore – “Remote” Disk #2 “Remote” Disk Backups: Making File and Email Restores easy! Backup which is physically located some distance from Active Data, on a storage device in a secondary data centre. Secondary Data Centre Manual Connections Active Connections U:\ Drive Primary Data Centre FAS 2240 U:\ Drive Email Admin Email Email Changes made to data, copied to Secondary Data Centre (Once a day) Efficient Backup Software FAS 6240 University of Adelaide

22. Backup and Restore • Important: • Missing Data? Call Service Desk as soon as possible. • Never delete required data, assuming it’ll just get restored from backup. • Local Computer Hard Disc, not backed up! University of Adelaide

23. Handy Information and Techniques • Secure Data Transfers and Remote File Access • AARnetCloudStor (https://cloudstor.aarnet.edu.au/sender/) • Secure data transfer to anyone with an email address. • University Virtual Private Network (https://vpn.adelaide.edu.au/) • Secure data access to R:\, S:\ and U:\ drives for all UofA affiliated users. University of Adelaide

24. Handy Information and Techniques • Big Datasets • AARnetCloudStor+ (https://cloudstor.aarnet.edu.au/plus) • eResearchSA (http://www.ersa.edu.au/data) • Data Collaboration • AARnetCloudStor+ • Shared Data Drive (S:\) • Low Cost Storage (R:\) • More information on research data management: http://libguides.adelaide.edu.au/researchdata University of Adelaide

25. Handy Information and Techniques What about Cloud Storage? • Would the Cloud provider tell you if they were hacked and your data was stolen? • Is your data being backed up? • Is your data being shared with advertising companies? • What happens if the Cloud provider goes bankrupt or is taken over? • Are employees of the Cloud provider allowed to view and share your data? University of Adelaide

26. Handy Information and Techniques What about Cloud Storage? Some privacy policies: “When you upload or otherwise submit content to our Services, you give Google (and those we work with) a worldwide license to use, host, store, reproduce, modify, create derivative works … communicate, publish, publicly perform, publicly display and distribute such content.” – Google, April 2014 “In the event of a reorganization, merger, or sale we may transfer any and all personal information we collect to the relevant third party.” – Apple, March 2014 “If we are involved in a reorganization, merger, acquisition or sale of our assets, your information may be transferred as part of that deal. We will notify you (for example, via a message to the email address associated with your account) of any such deal and outline your choices in that event.” – DropBox, March 2014 More information about keeping data secure: http://www.adelaide.edu.au/technology/secureit/data/ University of Adelaide

27. Storage Future • What’s on the horizon. • Bigger S:\ drive allocations • Smarter Archiving • Cloud Integration for Data Storage • Ability to access your files any device, any time, any way. • Ease of collaboration. • Research Data Reforms (via eResearch Strategy) • Associate Director Research IT Strategy (David Munro) • Identify-Classify-Protect!(Data Classification Campaign - Secure IT) University of Adelaide

28. IT Matters – 2014 Storage Questions?

29. THANKS FOR LISTENING! IT Matters