StorageBroker A project idea for Switch AAA Grid

1. StorageBrokerA project idea for Switch AAA Grid • Tabea Lurk, MA (tabea.lurk@bfh.ch) • Dipl. Inform. Jürgen Enge (juergen.enge@hfg.edu)

2. Subject • From ArchiveBroker • to • StorageBroker

3. Requirements for Longevity • Sustainability • Trust • Comprehensibility • Confidence • Cost Efficiency • Easy handling

4. Sustainability by redundancy

5. What about Cost Efficiency? More Storage per System 3x

6. Distributed Storage Grid Mirror SB Mirror Mirror

7. Fairness Among Partner Institutions • Sustainability • Trust & Fairness • Comprehensibility • Confidence • Cost Efficiency • Easy handling

8. BLOB (Binary Large Object)Distribution SourceStorage StorageBrokerLayer Redundance Redundance SourceStorage Color Schema: Black: Simple Redundance Green: Double Redundance (Standard) Red: tripple Redundance (High Priority)

9. Distributed CAS • “Content-addressable storage, also referred to as associative storage or abbreviated CAS, is a mechanism for storing information that can be retrieved based on its content, not its storage location. It is typically used for high-speed storage and retrieval of fixed content, such as documents stored for compliance with government regulations.” • --- • Content-addressable storage. (2009, December 5). In Wikipedia, The Free Encyclopedia. Retrieved 15:36, January 8, 2010, from http://en.wikipedia.org/w/index.php?title=Content-addressable_storage&oldid=329800321

10. Storage Broker System Storage Broker Middleware Storage Broker Adaptor Storage Broker Adaptor Content Provider Content Provider Storage Abstraction A Storage Abstraction B Application Adaptor A Application Adaptor B File System Adaptor Archive System Institution A Institution B

11. Storage Broker Adaptor • Access • Integrity • Cost calculation & • Fairness • Allocation of content • space • Content reorganization • Management frontend Storage Broker Middleware Storage Broker Adaptor Storage Broker Adaptor Content Provider Content Provider Storage Abstraction A Storage Abstraction B Application Adaptor A Application Adaptor B File System Adaptor Archive System Institution A Institution B

12. Storage Abstraction • Storage space provision • Storage access • Atomic functions delete/copy/move • Integrity check • Storage quality management Storage Broker Middleware Content Provider Content Provider Storage Broker Adaptor Storage Broker Adaptor Storage Abstraction A Storage Abstraction B Application Adaptor A Application Adaptor B File System Adaptor Archive System Institution A Institution B

13. Content Provider and Application Adaptor • Content operations (Add/Delete/Change) • Application adaptor • File system adaptor • Storage backend for archiving • system • Storage backend for administration • software • … Storage Broker Middleware Storage Broker Adaptor Storage Broker Adaptor Content Provider Content Provider Content Provider Storage Abstraction A Storage Abstraction B Application Adaptor A Application Adaptor B Application Adaptor B File System Adaptor Archive System Institution A Institution B

14. Storage Broker System Storage Broker Middleware Storage Broker Adaptor Storage Broker Adaptor Content Provider Content Provider Storage Abstraction A Storage Abstraction B Application Adaptor A Application Adaptor B File System Adaptor Archive System Institution A Institution B

15. Summary • What is the StorageBroker? • A Service which implements a fair platform for distributed backup systems. • What is our basic interests? • To improve storage security and data sustainability while optimizing cost efficiency. • Whom are we looking for? • Storage partner: providing storage capacity • Content partner: providing storable content • Technical partner: supporting system development • What is our aim? • To provide a functional infrastructure for storing data and secure backup

16. Thank you very much for your attention. • Looking forward talking to you soon.