120 likes | 156 Views
Storage Resource Broker. Managing Distributed Data in a Grid. A discussion of a paper published by a group of researchers at the San Diego Supercomputer Center, UCSD. By: Nayef TRAD INSA-Lyon. PLAN. What is SRB? SRB Features & Capabilities SRB communication in conjonction with MCAT
E N D
Storage Resource Broker Managing Distributed Data in a Grid A discussion of a paper published by a group of researchers at the San Diego Supercomputer Center, UCSD By: Nayef TRAD INSA-Lyon
PLAN • What is SRB? SRB Features & Capabilities • SRB communication in conjonction with MCAT • Federated SRB Zones Why Federation? • Cons & Pros N.T@INSA-Lyon
What is SRB? SRB in a Nutshell • A data grid solution • A digital library • A distributed but unified file system • An advanced archival system • A semantic Web • A five nines availability resource broker N.T@INSA-Lyon
What is SRB? Features In depth • The SRB is a client-server middleware that uses datasets to build a logical name space for referencing distributed data. • The SRB provides a way to organize information stored on multiple heterogeneous systems into logical entities for ease of use. • The SRB provides access to data stored on archival resources, file systems and databases. • The SRB also provides capabilities to store replicas of data, controlling and auditing access to documents and collections, which is also known by logical-to-physical mapping hence Metadata Cataloging • The SRB also provides a facility for co-locating data together using containers with more flexibility in accessing and updating files and stores user-defined metadata at different levels for better search capabilities. N.T@INSA-Lyon
What is SRB? SRB specific capabilities • Support for the execution of remote operations. • Access controls and audit trails to control and track data usage ( MCAT ) • Interacting with multiple types of storage systems, for its abstraction • User-friendly access through many ways like shells, scripts, libraries and web browsers N.T@INSA-Lyon
SRB & MCAT N.T@INSA-Lyon
User SRB communication 3 MES Interpreting queries into SQL statements DB Server 4 Returning DB query 2 Contacting MES Supplying the location of the file 5 Contacting hosting server 6 1 SRB Server A SRB Server B Requesting a file 7 Sending requested file N.T@INSA-Lyon
Federated SRB Zones Zone A Zone B SRB SRB Trust Relation DB DB SRB Zones recognize the presence of each others and is able to interact, despite the independency of each zone which is forming a federation. The overall federation is always viewed as a single logical namespace. N.T@INSA-Lyon
Federated SRB Zones Why Federation? • Federation enables fragmentation of MCAT DataBase When a system failure occurs that would bring down an MCAT fragment, but shouldn’t affect the entire SRB, as the other sections will isolate the temporarily inaccessible server. • Federation permits MetaData to reside closer to the resource To reduce network latency, an MCAT server is hosted closer to the resource; in turn the SRB performance improves on a network span basis. • Federation enables the Virtual Organizations notion and makes it easier to merge newbies to the network, not to forget the ability of transferring and replicating documents across VOs N.T@INSA-Lyon
Cons & Pros Cons • That paper can be considered as a fine support for understanding the Data Grids Architecture. • Experiencing such enormous projects describes the powerful and huge capabilities of an SRB. Pros • Absence of citation of some important points, like SRB federation and MCAT. • Redundancy of similar ideas and information along the examples discussed. N.T@INSA-Lyon
Some Useful References • http://www.npaci.edu/dice/srb/ • https://srb.npaci.edu/mySRB.html • http://www.eudatagrid.org/grid/papers/data_mgt_grid2000.pdf • http://www.npaci.edu/dice/srb/mcat.html • http://www.srl.caltech.edu/nvo/ • http://www.ipac.caltech.edu/2mass/ • http://www.nbirn.net/ N.T@INSA-Lyon
Here come troubles… Show me some MERCY while SHOOTING your questions Thank you !