100 likes | 271 Views
SRB in Ecogrid. Bing Zhu San Diego Supercomputer Center May 14, 2004. SRB. Metacat. query. get. DiGIR. Xanthoria. Ecogrid Level I Services. C Java C++ Python Web services …. user. Java. Java. Ecogrid. user. user. user. user. Application. Resource, User. Java, NT
E N D
SRB inEcogrid Bing Zhu San Diego Supercomputer Center May 14, 2004
SRB Metacat query get DiGIR Xanthoria Ecogrid Level I Services C Java C++ Python Web services … user Java Java Ecogrid user user user user
Application Resource, User Java, NT Browsers Prolog Predicate C, C++, Linux I/O Unix Shell Third-party copy Web User Defined SRB Remote Proxies MCAT Databases DB2, Oracle, Sybase Archives HPSS, ADSM, UniTree, DMF File Systems Unix, NT, Mac OSX HRM Dublin Core DataCutter Application Meta-data SDSC Storage Resource Broker & Meta-data Catalog
Peer to peer Federated MCAT (3.0 +) MCAT1 Server1.1 Server1.2 MCAT3 Server3.1 MCAT2 Server2.2 Server2.1
Ecogrid Query Service implementation for SRB system • Ecogrid Query for SRB data source is based on search on metadata data which includes • system metadata (create date, owner, size, etc) • user metadata
Flow of SRB Query Jargon user SEEK Query document SRB MCAT Ecogrid node SeekXMLQueryDocSRBParser Ecogrid Resultsets Submit SRB Query SRB Server Translate SRB query result to Ecogrid ResultSet SRB Query results
Query Example 1 <AND> < condition operator=“LIKE" concept=" srbUR”I>srb://testuser.sdsc:passwd@srb.sdsc.edu:6617/home/testuser.sdsc</condition> <condition operator="EQUALS" concept="Number of Species">2</condition> <condition operator="LIKE" concept="file name">%Model%</condition> </AND> Ecogrid Query adopts a query schema, Query Document Schema, as a common query language within Ecogrid. <?xml version="1.0" encoding="UTF-8"?> … <egq:query queryId="test.1.1" system="http://knb.ecoinformatics.org" xmlns:egq="ecogrid://ecoinformatics.org/ecogrid-query-1.0.0beta1" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="ecogrid://ecoinformatics.org/ecogrid-query-1.0.0beta1 ../../src/xsd/query.xsd"> <namespace prefix="eml"> … </namespace> <title>metadata query for Eco Models</title> <AND> < condition operator=“LIKE" concept=" srbUR”I>srb://testuser.sdsc:passwd@srb.sdsc.edu:6617/home/testuser.sdsc</condition> <condition operator="EQUALS" concept="Number of Species">2</condition> <condition operator="LIKE" concept="file name">%Model%</condition> </AND> </egq:query>
Query Example 2 <?xml version="1.0" encoding="UTF-8"?> … <AND> <condition operator=“EQUALS" concept=“srbUser”>testuser</condition> <condition operator=“EQUALS" concept="MdasDomain”>sdsc</condition> <condition operator=“LIKE" concept="MdasHome”>/home/testuser.sdsc</condition> <condition operator=“EQUALS" concept=“srbPort”>6617</condition> <condition operator=“EQUALS" concept=" srbPasswd”>passwd</condition> <condition operator=“EQUALS" concept=" AuthScheme”>encrypt1</condition> <AND> <condition operator="EQUALS" concept="Number of Species">2</condition> <condition operator="LIKE" concept="file name">%Model%</condition> </AND> </AND> </egq:query>
Ecogrid Services implementation for SRB system (get) • A ‘get’ call from ecogrid to SRB system means to retrieve the content of a dataset. • The ‘get’ function can also be used to submit a SQL query for a relational database (Oracle, DB2, etc), which is pre-registered as a data source in SRB.
SRB get file system SRB MCAT Oracle Jargon user SEEK get request Resolve SRB file name Ecogrid node Bytes or a text string for a DB SQL srb.sdsc.edu SRB file I/O SRB Server bytes Submit SQL query ec.wisc.edu Wrapped results SRB Server