1 / 9

SOCATS

SOCATS is a grid-based middleware for efficient transfer of large relational datasets within the GAE framework. It provides accessibility, security, and latency solutions for relational DB access in grid environments. Supports alternate analysis tools, file location access, and replication of centralized DBs.

juanhernandez
Download Presentation

SOCATS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SOCATS STL-based Object Caching And Transport System

  2. SOCATS • SOCATS is Grid-based middleware for the efficient transfer of large relational datasets within the GAE framework • Uses Clarens for remote procedure call layer

  3. SOCATS • Does not replace Sql2Root for generation of ROOT files Usage examples: • A user wants to use an alternate analysis tool (e.g. Matlab,) on the client.  The (s)he may want to transfer large resultsets in a non-ROOT relational DBformat. • A programmer/user wants to access large lists of file locations (from anrls), etc. • A user wants to replicate large portions of centralized dbs to a client or servermachine

  4. SOCATS Relational DB access in Grid environments pose challenges in several areas: • Security • Latency • Modularity / Data Provenance • Accessibility / Ease of Use

  5. SOCATS

  6. SOCATS

  7. SOCATS

  8. SOCATS • Accessibility designed for C++/Python clients, with results delivered in Standard Template Library vector and map objects • RPC interfaces defined with WSDL and results delivered in binary form • Client-side caching of result sets in conjunction with VDC queries

  9. SOCATS • In Summary – SOCATS will provide • DB vendor abstraction. • Language natural access:  STL for C++, RMI for Java, ... • Location transparency - client code does not have to know whether an object has been transferred in order to call a method on that object. • Front-end caching - client code will cache frequently accessed result sets to minimize latencies • integrated security and firewall transversal - currently GAE uses CLARENS for rpc and security functionality.  • Random access of rows in result set - reordering of transfers to meet user's requests.  If a user jumps to row 10,000 of the result set, then intervening rows need not be transferred before row 10,000 can be transferred. • Eliminate latencies associated with packaging result sets to files by streaming directly to the client. • Self describing object collections • Demo this afternoon

More Related