1 / 6

Data Breakout

Data Breakout. OGSA Architecture – databases. Eldas, OGSA-DAI and GridMiner implement a slightly old version of OGSA / DAIS Architecture doc describes capabilities; DAIS explores details Current OGSA / DAIS spec does not include: Extensibility (e.g. as used in e-Diamond)

tarak
Download Presentation

Data Breakout

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Breakout

  2. OGSA Architecture – databases • Eldas, OGSA-DAI and GridMiner implement a slightly old version of OGSA / DAIS • Architecture doc describes capabilities; DAIS explores details • Current OGSA / DAIS spec does not include: • Extensibility (e.g. as used in e-Diamond) • Packing of multiple tasks and multiple data sets • Translation • Definitely need (* as noted in OGSA doc): • Data connection / third-party delivery* • Unique names for identifying data content and data instance* • Robust and integrated architecture* • Model of metadata for databases • Eldas and OGSA-DAI have OGSI, WSRF and WS-I interfaces planned • OGSA explicitly assumes WSRF • Some resistance to this; a federated approach suggested

  3. OGSA Architecture – Files • File Storage – GSM (SRM-like) • Directory structure – GFS • Replica Catalogs – OREP • Metadata Catalogs • File stats (locking, mutability, ACLs) • User attributes • API for access – ADF (POSIX-like) • Definitely need: • Naming • Data Movement

  4. Web Service Interfaces • SRM is not WS-I compliant (yet) • Eldas supports message-level encryption • https for Wed Services • WS-Security for Grid services • OGSA-DAI requires XSLT • Other standards that we have to adhere to • POSIX, Windows, NFS, FTP, Gzip, …

  5. APIs: User commands • Files: Explorer equivalent • Including ls, tail, find, … ? • Need to prioritise • Quota management • ACLs • Files: Directories • Familiar interface • Databases: Query tool • OGSA-DAI and Eldas provide GUI tools • Quick query, schema inspection, etc • No existing standard • Databases: DBA Tools • No existing standard

  6. APIs: programming interfaces • Files: SRM • POSIX-like • Need to prioritise • plus management interface to handle scalable systems • Files: Directories • Familiar interface • Files: Catalogs • One-shot interface (because content unknown) • Bulk operations • Databases: • “OGSA-DAI client API” • E.g. simple query • Add to SAGA or form DAIS API group? • Extensibility interface (client and server) • Bulk operation and bulk data interface (client and server)

More Related