1 / 8

Data Grids and Data Management

Explore how Data Grids support shared collections, digital libraries, and persistent archives through efficient data management and storage systems. Learn about using a Data Grid, metadata catalogs, and storage resource brokers for seamless data retrieval. Discover the Astronomy Data Grid's international collaboration for astronomical data storage.

kmccullers
Download Presentation

Data Grids and Data Management

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Grids and Data Management Storage Resource Broker Reagan W. Moore moore@sdsc.edu http://www.sdsc.edu/srb

  2. Shared Collections • Data grids support the creation of shared collections that may be distributed across multiple institutions, sites, and storage systems. • Digital libraries publish data, and provide services for discovery and display • Persistent archives preserve data, managing the migration to new technology

  3. Using a Data Grid – in Abstract Data delivered Ask for data • The data is found and returned • Where & how details are hidden Data Grid • User asks for data from the data grid

  4. Using a Data Grid - Details DB Storage Resource Broker Metadata Catalog Storage Resource Broker • User asks for data • Data request goes to SRB Server • Server looks up data in catalog • Catalog tells which SRB server has data • 1st server asks 2nd for data • The data is found and returned

  5. Using a Data Grid - Details DB MCAT SRB SRB SRB SRB SRB SRB • Data Grid has arbitrary number of servers • Heterogeneity is hidden from users

  6. Astronomy Data Grid • Chile • Tucson, Arizona • NCSA, Illinois • A functioning international Data Grid for Astronomy Manchester-SDSC mirror Moved over 400,000 images

  7. For More Information Reagan W. Moore San Diego Supercomputer Center moore@sdsc.edu http://www.sdsc.edu/srb/

More Related