1 / 6

Demo : Uniform Grid Access to Different Mass Storage Systems

Demo : Uniform Grid Access to Different Mass Storage Systems. This demo illustrates: Uniform Grid Access to: three MSSs: HPSS, Enstore, JASMine Using the Storage Resource Manager (SRM) interface SRM modules were developed independently for the 3 MSSs

ferrol
Download Presentation

Demo : Uniform Grid Access to Different Mass Storage Systems

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Demo: Uniform Grid Accessto Different Mass Storage Systems • This demo illustrates: Uniform Grid Access to: • three MSSs: HPSS, Enstore, JASMine • Using the Storage Resource Manager (SRM) interface • SRM modules were developed independently for the 3 MSSs • Shows the power of standard SRM functionality • Contributors: • JLAB: Bryan Hess, Andy Kowalski • FNAL: Don Petravick, Timur Perelmutov, Rich Wellner • LBNL: Junmin Gu, Vijaya Natarayan,Ekow Otoo, • Alex Romosan,Alex Sim, Arie Shoshani

  2. High Level View of Demo Setup Client (USER/APPLICATIONS) uniform interface SRM SRM JASMine SRM Enstore

  3. High Level View of Demo Setup Client USER/APPLICATIONS Grid Middleware SRM SRM SRM SRM SRM Enstore DCache JASMine CASTOR

  4. Screen Dump of Demo at Fermi Booth

  5. Where do SRMs belongin the Grid architecture? : . G N O R 2 S O T R O I E E O T Request Workflow or C C N V I A L Application- Community Consistency Services I I I F Interpretation Request C A T V A I I Specific Data Authorization (e.g., Update Subscription, C C R U M L and Planning Management E T E E P O E Discovery Services Services Versioning, Master Copies) P L S R P V Services Services D I L S I A V T O C C E L L G : R O 1 S N O C I E E E L F T V L Data Filtering or C A Data Data General Data Storage Compute Monitoring/ A I S P R R T N I E Transformation E Transport Federation Discovery Management Scheduling Auditing U T I C C D L N O E I Services Services Services Services (Brokering) (Brokering) Services R U E V L S L M G O R E O E O R C S C E L : S G E E N C Resource I Storage C File Transfer Data Filtering or Database Compute R S R Monitoring/ U Service Resource Transformation Management Resource U G O O N Auditing (GridFTP) Manager Services Services Management S I S R E E A R R H S Y T I V I T Communication Authentication and C E Protocols (e.g., Authorization N TCP/IP stack) Protocols (e.g., GSI) N O C C I Other Storage R Mass Storage System (HPSS) Compute B Networks A Systems This figure based on the Grid Architecture paper by Globus Team F systems

  6. Main advantages of using SRMs • Same uniform interface to all types of storage systems • Disk Storage System • Mass Storage System • For Mass Storage Systems it provides: • Queuing and pre-staging • Queued multi-file “get” requests (avoid flooding MSS) • Pre-staging of files (concurrent with transfer) • Queued archiving of “put” requests (avoid flooding MSS) • Robustness and efficiency • Recover in case of transient failures from MSS • Reorders pre-staging requests to minimize tape mounts • Recovery from failed GridFTP transfers • Re-issues requests in case of failure

More Related