1 / 18

First evaluation of the Globus GRAM service

First evaluation of the Globus GRAM service. Massimo Sgaravatto INFN Padova. GRAM & fork system call. Simple job submission tests using globusrun, globus-job-run, globus-job-submit No serious problems found. GRAM & Condor. INFN WAN Condor pool configured as Globus resource

gloria
Download Presentation

First evaluation of the Globus GRAM service

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. First evaluation of the Globus GRAM service Massimo Sgaravatto INFN Padova

  2. GRAM & fork system call • Simple job submission tests using globusrun, globus-job-run, globus-job-submit • No serious problems found

  3. GRAM & Condor • INFN WAN Condor pool configured as Globus resource • ~ 200 machines spread across different sites • Heterogeneous environment • No single file system and UID domain

  4. GRAM & INFN WAN Condor pool

  5. GRAM & Condor • The RSL common set is often insufficient (i.e. the Condor “requirements” attribute is necessary) • The unrecognized attributes are not passed unchanged • Serious problem in particular for Condor vanilla jobs

  6. GRAM & Condor & GIS

  7. Submittig Condor jobs to Globus resources • Two possible mechanisms: • Globus Universe • GlideIn mechanisms

  8. Globus Universe Universe=globus Executable=/users/noi/sgaravat/CondorGlobus/ciao Output=/users/noi/sgaravat/CondorGlobus/out.$(Process) GlobusScheduler=lxde16.pd.infn.it/jobmanager-fork Queue 10 • Is it a simple translation: condor_submit  globusrun ? • Why is it useful ? • It will be very very very useful when Condor will be so smart to choose the Globus resource where to submit the jobs

  9. GlideIn lxde01% condor_glidein lxde15.pd.infn.it lxde01% condor_glidein lxde16.pd.infn.it

  10. GlideIn • Standard and vanilla Condor jobs successfully submitted and executed • The current implementation is not too much useful: • It is not necessary to install Condor on the remote resources … • … but it is necessary to install Globus !

  11. GRAM & LSF

  12. GRAM & LSF • Not all operations are possible (the RSL attributes are not enough) • Not a so serious problem because usually the policies are defined in the queue

  13. GRAM & LSF & GIS

  14. RSL • We need a uniform language to specify resources, between different resource management systems !!! • The RSL syntax model seems suitable to define even complicated resource specification expressions • The common set of RSL attributes is often not sufficient

  15. RSL • The attributes not belonging to the common set are ignored • Serious problem in particular when Globus relies upon a heterogeneous Condor pool • More flexibility is required • It should be possible to define new attributes and users should be allowed to use them in resource specification expressions (Condor ClassAds model) • Same language to describe the offered resources and the requested resources (ClassAds model) ?

  16. Conclusions • RSL must be improved • Local GRAMs should provide the GIS with other important information about characteristics and status of local resources • Globus & Condor • Promising activities • Not too much useful at the moment

  17. Future activities • GRAM and other resource management systems (e.g. PBS) • Use of GRAM API • Use of GRAM service in production environments for real applications (e.g. HLT activities) • Resource broker • Condor and Globus • Personal Condor as HTB for Globus Resources ?

  18. Globus Gatekeeper Globus Gatekeeper Globus Gatekeeper Site X jobs Site Z Personal Condor Personal Condor as broker for Globus resources ? Site Y

More Related