1 / 10

EGEE UF4/OGF25 Catania, Italy March 2 nd , 2009

EGGE UF4 / OGF25 Catania (Italy), March 2 nd , 2009. State and Future Plans for GridWay Metascheduler. EGEE UF4/OGF25 Catania, Italy March 2 nd , 2009. Eduardo Huedo. Contents. Architecture Components Scheduling Policies Interoperation through Adapters Infrastructures Using GridWay

hannibal-braden
Download Presentation

EGEE UF4/OGF25 Catania, Italy March 2 nd , 2009

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EGGE UF4 / OGF25 Catania (Italy), March 2nd, 2009 State and Future Plans for GridWay Metascheduler EGEE UF4/OGF25 Catania, Italy March 2nd, 2009 Eduardo Huedo

  2. Contents • Architecture • Components • Scheduling Policies • Interoperation through Adapters • Infrastructures Using GridWay • Status and Future Plans • More Information

  3. Architecture GridWay DRMAA • LRM-like Command Line Interface • OGF DRMAA C, Java, Perl… bindings • OGF JSDL (POSIX & HTC profiles) • Job arrays, DAG workflows and MPI jobs $> Applications CLI Application-Infrastructure decoupling .C, .java .C, .java • Advanced scheduling policies • Accounting • Fault detection & recovery Grid Meta- Scheduler • Straightforwarddeployment • Deploy different kinds of grids • Interoperation between grids Globus Services Grid Middleware • Highly dynamic & heterogeneous • High fault rate Infrastructure PBS SGE

  4. Components MDS2 MDS2 GLUE MDS4 GridFTP RFT pre-WS GRAM WS GRAM DRMAA library CLI Job Submission Job Monitoring Job Control Job Migration GridWay Core Request Manager Job Pool Host Pool Dispatch Manager Scheduler Transfer Manager Execution Manager Information Manager Job Preparation Job Termination Job Migration Resource Discovery Resource Monitoring Information Services File Transfer Services Execution Services

  5. Scheduling Policies • Rank Expressions • Fixed Priority • User Usage History • Failure Rate Resource Policies Grid Scheduling = Job + Resource Policies Matching resources for each job (user) Pending Jobs Job Policies • Fixed Priority • Urgent Jobs • User Share • Deadline • Waiting Time

  6. Interoperation through Adapters • Different execution interfaces (GRAM2, GRAM4, CREAM, ARC...) • Different cluster configurations (shared FS or not) • Different transfer models (direct, reverse) • Different information models (Globus, GLUE...) • A&A through globally recognized CAs and DN’s Users GridWay gLite Globus Globus gLite Globus Globus SGE Cluster PBS Cluster SGE Cluster PBS Cluster SGE Cluster PBS Cluster

  7. Interoperation through Adapters • A real example of gwhost output (OGF23 demo):

  8. Infrastructures Using GridWay

  9. Status and Future Plans • Latest developments (for GridWay 5.5) • A single account to manage several grid users/proxies, useful for portals • Execution adapter for CREAM • Improved information adapter for EGEE • Other developments (related components) • Information and execution adapters for ARC, thanks to Dmytro Karpenko (BITP) • Execution adapter for SGE, thanks to CESGA • Plug-in for SLA negotiation, thanks to BEinEIMRT project • Future developments • Scheduling policies for federated grids • Execution adapter for DRMAA, i.e. for any DRMS supporting it • Adapters for UNICORE • Data caching and data management

  10. More Information • Guides, howtos, mailing lists... • http://www.gridway.org • Globus guides • http://www.globus.org/toolkit/docs/4.2/4.2.0/execution/gridway • Open community development process • http://dev.globus.org/wiki/GridWay • Research publications • http://dsa-research.org • More about GridWay at EGEE UF4/OGF25 • Tutorial about "Porting Applications with Globus GridWay”, here! next! • Presentation "Vashra-T: Grid Ray Tracing for the Fusion Physics ASTRA Code", Tuesday 14:25 • Presentation "Porting AITALC product through a master/worker scheme", Wednesday 14:00 • Poster "Support for CREAM-based CEs in GridWay Metascheduler“, Tuesday 16:00 • Any question now?

More Related