• 150 likes • 239 Views
Grid Workflow within Triana. Ian Wang Cardiff University. E.U. Funded 9 Institutions German (x2), Poland, Hungry, Czech, Holland, Greece, Italy, U.K. 13 Work-Packages GAT Resource Broker (GRMS) Data Management Portal (GridSphere) Monitoring (Mercury) Adaptive Components
E N D
Grid Workflow within Triana Ian Wang Cardiff University
E.U. Funded 9 Institutions German (x2), Poland, Hungry, Czech, Holland, Greece, Italy, U.K. 13 Work-Packages GAT Resource Broker (GRMS) Data Management Portal (GridSphere) Monitoring (Mercury) Adaptive Components Information Services (iGrid) … GridLab
GridLab GAT • Application-level API • Abstract ‘Common’ Capabilities required by Grid Applications • Resource Discovery • Job Submission • File Transfer • Capabilities extracted through a number of Grid Application Scenarios. • Makes life as a Grid programmer easier … • Motivation for the GGF SAGA research group (Simple API for Grid Applications)
GAT Architecture Application (e.g. Triana) GridLab GAT API Resource Broker File GRMS GRAM Local File Service GridFTP HTTP Local Adaptors Services GRMS GRAM Grid FTP HTTP File Transfer iGrid Mercury
Using the GAT GATContext context = new GATContext(); Preferences prefs = new Preferences(); prefs.put("ResourceBroker.adaptor.name", "grms"); URI exe = new URI("file:////bin/hostname"); File outFile = GAT.createFile(context, prefs, new URI("file:///out") SoftwareDescription sd = new SoftwareDescription(); sd.setLocation(exe); sd.setStdout(outFile); ResourceDescription rd = new HardwareResourceDescription(); rd.put("hostname", "bouscat.cs.cf.ac.uk"); JobDescription jd = new JobDescription(sd, rd); ResourceBroker broker = GAT.createResourceBroker(context, prefs); Job job = broker.submitJob(jd);
Visual GAT • GAT Primitives represented as Workflow Objects • Job Tasks • File Tasks • Grid Data Flow implicit in Workflow Connections • File Task -> File Task = Data Transfer • File Task -> Job Task = Pre-Stage File • File Task -> Local Task = File Read • Grid Operations handled by GAT Adaptors • Grid File -> Grid File = GridFTP • HTTP File -> Local Task = HTTP • Grid File -> GRMS Job = GRMS Pre-Stage
Grid Workflow in Triana File Write File (Local/Remote) Pre-Stage Job (Local/Remote) Post-Stage Temporary File File Read Local Java Unit
Visual GAT Alternative • Grid Operations Expressed Explicitly • GridFTP Tasks • File Write Tasks • File Read Tasks • Not Intuitive • Not Future Proof
GridLab GAT File CPI Resource Broker CPI HTTP Adaptor GridFTP Adaptor Data Movement Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor File Input (HTTP) Triana WaveToy.par www. gridlab. org
File Staging (GridFTP) Triana GridLab GAT File CPI Resource Broker CPI HTTP Adaptor GridFTP Adaptor Data Movement Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor WaveToy.par www. gridlab. org Testbed
Job Submission 1 Triana GridLab GAT File CPI Resource Broker CPI HTTP Adaptor GridFTP Adaptor Data Movement Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor GAS GRMS Cactus www. gridlab. org Testbed Data Mvment Testbed WaveToy.par Delphoi Mercury iGrid
Job Submission 2 Triana GridLab GAT File CPI Resource Broker CPI Instant Mess HTTP Adaptor GridFTP Adaptor Data Movement Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor Portal GAS GRMS Cactus www. gridlab. org Testbed Data Mvment Testbed Delphoi Mercury iGrid
Job Submission (GRAM) Triana GridLab GAT File CPI Resource Broker CPI Instant Mess HTTP Adaptor GridFTP Adaptor Data Movement Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor Portal GRAM Cactus www. gridlab. org Testbed Testbed
WSPeer User Interface Web Service GridMonSteer Resource Broker (e.g. GRMS) Grid Side submit run User Side Application (e.g. Triana) GridMonSteer (gms) gms http://www.xyx.org:4802/axis/gms cactus monitor cactus phi_xy.jpg phi_yz.jpg phi_xy.jpg phi_yz.jpg rundir http://www.xyz.org/axis/gms invoke using SOAP
Triana Grid Workflow Summary • GridLab GAT • Application-level API • Abstracts Common Capabilities required by Grid Applications such as Triana • Visual GAT • GAT Primitives represented in Triana as Workflow Objects • Grid Data Flow implicit in Workflow Connections • GridMonSteer • Generic Architecture for Monitoring and Steering Legacy Applications