1 / 10

OGCE Workflow Suite

OGCE Workflow Suite. Gopi Kandaswamy Suresh Marru Srinath Perera Chathura Herath Marlon Pierce. TeraGrid 2008. Workflow Suite. Generic Service Toolkit Tool to wrap command-line applications as web services Handles file staging & job submissions

teddy
Download Presentation

OGCE Workflow Suite

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OGCE Workflow Suite Gopi Kandaswamy Suresh Marru Srinath Perera Chathura Herath Marlon Pierce TeraGrid 2008

  2. Workflow Suite • Generic Service Toolkit • Tool to wrap command-line applications as web services • Handles file staging & job submissions • Extensible runtime for security, resource brokering & urgent computing • Generic Factory service for on-demand creation of application services • XRegistry • Information repository for the OGCE workflow suite • Register, search, retrieve & share XML documents • User & hierarchical group based authorization • XBaya • GUI based tool to compose & monitor workflows • Extensible support for compiler plug-ins like BPEL & Jython OGCE TeraGrid08 Tutorial

  3. Features • Security • Authentication and authosrization • Secure invocations between services • Support for gateway community accounts • Support for multiple user accounts • Reliability • Retry job submissions and file staging • Fault Tolerance and Recovery service • Over-provisioning and migration • Compatibility • Taverna, Kepler and Trianna OGCE TeraGrid08 Tutorial

  4. Applications • LEAD • Lower entry barrier to using weather analysis tools • Improve detection, analysis & prediction of mesoscale weather • Motif-Network • Transformation of sequenced genomes to “domain-space” • Cyber-Infrastructure Evaluation • Performance evaluation of future supercomputer architectures • ADAM • Algorithms for feature extraction, data normalization, classification and normalization OGCE TeraGrid08 Tutorial

  5. LEAD: A Weather Forecasting Workflow (1/2) Terrain data files 3D Model Data Interpolator (lateral Boundary Conditions) NAM, RUC, GFS data 9 3 1 3D Model Data Interpolator (Initial Boundary Conditions) Terrain Preprocessor Surface data, upper air mesonet data and wind profiler data 11 15 2 ARPS to WRF Data Interpolator WRF Static Preprocessor IDV 4 88D Radar Re-mapper 7 Surface, terrestrial data files WRF WRF 10 ADAS WRF ARPS Ensemble Generator WRF 12 Radar data (Level II) Run once per forecast region 5 13 NIDS Radar Re-mapper 8 WRF to ARPS Data Interpolator Radar data (Level III) ADAM Visualization on users request Satellite data 6 Satellite Data Re-mapper 14 Repeat periodically for new data ARPS Plotting Program Data mining: look for storm signature Triggered if a storm is detected Static data Real time data Initialization Forecast Visualization Analysis Data Mining

  6. LEAD: A Weather Forecasting Workflow (2/2) WRF-Static running on Tungsten OGCE TeraGrid08 Tutorial

  7. Ensemble-type processing (minimal network reqs) Capacity-type computing Parallel processing Capability-type computing Motif-Network: Whole Genome workflow • Domain webs of large genomes • Input list of amino acid sequences • Identify all known domains • Construct webs Jeff Tilson, RENCI OGCE TeraGrid08 Tutorial

  8. CI: Execute Sub-Workflow • Input a campaign step filename • Execute GAMESS per step specification Jeff Tilson, RENCI OGCE TeraGrid08 Tutorial

  9. More Information OGCE TeraGrid08 Tutorial

  10. Questions? OGCE TeraGrid08 Tutorial

More Related