1 / 23

WS-VLAM Workflow Engine

System and Network Engineering group Institute of informatics University of Amsterdam. WS-VLAM Workflow Engine. Introduction. This presentation contains information related to WS-VLAM engine

tamara-robles
Download Presentation

WS-VLAM Workflow Engine

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WS-VLAM Introduction presentation System and Network Engineering group Institute of informatics University of Amsterdam WS-VLAM Workflow Engine

  2. WS-VLAM Introduction presentation Introduction • This presentation contains information related to WS-VLAM engine • It helps the reader understand how the workflow engine works, describes the current state and present the ongoing activities and planned ones. • NOTE: • We are currently still working on the User’s and developer’s Guide, they are notavailable at this time. The presentations do not replace the documentation it just give a quick introduction. • Do not hesitate to contact us for further information Thanks for taking some of your time to read about the WS-VLAM work, any comments are more than welcome WS-VLAM developers gvlam-dev@lists.vl-e.nl

  3. WS-VLAM Introduction presentation Needed background … • To be able to follow the content of this presentation you will need to know about: • WSRF= Web Service Reference Framework • GT4= Globus Toolkit version 4 • More detailed description of the presented work can be found in the section of publication of the WS-VLAM home page

  4. WS-VLAM Introduction presentation Objective of this presentation… • Why you should look at this presentations • You want to know how WS-VLAM works and interacts with the Grid middleware. • Why you don’t have to worry if you do not understand the content on this presentation: • You are an end-user: it will be enough for you to read the User’s guide or the WS-VLAM composer presentation • You are an application developer: it will be enough for you to read the Developer’s guide & the WS-VLAM developers presentation

  5. WS-VLAM Introduction presentation Outline • Introduction • Architecture of the WS-VLAM • Hierarchical workflow compositions & execution • Conclusions

  6. WS-VLAM Introduction presentation Objectives: A WSRF enabled workflow engine Workflow composition Workflow Management system Distributed Workflow Workflow execution Data Management Stack Process Management Stack Web Service Interface Web Service Interface Grid Services Workflow Engine Web service Application Templates Web service OGSA DAI Application web service Grid Services Grid Services Workflow Engine Web service Grid Middleware: Process & resource management Grid Middleware: Data management Network & storage Resources Network & Computing Resources

  7. WS-VLAM Introduction presentation WS-VLAM Engine characteristics • Implemented as GT4 WSRF service • Uses GT4delegation service for security • Uses GSI enabled, private VNC for Graphical modules • Uses notifications mechanisms provides by GT4 for monitoring the execution

  8. WS-VLAM Introduction presentation WS-VLAM Engine: architecture Service host(s) and compute element(s) GT4 Java Container Job functions GRAM services RTSM Factory pre-ws-GRAM Client RTSM Instance Worker nodes Delegate Delegation service Workflow components

  9. WS-VLAM Introduction presentation A three step execution process • Step 1: Create Delegated Grid Credentials • Step 2: Instantiate the workflow components • Step 3: Monitor the workflow execution RTSM Factory RTSM Instance Workflow components Client Delegation Service GRAM Step 1 Step 2 Step 3

  10. WS-VLAM Introduction presentation Sequence-diagram WS-vlam Client GT4 Delegation Service RTSM Factory GT4 GRAM RTSM Instance 1. Create: delegation credential Step 1 Get the delegation credential EPR 2. Submit workflow execution plan 3. Create: RTSM instance Step 2 4. Create: RTSM instance Get the RTSM instance EPR 5. subscribe: to notification events Step 3 Get the notification events

  11. WS-VLAM Introduction presentation Current Setting… Not yet available Sara SRB UvA TUDELFT Server host Where the WS-VLAM engine is running DAS-3 Leiden University VU

  12. WS-VLAM Introduction presentation Step1: Create Delegated Credential Credential RP GT4 Service Container • Create delegated credential resource VLAM Client RTSM Factory. EPR GRAM • Credential EPR returned proxy Delegation • Initialize user proxy cert. Worker nodes EPR = End Point Reference

  13. WS-VLAM Introduction presentation Step 2: instantiates the workflow components and Create a RTSM instance Credential RP • Contact GRAM to instantiates the workflow components GT4 Service Container RTSM Factory. VLAM Client EPR • GRAM instantiates the workflow components • Request the creation RTSM instance • Pass delegated credential EPR GRAM RTSM Instance • RTSM instance EPR returned Delegation • Access delegated credential resource Worker nodes Workflow components Workflow components EPR = End Point Reference

  14. WS-VLAM Introduction presentation Step3: monitors the application workflow Credential RP GT4 Service Container • RTSM instance subscribes for notification events from GRAM and Workflow components RTSM Factory. VLAM Client Notification events GRAM RTSM Instance • GRAM and Workflow components generate events Delegation • Contact RTSM instance and subscribe for notification events Worker nodes Workflow components Workflow components

  15. WS-VLAM Introduction presentation Workflow components with graphical output Credential RP GT4 Service Container RTSM Factory. VLAM Client GRAM RTSM Instance RTSM Instance Delegation GUI proxy GSI enabled connection Worker nodes Workflow components Workflow components vnc server

  16. WS-VLAM Introduction presentation Support hierarchical workflows … • workflow components can be composed of a collection of other components • The advantage is now both the composition & the execution of complex workflows become easier

  17. WS-VLAM Introduction presentation Setting for distributed hierarchical workflows … Sara SRB UvA TUDELFT Server host Where the WS-VLAM engine is running Server host Where the WS-VLAM engine is running DAS-3 Leiden University VU

  18. WS-VLAM Introduction presentation Step2: instantiates the distributed workflow components & Create a RTSM instances GT4 Service Container GT4 Service Container EPR RTSM Factory RTSM Factory GRAM GRAM VLAM Client Distributed RTSM Distributed RTSM RTSM Instance RTSM Instance GUI proxy GUI proxy Data proxy Data proxy Worker nodes Worker nodes Workflow components Workflow components Workflow components Workflow components

  19. WS-VLAM Introduction presentation Step2: instantiates the distributed workflow components & Create a RTSM instances GT4 Service Container GT4 Service Container EPR RTSM Factory RTSM Factory GRAM GRAM VLAM Client Distributed RTSM Distributed RTSM RTSM Instance RTSM Instance GUI proxy Data proxy Data proxy GUI proxy Worker nodes Worker nodes Workflow components Workflow components Workflow components Workflow components

  20. WS-VLAM Introduction presentation Conclusions • WSRF compliant middleware such as GT4 offers useful basic services to develop a truly grid enabled workflow engine: • Delegation service & ws-notification mechanisms proved to be very useful • Separating the workflow composition from execution suits better the Grid environments

  21. WS-VLAM Introduction presentation Some References • Science Z Zhao, A Belloum, M Bubak Editorial: Special section on workflow systems and applications in e-Future Generation Computer Systems 25 (5), 525-527 • A. Wibisono, D. Vasyunin, V. Korkhov, AS.Z. Belloum WS-VLAM: a GT4 based workflow management system , The 2nd International Workshop on Scientific Workflows, In conjunction with ICCS 2007, Beijing, China, 2007 • A.S.Z. Belloum, V. Korkhov, S. Koulouzis, M. A Inda, and M. BubakCollaborative e-Science experiments: from scientific workflow to knowledge sharing JULY/AUGUST, IEEE Internet Computing, 2011 • IlkayAltintas, Manish Kumar Anand, Daniel Crawl, Shawn Bowers, Adam Belloum, Paolo Missier, Bertram Ludascher, Carole A. Goble, Peter M.A. Sloot, Understanding Collaborative Studies Through Interoperable Workflow Provenance, IPAW2010, Troy, NY, USA

  22. WS-VLAM Introduction presentation Some References • A. Belloum, Z. Zhao, and M. Bubak Workflow systems and applications , Future Generation Comp. Syst. 25 (5): 525-527 (2009) •  Z. Zhao, A.S.Z. Belloum, et al., Distributed execution of aggregated multi domain workflows using an agent framework The 1st IEEE International Workshop on Scientific Workflows, Salt Lake City, U.SA, 2007 • Zhiming Zhao, Adam Belloum, Cees De Laat, Pieter Adriaans, Bob Hertzberger Using Jade agent framework to prototype an e-Science workflow bus Authors Cluster Computing and the Grid, 2007. CCGRID 2007

  23. WS-VLAM Introduction presentation http://www.vl-e.nl/

More Related