1 / 22

Scientific workflow in Kepler – hands on tutorial

Scientific workflow in Kepler – hands on tutorial. Marcin Plociennik (PSNC) Tomasz Zok (PSNC) A. Gomez (CIEMAT). Agenda. Kepler overview Main Kepler's concepts (actors, directors, etc .) Serpens for Kepler Hands on tutorials http:// s erpens.psnc.pl/uf2011.

nicolegperez
Download Presentation

Scientific workflow in Kepler – hands on tutorial

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Scientific workflow in Kepler – hands on tutorial Marcin Plociennik (PSNC) Tomasz Zok (PSNC) A. Gomez (CIEMAT) EGI User Forum 2011

  2. Agenda • Kepler overview • Main Kepler's concepts (actors, directors, etc.) • Serpens for Kepler • Hands on tutorials http://serpens.psnc.pl/uf2011 EGI User Forum 2011

  3. What you should know after this tutorial • the general idea of Kepler • how to build simple workflows • how to build simple controls like loops • how to use grid actors EGI User Forum 2011

  4. About Kepler www.kepler-project.org • Scientific Workflow System • Builds upon the open-source Ptolemy II framework • Current release: 2.1 (past 2.0, 1.0 – May 2008), initiated 2003 • Allows scientists to visually design and execute scientific workflows • Actor-oriented model with directors acting as the main workflow engine • Enables different models of computation • Workflows are saved as XML files - can easily be shared/published • Kepler is supported by the NSF-funded Kepler/CORE team, which spans several of the key institutions that originated the Kepler project: UC Davis, UC Santa Barbara, and UC San Diego • useful across disciplines: Ecology, Engineering, Geology, Physics, ... EGI User Forum 2011

  5. About Kepler EGI User Forum 2011

  6. About Kepler • Kepler is a Java based tool for building and executing workflows • Kepler allows you to use existing elements • Kepler allows you to extend it by creating new elements • Kepler is an Open Source project (BSD License) • Kepler can support you with: • building and executing workflows • executing tasks locally • executing tasks within distributed environments • http://kepler-project.org EGI User Forum 2011

  7. How can I build workflow Kepler allows you to build workflows using standard elements: • Workflow • Director • Actor • Port • Relation EGI User Forum 2011

  8. Accessing workflow • Workflow allows to compose data flow between elements • Elements can be Dragged and Dropped into Workflow's area • After workflow is ready it can be started two ways: • directly from the GUI • from the command line EGI User Forum 2011

  9. Accessing workflow EGI User Forum 2011

  10. Accessing Actors and Directors • Available elements can be accessed through the component's browser • Elements can be Dragged and Dropped into Workflow's area • You can search for elements if you don't know theexact name of the component • You can add your own components into library EGI User Forum 2011

  11. Accessing Actors and Directors EGI User Forum 2011

  12. Accessing Supplementary Components • Components that bind all elements together are accessible from toolbar • Ports, relations, can be Dragged and Dropped into Workflow's area • You can easily Start/Stop workflow directly from the GUI using toolbar icons EGI User Forum 2011

  13. Accessing Supplementary Components EGI User Forum 2011

  14. Main components EGI User Forum 2011

  15. Directors • Directors are responsible for the orchestrationof the workflow. • Directors can provide various means of execution: • CT Director (Continuous Time) • DDF Director (Dynamic Data flow) • SDF Director (Sequential Data flow) • PN Director (Process Network) - parallel executions … EGI User Forum 2011

  16. Actors • Actors perform actions basing on input ports and parameters EGI User Forum 2011

  17. Actors • You can use already existing actors that are available within Kepler • You can import actors from the other sources into Kepler • You can develop your own actors and add them to the Kepler EGI User Forum 2011

  18. Concept of composite actor EGI User Forum 2011

  19. Composite actors • Composite actors allow to encapsulate workflows • Composite actors can be copy-pasted between workflows • Composite actors can be exported as components EGI User Forum 2011

  20. Serpens for Kepler • Serpens: • Actors, workflows, templates for using grid middleware: • gLite • Unicore • QCG • Accessing cloud: • OpenNebula • Amazon EC2 • Developed under EU FP7 Euforia project • Used by Fusion community • Support for new workflow scenarios as a part of SA3 http://serpens.psnc.pl EGI User Forum 2011

  21. User Forum 2011 Tutorial Survey Your feedback would be appreciated - please visit us on line at: https://www.egi.eu/online_surveys/index.html

  22. Thank you for your attention And now Let’s move to Hands on part http://serpens.psnc.pl/uf2011 EGI User Forum 2011

More Related