1 / 16

Contents

Executing Workflow-Based Grid Applications with the Collaborative P-GRADE Portal Gergely Sipos 1 , Csaba Nemeth 1 , Gareth J. Lewis 2 , Vassil N. Alexandrov 2 ,Peter Kacsuk 1 , 1 MTA SZTAKI (Hungary) 2 University of Reading (UK). Contents. Need for c ollaborative grid applications

amelia-shelton
Download Presentation

Contents

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Executing Workflow-Based Grid Applications with the Collaborative P-GRADE PortalGergely Sipos1, Csaba Nemeth1, Gareth J. Lewis2,Vassil N. Alexandrov2 ,Peter Kacsuk1, 1MTA SZTAKI (Hungary)2University of Reading (UK) UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  2. Contents • Need for collaborative grid applications • Our proposed concept • Implementation: Collaborative P-GRADE Portal • Workflow execution in single-VO environment • Workflow execution in multi-VO environment • Conclusions UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  3. How to develop them? Programming the Grid • Grid – a highly complex infrastructure • Different types of services  multiple APIs • Multiple VOs  Different certificates • Concurrency, transactions, etc. • Only complex applications can efficiently utilize the Grid. UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  4. Programming the Grid collaborativelyCurrent collaborative environments Grid programmingenvironment Grid infrastructure UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  5. Programming the Grid collaborativelyCurrent collaborative environments • Application development: • Centralised  information pieces must be collected • Application execution: • Centralised  responsibility is taken by a single person Grid programmingenvironment Grid infrastructure UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  6. Programming the Grid collaborativelyOur proposed solution Grid programmingenvironment Grid infrastructure UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  7. Collaborative Grid Portals • Concurrent development of Grid applications • Collaborative execution of Grid applications share responsibility! UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  8. The Collaborative P-GRADE Portal Workflow development GSI Globus GridFTP Globus GRAM Globus MDS Mercury monitor(GridLAB) Workflow execution GEMLCA(Uni. Of Westminster) User Portal server Grid services UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  9. A Collaborative P-GRADE Portal workflow • The workflow is a graph where • Nodes are jobs (or services) • Arcs represent file transfer between the jobs (services) • Semantics of the workflow enables two levels of parallelism: • Parallel execution inside a workflow node • Parallel execution among workflow nodes • The portal server contains a DAGMan-based workflow manager: • File transfer • Job submission (service invocation) Jobs can be parallel UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  10. The result of collaborative workflow development • Workflow definition <workflow name=…> <node name=„delta”…> <port type=…> … </workflow> • Contribution table All these properties can be defined by different users Each workflow component has several properties UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  11. Sharing responsibilities 1:Accessing files WF manager: Whose proxy to use to access a file? • The only rational answer: the proxy that belongs to the user who defined the file location. • If the source and target files were defined by different users transfer the file through the portal server indirectly UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  12. Sharing responsibilities 2:Submitting jobs – single VO case WF manager: Whose proxy to use to submit a job? • If the Portal is connected to a single VO: • Every portal user is allowed to submit jobs to any of the resorces  several possible answers • The developer of the binary executable • The provider of the input parameters • Etc. • P-GRADE Portal: the proxy that belongs to the user who defined resource for the job(no brokering!) UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  13. Sharing responsibilities 3:Submitting jobs – multi VO case WF manager: Whose proxy to use to submit a job? If the Portal is connected to multiple VOs: • Different collaborative users may have access to different resources • the only rational answer:the proxy that belongs to the user who defined resource for the job(no brokering!) UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  14. Download proxies MyProxy server MyProxy server MyProxy server P P P P P P P P P P P P Multi-Grid execution P-GRADE Portalserver VO 1 VO 2 VO 3 UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  15. Conclusions • Collaborate through Grid applications! • The Collaborative P-GRADE Portal is the first implementation of the concept: • Workflow applications • Execution in Globus Grids • Multi-VO access • Prototype version, release in 2006 • Non collaborative version is already connected to the UK NGS: www.cpc.wmin.ac.uk/ngsportal/gngsportal/index.php UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

  16. Thank you for your attention! Questions… sipos@sztaki.huwww.lpds.sztaki.huwww.cpc.wmin.ac.uk/ngsportal/gngsportal/index.php P-GRADE NGS GEMLCA Portal Demo6pm, booth of Grid Operations Support Centre UK e-Science All Hands Meeting, Nottingham, 19-23. September, 2005

More Related