1 / 15

From P-GRADE to SCI-BUS

From P-GRADE to SCI-BUS. Peter Kacsuk, Zoltan Farkas and Miklos Kozlovszky MTA SZTAKI - Computer and Automation Research Institute of the Hungarian Academy of Sciences. www.lpds.sztaki.hu. Content. P-GRADE WS-PGRADE & gUSE in a nutshell Basic and new services Case studies SCI-BUS

zocha
Download Presentation

From P-GRADE to SCI-BUS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. From P-GRADE to SCI-BUS Peter Kacsuk, Zoltan Farkas and Miklos Kozlovszky MTA SZTAKI - Computer and Automation Research Institute of the Hungarian Academy of Sciences www.lpds.sztaki.hu

  2. Content • P-GRADE • WS-PGRADE & gUSE in a nutshell • Basic and new services • Case studies • SCI-BUS • How to access

  3. HP-SEE P-GRADE Portals around the globe • National Grid portals (UK, Ireland, Croatia, Turkey, Spain, Belgium, Malaysia , Kazakhstan, Switzerland, Australia, ClGrid, etc.) • HP-SEE/SEE-GRID-SCI, BalticGrid • US Open Science Grid, TeraGrid • IDGF (International Desktop Grid Federation) • SHIWA Simulation Platform • Economy-Grid, Swiss BioGrid, Bio ésBiomed Virtual Organisations, MathGrid, etc.

  4. 2011 2010 2009 2008 Open source from 2008 stats: P-GRADE Portal software family P-GRADE Portal 2.4 GEMLCA Grid Legacy Code Arch. P-GRADE Portal 2.5 NGS P-GRADE portal GEMLCA, storage concepts P-GRADE Portal 2.8 Basicconcepts WS-PGRADEPortal 3.1 P-GRADE Portal 2.9.1 WS-PGRADEPortal 3.2 P-GRADE Portal 2.10 WS-PGRADEPortal 3.3

  5. Motivations of creating gUSE • To overcome (most of)the limitations of P-GRADE portal: • To provide better modularity  to replace any service • To improve scalability  to millions of jobs • To enable advanced dataflow patterns • To interface with wider range of resources • To separate Application Developer view from Application User view WS-PGRADE (Web Services Parallel Grid Runtime and Developer Environment) and gUSE (Grid User Support Environment) architecture

  6. gUSE and WS-PGRADE architecture Graphical User Interface: WS-PGRADE Gridsphere  LIFERAY Large set of portlets gUSE Filestorage Workflowstorage Filestorage gUSEinformationsystem Autonomous Services: high level middleware service layer WorkflowEngine Applicationrepository Submitters Submitters Submitters Submitters Meta-broker Logging Resources: middleware service layer Local resources, service grid VOs, Desktop Grid resources, Web services, Databases

  7. WS-PGRADE/gUSE • Creating complex workflow and parameter sweeps • Seamless access to various types of resources • clusters, • service grids, • desktop grids, • databases. • Scalable architecture • Advanced data-flows and workflow concept • Creating complex applications using embedded workflows, legacy codes • Comfort features • Separated views for application developers and end-users • Community components from workflow repository www.wspgrade.hu

  8.              WS-PGRADE in a nutshell • General purpose, workflow-oriented portal. Supports the development and execution of workflow-based applications • Based on Liferay • Services supported by the portal: • New functionalities • Web services • DB connectors • Embedded workflows • Job level PS • Conditional jobs • Recursive graph • Multi-generator • Multi-collector • CROSS product PS • DOT product PS             Simultaneous use of various clusters, service and desktop Grids at workflow level

  9. WS-PGRADE in European and national projects • CancerGrid (EU FP6) • ProSim (UK) • EDGeS and EDGI (EU FP7) • MosGrid (D-Grid) • Swiss Proteomics Portal • HP-SEE (EU FP7) • SHIWA (EU FP7) • SCI-BUS (EU FP7)

  10. The CancerGrid portal for anti-cancer drug research Workflow execution Workflow development & configuration Integrated components of CancerGrid portal Algorithms configuration Molecule database browser Structure viewer

  11. SHIWA VO SHIWA Science Gateway local cluster Globus DCI gLite DCI SHIWA Portal SHIWA Repository WF1 WFn Triana WE search WF GEMLCA admin Taverna WE s1 MOTEUR WE WF1 WFm s2 WE1 WEp WF list ASKALON WE Kepler WE edit WF GEMLCA Repository s2 PGRADE Workflow editor ASKALON WE MOTEUR WE GWES WE s4 WE + WF e-scientist s3 PGRADEWorkflow engine GEMLCA with GIB pre-deployed-WEs s5 invoke WE GEMLCA Service SHIWA Simulation Platform v1 (P-GRADE) and v2 (WS-PGRADE) Creating multi-workflow applications and executing them in the multi-middleware SHIWA VO

  12. WS-PGRADE and SCI-BUS • P-GRADE and WS-PGRADE has been developed in the framework of EU and Hungarian projects • This tradition will be followed in SCI-BUS • The major goals: • To further develop WS-PGRADE/gUSE • To develop customization methodology • To create production gateways both • Generic-purpose gateways for NGIs • Customized gateways for at least 17 user communities

  13. Portal Access • Portal related information • www.wspgrade.hu • Access to multi-grid environment • WS-PGRADE/gUSE portal • https://guse.sztaki.hu/liferay-portal-6.0.5/ • For application porting • GASUC (Grid Appl. Support Centre) success stories • http://www.lpds.sztaki.hu/gasuc/ • Interoperable workflow and DCI support • SHIWA Simulation platform • http://www.shiwa-workflow.eu GASUC

  14. Thank you for your attention! Questions? kacsuk@sztaki.hu www.lpds.sztaki.hu

More Related