1 / 20

CloudBroker Platform Presentation

CloudBroker Platform Presentation. Wibke Sudholt CloudBroker GmbH Technoparkstrasse 1, CH-8005 Zurich, Switzerland Phone: +41 44 633 79 34 Email: wibke.sudholt@cloudbroker.com Web: http://www.cloudbroker.com. CloudBroker Platform.

csilla
Download Presentation

CloudBroker Platform Presentation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CloudBroker Platform Presentation Wibke Sudholt CloudBroker GmbH Technoparkstrasse 1, CH-8005 Zurich, SwitzerlandPhone: +41 44 633 79 34Email: wibke.sudholt@cloudbroker.comWeb: http://www.cloudbroker.com

  2. CloudBroker Platform • Web application store for the deployment and execution of scientific and technical software in the cloud • On demand, pay per use, browser / programmatic / command-line access, cross-domain • Uses infrastructure as a service (IaaS) from cloud providers • Offers platform as a service (PaaS) for software vendors and software as a service (SaaS) for end users • Easy to use, speeds up time to market, no need for own high performance computing infrastructure, OpEx instead of CapEx

  3. Platform Architecture End Users, Software Vendors WebBrowserUI CLI Java Client Library User Tools REST Web Service API CloudBroker Platform CloudBroker Integration HealthAppli-cations EngineeringAppli-cations ChemistryAppli-cations BiologyAppli-cations …Appli-cations …Cloud AmazonCloud IBMCloud

  4. Platform Functionality Tools Users Security Frame: Transport Layer Security, Access Rights Security Web Browser UI Web Service API Process Manager Application Manager User Manager Accounting Module Billing Module Payment Module Process Monitor Queuing System Resource Manager Storage Manager Image Manager Scalability and Fault Tolerance Handler Cloud Provider Access Manager IBM Adapter AmazonAdapter …Adapter …Cloud AmazonCloud IBMCloud

  5. Platform Security Corporate IT Corporate Security Policies and Standards Customer Client Browser or Application SSL Secured Connection CBP . Authentication Industry Standard Server Security Technology Industry Standard Secure Data Center CloudBrokerPlatform Industry Standard Application Security Technology CloudBroker SSL Secured Connection SSL secured connection Authentication to Cloud CBP . Authentication to VM Security Certified Compute and Storage Cloud Technology Security Certified Data Center CloudInstances Dedicated, Secured and Restricted Virtual Machines Cloud Provider

  6. User Management • User roles: admin, advanced, standard • Software visibility: private, protected, public

  7. Typical JobSubmission Lifecycle • Prepayment (user) or monthly invoice (platform) • Software and resource selection and job creation (user) • Data file upload (user) to cloud storage (platform) • Job submission (user) • Compute instance startup or reuse (platform) • Data file upload from cloud storage to master node (platform) • Computations on worker nodes (platform, application) • Data file download from master node to cloud storage (platform) • Compute instance shutdown or reuse (platform) • Data file download (user) from cloud storage (platform) • Accounting and billing (platform)

  8. Dynamic Cluster in the Cloud • Communication to and between nodes via SSH • Instance information in dynamically generated node file (MPICH / MPICH2 / Open MPI format, more formats can be added upon request) • File sharing via NFS can be enabled

  9. Application Requirements

  10. Ported Applications More applications continuously to be addedApplications can also be added by users

  11. Typical SoftwareDeployment Lifecycle • Generation of installation script (vendor) • Creation and configuration of software (vendor) • Adding of executables (vendor) • Adding of installation package (vendor), including installation script and software package, if needed • Deploying of software (vendor) • Checking of software and installation script (manager) • Generation of deployments (manager) • Running of special deployment jobs (platform) • Checking and activation of deployments (manager) • Activation of software (manager/vendor) • Publication of software (vendor) • Running of jobs (user)

  12. Clients and APIs

  13. Public Platform • https://platform.cloudbroker.com • First preview version published in fall 2010, current version 1.0.4 • Available clouds: • Amazon EC2 and S3 (computing and storage) • IBM SmartCloud Enterprise (only computing currently, storage upcoming) • Available applications: • BLAST, AutoDock, Gromacs, X! Tandem, OpenFOAM • Additional applications privately or upon request • Software checking before deployment • Standard pricing: • Cloud resource costs + software costs + CloudBroker surcharges • Production version, monitored and maintained • Help desk under platform@cloudbroker.com • Also available as hosted and in-house version

  14. Protein Modelling Example Case • Setup: • Collaboration between IBM, CloudBroker and the Institute of Molecular Systems Biology (IMSB) at ETH Zurich • Goal is to better understand the mechanisms of infectious diseases • For the example of the Strepto-coccus bacterium, predict the 3D structures of important proteins from their 1D sequences by means of the Rosetta software • Use the CloudBroker Platform to manage the calculations on top of IBM SmartCloud Enterprise compute and storage resources • Results: • 249 target proteins modeled • More than 1’000 CPUs used in parallel • 36’000 jobs automatically managed • Almost 250‘000 CPU hours consumed • 2.3 Mio 3D protein structure models created • Less than two weeks runtime

  15. Further Examples • ASCOMP TransAT (http://www.ascomp.ch) • Computational fluid dynamics • Collaboration with HSR • Microsoft Silverlight-based web browser UI • KNIME (http://www.knime.org) • Konstanz Information Miner • Workflow framework • Computational chemistry example case • SCI-BUS (http://www.sci-bus.eu) • SCIentific gateway Based User Support • EU FP7 project • 11+6 user communities from different domains

  16. CloudBroker in SCI-BUS

  17. Goals in SCI-BUS • Provide connection to open and commercial cloud infrastructures for the scientific gateways • Allow scientific gateways to charge for their services via the CloudBroker Platform • Integrate CloudBroker Platform as new distributed computing infrastructure (DCI) in WS-PGRADE / gUSE

  18. Features to Be Implemented • Already available: • Development and testing platform for SCI-BUS • Extended CloudBroker Platform REST and Java APIs • Integration of CloudBroker Platform in WS-PGRADE / gUSE under DCI Bridge, security and job settings • Possibility to configure and run CloudBroker jobs from within WS-PGRADE / gUSE workflows • In preparation: • Commercial components in WS-PGRADE / gUSE for user mapping, billing and cost display • Possibility to register own cloud resources in the CloudBroker Platform • Adapters to open cloud infrastructures (OpenStack, OpenNebula, Eucalyptus)

  19. Acknowledgements • CloudBroker GmbH: • Maxim Malgin, Ann Mikhailova • ScaleTools AG: • Nicola Fantini, Andrey Sereda • MTA SZTAKI: • Peter Kacsuk, Zoltan Farkas, Akos Hajnal • … and many others

  20. Thank you! Questions? Please add yourself to the tutorial user list!

More Related