1 / 11

STFC Cloud Introduction

STFC Cloud Introduction. Alexander Dibbo. STFC Cloud. Delivers dynamic compute resources to scientists across STFC and externally Works closely with other services run by SCD, in particular the Storage team, the WLCG Tier 1 and the facilities programme. World. What, Who, Why?. LSST. EUCLID.

elionel
Download Presentation

STFC Cloud Introduction

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. STFC Cloud Introduction Alexander Dibbo

  2. STFC Cloud • Delivers dynamic compute resources to scientists across STFC and externally • Works closely with other services run by SCD, in particular the Storage team, the WLCG Tier 1 and the facilities programme

  3. World What, Who, Why? LSST EUCLID AENEAS UKAEA STFC ISIS DLS Technology SCD PPD H2020 SCD Cloud CLF Other cloud providers, incl. IRIS and commercial IDAaaS UKATC DAFNI-a DAFNI-b UKT1-a ASTEC Hartree RALSpace UKT1-b Jasmin SCARF

  4. The Core (SCD) Cloud team • Architect/Team Leader - Alex Dibbo • Production/Fabric - Martin Summers • Image management and development – Apprentice • Operational Software - Graduate

  5. User Support • User ticketing system • Jiscmail mailing list: https://www.jiscmail.ac.uk/cgi-bin/webadmin?A0=STFC-CLOUD • STFC Cloud slack: https://Stfc-cloud.slack.com • Regular user forum • SCD Cloud core team + all community/dept. expert “Cloud Sysadmins” • Also open to all interested end users • Key, two way communication channel • Scalable user support model • Requires (appropriate fraction of an) expert “cloud Sysadmin” for each dept. or user community. Each “cloud Sysadmin”: • Is provided or funded by joining user community (training provided if required) • An essential local expert who understands their community (and speaks their language) • A single POC for small SCD Cloud core team • A key two-way communication channel between users and cloud team

  6. World User Support Model LSST EUCLID AENEAS UKAEA STFC ISIS DLS Technology Warren Jeffs SCD PPD H2020 SCD Cloud CLF Other cloud providers, incl. IRIS and commercial SCD Core Team Alex Dibbo Martin Summers Apprentice Graduate IDAaaS UKATC DAFNI-a DAFNI-b UKT1-a ASTEC Hartree RALSpace UKT1-b Jasmin SCARF

  7. Technical Summary • The Cloud is an infrastructure as a service platform based on OpenStack • Provides ~ 4000 cores of compute capacity (increasing to ~ 8000 in Q2). • Offers ~ 150TB of useable storage for VMs and scratch space (increasing to 750TB in Q3) • Up to 25gb networking is available to VMs • VMs can be created in various sizes depending on requirements.

  8. Cloud Architecture • Endpoints sit behind a pair of load balancers with at least three instances of each service • 3 node Galera MariaDB cluster • 3 node RabbitMQ cluster • KVM/QEMU tuned as far as possible without compromising manageability • Underlay network is a routed leaf-spine network • Ceph for Virtual Machine storage and volumes. • Flat and project networks are available • DVR is used for VM connectivity • GPUs are in use

  9. Components Deployed • Keystone • Nova • Neutron (currently six instances on neutron-server to support DVR load) • Glance • Cinder • Heat • Rally

  10. Future plans • Additional capacity deployment in the next couple of months (brings total to ~8000 cores) • Procurement later this year for further capacity • About to buy physical DB cluster, network nodes and physical service nodes • Deployment of Manilla (led by storage team), deployment of Magnum, LBaaSv2, Aodh and Gnocci (or monasca), Murano

  11. Any Questions?

More Related