1 / 15

DAaaS: Data Analysis as a Service

DAaaS: Data Analysis as a Service. Jeremy Spencer jeremy.spencer@stfc.ac.uk Scientific Computing Department. Data Analysis as a Service. A generic platform for simulation, modelling and analysis of scientific data Brings together Software Data Compute. RAL. Three major facilities: ISIS

mashby
Download Presentation

DAaaS: Data Analysis as a Service

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. DAaaS:Data Analysis as a Service Jeremy Spencer jeremy.spencer@stfc.ac.uk Scientific Computing Department

  2. Data Analysis as a Service • A generic platform for simulation, modelling and analysis of scientific data • Brings together • Software • Data • Compute

  3. RAL • Three major facilities: • ISIS • Diamond • CLF SCD Diamond CLF ISIS

  4. The Facilities • ~10,000 scientists per year • Lots of different scientific techniques • May use multiple instruments and facilities • Data sizes from 1MB to many TB

  5. Experiment Life Cycle

  6. Aims • Improve the scientific output of the facilities • Decrease time to publication • Increase percentage of published experiments • Simplify deployment of new workflows • Simplify development of new innovations • Simplify data analysis process for users and developers

  7. METADATA INTERFACE USERS IDENTITY SOFTWARE COMPUTE DATA

  8. User Experience

  9. User Experience

  10. User Experience

  11. Demo https://isis.analysis.stfc.ac.uk/

  12. Currently • Provides customised VMs to ISIS science groups for interactive analysis • Uses SCD Openstack Cloud • ISIS Science groups: • In operation: Excitations, WISH • In development: Muon, Tomography • Next: Reflectometry, Disordered Materials, Engin-X • VM Flavours: • WISH: • 8 CPU, 32GB RAM, GPU • 14 CPU, 128GB RAM, GPU • Excitations: • 8 CPU, 32GB RAM • 8 CPU, 32GB RAM, GPU • 30 CPU, 90GB RAM

  13. Operational Status • Current ISIS Cycle • 5th February to 29th March • Over 30 VMs in concurrent use • Support team available to users from 9 to 5 • Future cycles • Increasing number of users as DAaaS takes on more groups • 24/7 Support

  14. 2019 Projects • Usage statistics • New front end • System hardening • More science groups in operation • Deployment of Virtual Machine Manager • Exploring use of other cloud resources • Other Openstack instances (IRIS resources) • AWS • Google Cloud Platform

  15. Any Questions? Jeremy Spencer jeremy.spencer@stfc.ac.uk Scientific Computing Department

More Related