1 / 14

HNSciCloud Status

HNSciCloud aims to provide a hybrid cloud platform that combines services at the IaaS level to support scientific workflows for the European research community. This platform will increase analysis capability and capacity to keep up with the growth in scientific data.

gjustice
Download Presentation

HNSciCloud Status

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. HNSciCloud Status HEPiX Madison May 2018 Andreas PetzoldKIT Slides Curtesy of Bob Jones & Joao Fernandes

  2. HNSciCloud To provide a common cloud platform for the European research community Collectively the buyers group need a means to increase the analysis capability and capacity offered to their users to keep pace with the growth in scientific data that needs to be analysed Andreas Petzold, KIT

  3. Helix Nebula Science Cloud Joint Pre-Commercial Procurement • Procurers: CERN, CNRS, DESY, EMBL-EBI, ESRF, IFAE, INFN, KIT, STFC, SURFSara • Experts: Trust-IT & EGI.eu • The group of procurers have committed • Procurement funds • Manpower for testing/evaluation • Use-cases with applications & data • In-house IT resources • Resulting services will be made available to end-users from many research communities • Co-funded via H2020 Grant Agreement 687614 Total procurement budget >5.3M€ Andreas Petzold, KIT

  4. What is being procured A hybrid cloud platform for the European research community Combining services at the IaaS level to support science workflows The R&D services to be developed are to be integrated withResources in data centres operated by the Buyers Group,GEANT network and eduGAIN fed. identity mgmt Source: CloudComputing for Govies, DLT Solutions,David Blankenhorn, Van Ristau and Caron Beesley HNSciCloudPCP Andreas Petzold, KIT

  5. Challenges Innovative IaaS level cloud services integrated with procurers in-house resources and public e-infrastructure to support a range of scientific workloads • Compute and Storage • support a range of virtual machine and container configurations including HPC working with datasets in the petabyte range accessible transparently • Network Connectivity and Federated Identity Management • provide high-end network capacity via GEANT for the whole platform with common identity and access management • Service Payment Models • explore a range of purchasing options to determine those most appropriate for the scientific application workloads to be deployed Andreas Petzold, KIT

  6. The Hybrid Cloud Model Brings together research organisations, data providers, publicly funded e-infrastructures, commercial cloud service providers In a hybrid cloud with procurement and governance approaches suitable for the dynamic cloud market In-house Andreas Petzold, KIT

  7. Use cases • As diverse as stake holder group and evolving • Classic HEP jobs for LHC experiments and others • HPC for photon science & accelerator simulation • Image processing for CTA • Genomics & Pan-Cancer • Containerized SWAN&EOS • Machine Learning with GPUs • Transparently and dynamically extending existing batch resources into the cloud with HTCondor Andreas Petzold, KIT

  8. HNSciCloud project phases 4 Designs 3 Prototypes 2 Pilots Tender Jul’16 Call-off Feb’17 Call-off Dec’17 Dec’18 Jan’16 Each step is competitive - only contractors that successfully complete the previous step can bid in the next Phases of the tender are defined by the Horizon 2020Pre-Commercial Procurement financial instrument Andreas Petzold, KIT

  9. Phase 3: Pilot Platform WP5 WP6 ScalabilityTesting END USERS Andreas Petzold, KIT

  10. IaaS Cloud Providers • T-Systems “Open Telekom Cloud • OpenStack • RHEA • Nuvla Portal • 3cloud providersT-SystemsExoscaleAdvania Andreas Petzold, KIT

  11. Current Technical Challenges • Transparent Data Access • Only one remaining solution: OneData • OneData experience in buyers group is mixed • Multi-Cloud behind a single portal • Another API on front of well known APIs • Split of resources between clouds Andreas Petzold, KIT

  12. Additional research orgs. Growing the buyers group Gov. agencies Private sector Procuring beneficiaries of EC project The initial group of buyers is the set of research orgs. that committed their resources at the start of the project and became beneficiaries of the EC project Goal is to progressively grow the buyers group by including more publicly funded research organisations: Earlyadopter group Document describesbenefits for the stakeholders,procurement process,steps for implementation Adopter Group CERN, DESY, EMBL-EBI, ESRF, KIT, CNRS, INFN, PIC-IFAE, SURFsara, STFC http://www.hnscicloud.eu/publications/reports/the-hnscicloud-adopter-group Andreas Petzold, KIT

  13. Conditions of access R&D • Adopters sign a contract with the service providers • Consider the service as a commodity – Adopter use cases to be satisfied without requiring additional R&D from the providers • Services delivered in compliance with the HNSciCloud Cloud Services Agreement • Adopters will be requested to share their experiences and acknowledge support of the project Andreas Petzold, KIT

  14. UpcomingEvents • June 5th: ELIXIR All-Hands-On Berlin [organised by EMBL] • June 13th-14: HNSciCloud M-PIL-3.2 progress review Geneva [organised at CERN] • July 9-13: CHEP 2018 Sofia [presentation CERN and cloud providers] • August 28-30: GridKa School Karlsruhe [Hands-On session organised by KIT] • September 11: HNSciCloud M-PIL-3.3 progress review Amsterdam [organised by SURFsara] •  October 9-11: DI4R 2018 Lisbon [CERN participation] • October 24th, Hamburg [organised by DESY] • November 28th-30th: HNSciCloud M-PIL-3.4 - End of Phase review Geneva [organised at CERN] • December 4-6: ICT 2018, Vienna [CERN participation]  Andreas Petzold, KIT

More Related