1 / 13

EOS Documentation and Tesla Data Box

This project focuses on the knowledge transfer and documentation of EOS, an open-source software product developed by CERN. It also includes the implementation of the Tesla Data Box for extendable storage solutions. The goal is to provide reliable documentation and real-world examples for EOS while enhancing the reliability and capacity of storage with the Tesla Data Box.

rmckenzie
Download Presentation

EOS Documentation and Tesla Data Box

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EOS Documentation and Tesla Data Box Gregor Molan Comtrade

  2. Background: EOS Productization Project Agreement • Comtrade is CERN openlab member • A special thanks to • Veselin Jevrosimović, owner and chairman of Comtrade • Alberto di Meglio, head of CERN openlab Phase 1: From 2015-2016 • First steps of CERN EOS knowledge gathering • EOS installation script Phase 3: From 2017-2019 • Knowledge transfer and merge of experiences between CERN and Comtrade • EOS documentation as a result of knowledge transfer • Full stack proof of concept (POC) • Support for EOS clients Phase 3: From 2017-2019 • Knowledge transfer and merge of experiences between CERN and Comtrade • EOS documentation as a result of knowledge transfer • Full stack proof of concept (POC) • Support for EOS clients • Phase 2: From 2016-2017 • Integration of COMTRADE engineers into the development and operations team at CERN • EOS installation script: Robust installation kit to allow rapid deployment of EOS • The continuous evolution of the testing, installation and documentation CERN EOS Workshop 2019-02-04

  3. Phase 3: Knowledge transfer Continuation of EOS research from 2015 Background knowledge • Comtrade Storage and Data Management (SDM) software development since 1990 • One of the largest SDM development labs • Comtrade processes for enterprise customers Knowledge transfer • Acquisition of the current EOS version • Acquisition of the current CERN procedures • Familiarity with the current CERN EOS team • Knowledge merge • Using of Comtrade SDM experiences The goal of knowledge transfer: Reliable and qualified Comtrade EOS team CERN EOS Workshop 2019-02-04

  4. Phase 3: EOS documentation The goal of knowledge transfer General background • Local installation of EOS at Comtrade • Deployment of EOS on Virtual Box • Deployment of EOS on Docker • One of the largest SDM development labs • Comtrade processes for enterprise customers Documentation background • Capture the list of EOS features • Create the high-level EOS picture • Propose the professional documentation format • Propose the documentation style The first goal for EOS documentation: Propose the professional documentation template CERN EOS Workshop 2019-02-04

  5. Phase 3: Full-stack proof of concept Why full-stack proof of concept Deployment of EOS at Comtrade • Documentation needs “screen shots” from full-stack installation • Documentation need to be updated with the latest features • To resolve conflicts with previous versions • Examples as “copy-paste” instructions The goal of full-stack deployment: Real-world documentation examples CERN EOS Workshop 2019-02-04

  6. EOS Documentation: List of EOS features Organization of EOS features as work packages • WP01 - MGM operations • WP02 - Fault tolerance and balancing • WP03 - Security and access • WP04 - Client access • WP05 - Geo-scheduling and Balancing • WP06 - Administration and deployment in large-scale environment • WP07 - EOS architecture from XRootD perspective • WP08 - Upgrades and Migration CERN EOS Workshop 2019-02-04

  7. The structure and style of professional documentation for EOS EOS: Documented open source software product • PDF documentation • A part of open source support • The final result of knowledge gathering CERN EOS Workshop 2019-02-04

  8. Documentation of EOS features The goal for documentation • Steps for features clarification • Description for Citrine EOS versions • Some distinction between EOS versions • Citrine • Aquamarine • Examples CERN EOS Workshop 2019-02-04

  9. Proposal for Tesla Data Box

  10. Comtrade Tesla Data Box powered by CERN Productization of CERN EOS • The complete storage solution • CERN EOS + Hardware + Support • High performance, High availability • Low-latency – the most important performance measure • World’s biggest disk-only storage: • 270 PB • Extendable disk storage • No real limits (currently 270 PB) • Current status • Proposal of configuration • Definition of open source licences • Definition of related licence institution • Proposed release • End of 2019 CERN EOS Workshop 2019-02-04

  11. Comtrade Tesla Data Box Tesla Box: New 4-dimensional extendibility Dimensions in tesseract (4-dimensional cube): • Extendable capacity • Add new Tesla Box FST to increase storage size • Extendable latency • Add new Tesla Box FST in RAID 6 • Extendable availability • Add new Tesla Box MGM and new Tesla Box FSTs in the same “Geo Location” • Extendable reliability • Add new Tesla Box MGM and new Tesla Box FSTs in a new “Geo Location” Solution for private storage (internally managed private cloud) CERN EOS Workshop 2019-02-04

  12. Tesla Box FST Tesla Box FST Tesla Box FST Tesla Box FST Tesla Box FST Tesla Box FST Comtrade Tesla Data Box: extendable reliability Geo Location 1 Geo Location 2 Tesla Box MGM Tesla Box MGM 4000 km CERN EOS Workshop 2019-02-04

  13. Comtrade EOS Team www.comtrade.com • Gregor Molan <Gregor@comtrade.com> • Branko Blagojević <Branko.Blagojevic@comtrade.com> • Ivan Arizanović <Ivan.Arizanovic@comtrade.com> Thanksfor the attention! CERN EOS Workshop 2019-02-04

More Related