1 / 17

INCD - National Distributed Computing Infrastructure: Services for Science and Education

INCD provides a distributed computing infrastructure with services for computation, storage, and data processing. It aims to foster resource sharing and interoperable solutions for the scientific and academic community.

blacka
Download Presentation

INCD - National Distributed Computing Infrastructure: Services for Science and Education

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. INCD Computação para a Ciência e para o Ensino

  2. Infraestrutura Nacional de Computação Distribuída Serviços: computação, armazenamento e processamento dados Fomentar: partilha de recursos, soluções comuns interoperáveis Alvo: comunidade científica e académica, infraestruturas, projectos Interface: com infraestruturas Europeias (EGI, IBERGRID, WLCG, EUDAT)

  3. Aproximação integrada INCD – Infraestrutura Nacional de Computação Distribuída 3

  4. Cloud e Farm HPC/HTC • INCD IaaS cloud (CPU*horas): • Serviços longas duração • Portais e serviços web • Big data • Processamentos especificos INCD farm (CPU*HS*horas): • Computação avançada Concurso internacional: • INCD nós de computação • INCD armazenamento • INCD rede de dados Novo equipamento Utilização Normalizada

  5. Utilizadores • > 44 centros de investigação e infraestruturas • Áreas • Ciências da vida • Saúde • Física • Química • Ciências dos materiais • Engenharia mecânica • Ambiente e modelação costeira • Ciências da computação • Inteligência artificial • Agronomia • Biodiversidade • Ciências do mar • Economia • Sociologia e psicologia • Nanotecnologia • Alterações climáticas • Ecologia INCD – Infraestrutura Nacional de Computação Distribuída

  6. Cloud Computing GBIF • The Global Biodiversity Information Facility (GBIF) is an international network and research infrastructure funded by the world’s governments and aimed at providing anyone, anywhere, open access to data about all types of life on Earth. • GBIF nodes in Portugal and Spain are maintained in the scope of LifeWatch and IberLife and these activities are supported by IBERGRID. • dados.gbif.pt  INCD • datos.gbif.es Supported by IBERGRID Cloud resources Iberian Distributed Computing Infrastructure

  7. OPENCoastS.pt High Performance Computing • On-demand circulation forecast systems for European coastal areas. • Generates daily forecasts of water levels, vertically averaged velocities and wave parameters over the region of interest for 48 or 72 hours • Numerical simulations of all physical processes with the SCHISM model. • Forcings are provided by: • NOAA / GFS • MétéoFrance • PRISM2017 • FES2014. • Tide gauge data: • EMODnet Physics • LNEC with INCD and LIP

  8. Worldwide LHC Computing Grid High Throughput Computing Portuguese participation at CERN/LHC implies contribution to the global simulation and reconstruction effort. LHC Computing MoU. With derivate products + simulation 80 PB/year RAW data • 50 PB/year 42 countries170 centres 2 million jobs/day Through INCD the Portuguese WLCG Tier-2 center supports the LHC Computing MoU, but need more resources: • opportunistic use of compute resources • officially supported by WLCG for certain workloads

  9. Worldwide LHC Computing Grid 2018 5,885,113,706 horas 2027 storage increase 18x CPU capacity increase 60x

  10. HPC e HTC • Cluster • Batch system • Nós computação • GPUs • Acesso • Login nodes • Containers • udocker • singularity • Software • Conjunto alargado • Nós de computação • 192GB RAM + 24 COREs • 512GB RAM + 24 COREs • 384GB RAM + 64 COREs • 24 GB RAM + 8 COREs • Armazenamento • Lustre • CVMFS para software • Rede • Ethernet • Baixa latência Infiniband • Integração • EGI, EOSC, IBERGRID e WLCG INCD – Infraestrutura Nacional de Computação Distribuída

  11. Cloud OpenStack • Virtualização • KVM • LXD • Containers • GPUs • Cloud APIs • OS, EC2 • swift, S3 • HEAT, CF, TOSCA • Acesso • CLI • dashboard • Nós de computação • 192GB RAM + 24 COREs • 512GB RAM + 24 COREs • 384GB RAM + 64 COREs • 24 GB RAM + 8 COREs • Armazenamento • Ceph para cloud block e objetos • Rede • Virtualizada VLANs e encapsulamento • Acesso a VLANs com opção de SRIOV • Baixa latência Infiniband • Integração • EOSC, EGI e IBERGRID INCD – Infraestrutura Nacional de Computação Distribuída

  12. EGI and IBERGRID • 4.4 Billion CPU core wall time (2018) • 4.4 Billion CPU core wall time (2018) • EGI federation of European national infrastructures • Integrating computing and data resources • INCD participates in EGI • IBERGRID Iberian distributed computing infrastructure • PT + ES in EGI as IBERGRID • > 1 Million computing cores in 2019 • > 740 PB disk & tape IFCA USC CESGA IFAE PIC UPORTO UAM CIEMAT CETA-GRID UPV IFIC NCG www.ibergrid.eu

  13. Ligaçõesnacionais e internacionais European Open Science Cloud A cloud for research data in Europe RNCA + RICA INCD – Infraestrutura Nacional de Computação Distribuída

  14. www.incd.pt helpdesk@incd.pt ObrigadO. INCD – Infraestrutura Nacional de Computação Distribuída

  15. Disk storage cost evolution Computing cost evolution 900PB/year in 2027

More Related