1 / 30

LIP Computing Activities

Learn about LIP's computing activities, distributed computing, digital infrastructures, IT services, R&D projects, and more.

cseabrook
Download Presentation

LIP Computing Activities

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. LIP Advisory 2019 LIP Computing Activities

  2. Organizational Structure (teams) • Distributed Computing and Digital Infrastructures • Lisbon (10x LIP staff + 5x ext collaborators)  J.Gomes • Scientific computing services for LIP users and projects • Digital infrastructures (WLCG, INCD, EGI, IBERGRID, EOSC) • R&D projects (DEEP, EOSC-hub, EOSC-synergy, …) • Institutional and administrative IT services • Web development and graphic design • Advanced Computing • Minho (1x LIP researcher + 2x MSc + 3x ext collaborators)  A.Pina • Software for HEP, development and optimization • ATLAS High-Level Trigger algorithms for GPGPU • Academic and technical training in scientific computing • Local computer infrastructure administration • Understanding Big Data in HEP (POCI-01-0145-FEDER-029147)

  3. Web & design • Intensively supporting • Organization events • Outreach • Social networks • Web pages • Web applications • Newsletters • Reports • Multimedia • Seminars broadcasting

  4. LIP IT services • LIP general • SSO, AAI & Edugain • WAN infrastructure • Eduroam • Mail • Central backups • Administrative servers • Heavy compute and data services (on top of INCD) • LIP Lisbon • Home directories • Data storage • Login servers • Desktops & Laptops • Printers • LAN

  5. WLCG Tier-2 • CPU time delivered to ATLAS and CMS within pledge Portugal — Total number of jobs by Tier 2 Federation and Month (LHC VOs) Upgrade • 68,274,317 normalized HS • 803,894 jobs • 8,513,007 hours In 2018: 5

  6. Organizational evolution • INCD • 4x INCD staff under LIP coordination • IT services for the research and academic communities • Heavy computing and data processing • Digital infrastructures • Tier-2 and LIP computing farm • Legal entity: non-profit association • Partners: LIP, FCT-FCCN, LNEC Spin-off • LIP Distributed Computing and Digital Infrastructures group • 10x LIP staff based in Lisbon • LIP IT services • Web and design • R&D projects • Digital infrastructures

  7. INCD - InfraestruturaNacional de ComputaçãoDistribuída Services: computing, storage and data processing Promote: resource sharing, common interoperable solutions Target: scientific and academic community, R&D projects Interface: with international e-infrastructures (WLCG, EGI, IBERGRID, ESFRIs) INCD is a partnership between: LIP, FCT-FCCN and LNEC

  8. INCD - InfraestruturaNacional de ComputaçãoDistribuída • Roadmap proposal submitted Sep 2013 6M€/6years • Roadmap proposal approved Feb 2014 6M€/6years • Project submitted to P2020 Mar 2016 3M€/3years • Project started Jul 2017 3M€/3years • Funding arrived Dec 2017 • 1st EU public tender launched May 2018 • 1st Computing equipment Jan 2019 • 1st Storage Equipment May 2019 3 years delay INCD: (2017-2020 possibly extended to 2021) 1.5M€ for equipment insufficient

  9. IT infrastructure • FCCN datacenter • Main computing farm & WLCG Tier-2 • OpenStack IaaS cloud • University of Lisbon datacenter • LIP general IT services • LIP-Lisbon IT services • LIP building at 3Is • LIP Lisbon offices and laboratories • Local network and data backups • Dep of Physics Univ of Coimbra • LIP Coimbra support • NOS - Riba de Ave datacenter • FCT Bob HPC cluster / MACC + INCD

  10. Cloud and Farm HPC/HTC INCD farm (CPU*hours): • HPC and HTC processing • INCD, LIP, LNEC International public tender: • INCD compute nodes • INCD online storage • INCD network upgrade • INCD IaaS cloud (CPU*hours): • Long running services • Portals and web services • Big data processing • Very specific processing • INCD, LIP, LNEC Upgrade

  11. EGI and IBERGRID • EGI federation of European national infrastructures • Integrating computing and data resources • LIP and INCD participate in EGI • Essential for WLCG and Tier-2 • IBERGRID Iberian distributed computing infrastructure • PT + ES in EGI as IBERGRID • LIP operations coordinator • IBERGRID reinforced in the Iberian summit of 2018 IFCA USC CESGA IFAE PIC UPORTO UAM CIEMAT CETA-GRID UPV IFIC NCG www.ibergrid.eu

  12. LIP in EGI (and also in IBERGRID) • LIP has been partner in all EGI flagship projects • InSPIRE(2010-2014), Engage(2015-2017), EOSC-hub (2018-2020) • Roles: • Resource provider (now as INCD) • Liaison with of the Portuguese and Iberian grid infrastructure • Infrastructure coordination together with policy, training, dissemination, and relations with user communities • Main activities: • Global coordination of the middleware rollout process • Quality criteria definition and validation for the middleware • Collaborate on security both in the region and with the EGI CSIRT • Regional operations support for the Iberian region • Representing Portugal in the EGI council since 2010

  13. EOSC-hub • Services for the European Open Science Cloud (EOSC) • EOSC is an initiative of the European Commission • EOSC-hub joins: EGI, EUDAT CDI and INDIGO-DataCloud • Services and software for advanced data-driven R&I • 1st review went very well • LIP participation: • Task 4.6:Middleware quality assurance and rollout process • OPENCoastS thematic service • udocker: support and maintenance of the tool • Service provider (grid, cloud) • Virtual Access funding mechanism • EOSC-hub in numbers: • 100 Partners • 3874 PMs, 108 FTEs • 33,331,180€ • 36 months EOSC-hub: (2018-2020)

  14. OPENCoastSservice in EOSC-hub • On-demand circulation forecast systems for EU coastal areas. • Daily 48h/72h forecasts of water levels, vertically averaged velocities and wave parameters over the region of interest. • Service supported by EOSC-hub @ EU level: • LNEC: simulations of physical processes • LIP: integration in the EOSC using EGI + EUDAT • INCD: provides the computing resources • https://opencoasts.ncg.ingrid.pt

  15. DEEP-HybridDataCloud • Deep Learning / Machine Learning as a Service. • Specialized hardware: GPUs, Low latency interconnects • On demand as a Service • Virtualized environments: udocker, Docker, LXD, QEMU/KVM • Very successful first review last April • LIP roles: • WP leader: SW release, SQA, management and support, testbeds • Task leader: Bare-metal like performance to access GPUs and IB • LIP participation: • Extended support for accelerated computing • High level networking orchestration • Pilot services and testbeds DEEP: (2017-2020)

  16. udocker on github • Execution of Linux containers without requiring privileges • Supported by • EOSC-hub • DEEP-HybridDataCloud • Widely used in life sciences and genomics • Computer Physics Communications, Volume 232, 2018, Pages 84-97, ISSN 0010-4655, https://doi.org/10.1016/j.cpc.2018.05.021 • Poster in ISC High Performance 2019 Likelihood analysis of the pMSSM11 in light of LHC 13-TeV data March 2018 During part of this work we used the middleware suite udockerto deploy MasterCode on clusters. We are particularly grateful to Jorge Gomes for his kind support.

  17. INDIGO software collaboration agreement • Following the INDIGO project LIP joined the INDIGO-DC collaboration agreement aiming to sustain: • Architecture • Branding and dissemination • Software Catalogue • Expand and go further: • Open to new partners wishing to extend or maintain the INDIGO-DC software components • Common stronger influence on larger initiatives • Exploitation of new opportunities • Participation in EOSC and new projects

  18. EOSC-synergy • Expanding Capacities & Building Capabilities • Expand EOSC infrastructure including data repositories • Integrating new services and fostering service adoption • Alignment of national EOSC related policies • Partners: CSIC, LIP, INCD, FCT-FCCN, LNEC, UPV, CESGA, BSC, Rediris, CIEMAT, INDRA, PSNC, CYFRONET, CESNET, KIT, JISC, DANS, EGI, LEGOS, UFCG • LIP participation: • Project deputy coordinator • WP3 coordination • Processes and tools to enforce and validate services software quality • Services integration in EOSC • Data repositories integration in EOSC • Skills development, training • EOSC-hub in numbers: • 20 Partners • 826 PMs • 5,584,006€ • 30 months EOSC-synergy: (2019-2022)

  19. HPC activities • Lisbon HPC service: • Initially established in 2009 was the first Infiniband cluster in Portugal • Now being upgraded with new compute nodes with Infiniband • Upgrade on Lustre HPC storage also ongoing • RNCA + RICA: • INCD is now a member of RNCA & RICA • Got funding to start RICA activities • Expected funding for operational costs • BOB: • Is the name of the Stampede partition offered by TACC to FCT • Being deployed in Riba de Ave (12000 CPU cores) • 20% managed by INCD / 80% managed by MACC • LIP via INCD is deploying the storage for BOB • FCT RICA protocol: • INCD • 150,000€ • 18 months

  20. Events in 2018 Digital Infrastructures for Research Conference (DI4R) Europe’s leading e-infrastructures invite all researchers, developers and service providers to participate to the third edition of Digital Infrastructures for Research conference Lisbon, 9 to 11 October 2018. Organized by EOSC-hub, EGI, EUDAT, INDIGO, GÉANT, OpenAIRE and PRACE. Locally organized by LIP + INCD IBERGRID 2018: Towards the European Open Science Cloud Fostering cooperative projects at the Iberian level, with a focus on the upcoming European Open Science Cloud (EOSC): challenges and opportunities for the Iberian region. Lisbon, 11 to 12 October 2018. Organized byIBERGRID. Locally organized by LIP + INCD

  21. How all fits together Participates Bridges with LIP computing services R&D through projects Users …. …. Support VRE VRE VRE VRE Knowledge Capabilities Provides shared computing and data capacity to the academic and research communities

  22. Projects and funding • LIP 2018-2019 • EOSC-hub HR 273.000€ 36M • EOSC-hub VA 146.000€ 36M • DEEP-HybridDataCloud 362.500€ 30M • INCD 2020 270.000€ 36M • EOSC-synergy 433.000€ 30M • INCD 2018-2019 • INCD 2020 2.700.000€ 36M • Géant Cloud Framework Pilot 10.000€ 12M • EOSC-synergy 120.000€ 30M • FCT RICA protocol 150.000€ 18M

  23. Distributed Computing and Digital Infrastructures Mainly LIP IT staff researchers and engineers working full-time: • Jorge Gomesnetwork, cloud, develop, INCD coordination • Gaspar Barreirapolicy, liaison with CERN and WLCG • Mário Davidcloud, GPU, distributed computing, INCD support • JoãoPinaTier-2, software management, INCD support • João P. Martinsfabric management, compute and storage • Nuno Diasdesktops, notebooks, security, network services • Hugo Gomesweb development, events, multimedia • Carlos Manuelweb development, graphic design • DinisMonteiro INCD software development

  24. Distributed Computing and Digital Infrastructures Technical and support team also coordinated by LIP. INCD collaborators based in Lisbon: • CatarinaOrtigão management support, dissemination, user relations • André Vieira compute, storage, monitoring, fabric mgmt INCD collaborators based in Braga: • ZacariasBentaINCD North node systems and support • José MachadoINCD North node systems and support LIP Minho • Henrique CarvalhoLIP, multimedia and communication, IT support

  25. Advanced Computing Mainly researchers and post-graduate students: • AntónioPinaU.Minho, application performance analysis, dynamic tracing • AntónioEstevesU.Minho, application of machine/deep learning techniques • José RufinoPolytechnic Institute of Bragança- parallelization strategies for GPU based algorithms • Vítor Oliveira Application behavior analysis and estimation, administration of LIP-Minho cluster infrastructure • Bruno Ribeiro(MsC) PlaCoR- A Platform for Resource-Oriented Computing • Tiago Duarte (MsC) Distributed training of Deep Neural Networks

  26. Conclusions • Negative • Large effort to keep all IT services running due to ageing • Lack of capacity to address the user needs • Lack of coherent sustained funding from FCT • for operation, maintenance and improvement of e-infrastructures • despite WLCG MoU signed by the ministry • Ministry focus moved to HPC (HEP needs HTC not HPC) • Future on INCD and non-HPC e-infrastructures unclear • Positive • Some capacity increase through INCD provided resources • Additional human resources through INCD • INCD is participating in RNCA and will manage part of BOB cluster • INCD is a member of the Iberian HPC network RICA • Operational costs for RNCA + RICA related activities is foreseen

  27. Thank you ! LIP workshop 2018

  28. NEW Other possible collaborations • EUDAT is a data oriented European infrastructure • Going forward with a national Pilot in EUDAT • Pilot funded by FCT for open data and digital preservation • Joining INCD (LIP, FCCN, LNEC), etc • Air Center • INCD as infrastructure / service provide • Géant Cloud framework agreement • Evaluation of commercial cloud services (Azure, Amazon, others) • Géant pan-European framework agreement (procurement) • Funded by FCT • Climate Change • Collaborate on application tuning for IPCC simulations • Deploy a national node of the Earth Grid Federation • National project submitted

More Related