1 / 17

Grid Activity in Oslo

Grid Activity in Oslo. CERN-satsingen/miljøet møter MN-fakultetet Oslo, 8 juni 2009 Alex Read. Grid Activity in Oslo. World-wide LHC Computing Grid (Norway~1.8%) Advanced Resource Connector (ARC) middleware-related projects Norwegian Tier-1(+2) sites Tier-3 status

abby
Download Presentation

Grid Activity in Oslo

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Grid Activity in Oslo CERN-satsingen/miljøet møter MN-fakultetet Oslo, 8 juni 2009 Alex Read

  2. Grid Activity in Oslo • World-wide LHC Computing Grid (Norway~1.8%) • Advanced Resource Connector (ARC) middleware-related projects • Norwegian Tier-1(+2) sites • Tier-3 status • Ganga (multi-grid job submission tool for LHC++) • ARC performance in ATLAS production • Participation in and/or influence on Norwegian, Nordic, European grid initiatives

  3. Norwegian resources for WLCG • Provided outside the HEP projects (ALICE & ATLAS) • Tier-1 & 2: Binding through MoU yearly basis • Tier-3 for analysis “self-funded” • NorGrid/NOTUR • Small contributions from NFR projects • 2 Grid-related post-docs for Alice and Atlas (50% HEP projects, 50% Uninett-Sigma/Norwegian eScience - eVita) • 1 in Oslo EPF F. Ould-Saada

  4. Oslo participation (and quite some leadership) in the NorduGrid Collaboration and the 3 ARC middleware-related Grid projects Collaboration • NorduGrid Collaboration (www.nordugrid.org) • Develop, support, and coordinate inputs to the Advanced Resource Connector (ARC) middleware, Oslo in from the beginning in 2001, current leader • The KnowARC project (www.knowarc.eu) • Create a novel, powerful Next Generation Grid middleware based on ARC and bridge the gaps between business and academia in Grid development (leadership and large contr. From Oslo) • NDGF (www.ndgf.org) • NDGF is a production grid facility that leverages existing, national computational resources and grid infrastructures  Nordic Tier-1 and external Tier-2’s • NGIn (www.nordugrid.org/ngin) • Train new Grid experts, securing further technology development  5 PhD grants (2 in Oslo!), Grid school Projects (rest of ATLAS is jealous) ARC ~ 2M Euros / year Farid Ould-Saada

  5. Grid activities at UiO / USIT • Tier-1, Tier-2 (NDGF) compute resources • 4000 core cluster (titan), Condor pool • Atlas (significant fraction of Nordic T1) • Alice production (to resume spring ‘09) • 362 dedicated cores ->552 dedicated cores (April 2009) • free resource (idle cores) • Regularly see > 1000 grid jobs • NorGrid production site • Tier-1 storage pools (dCache) • 120 TB 2008, 260 TB (April ‘09) Hans Eide

  6. Grid activities at UiO / USIT (cont.) • Collaboration between HEP group and USIT • Middleware development (ARC) • Graduate students (2) • Jon Kristian Nielsen (storage) • Dmytro Karpenko (workflow) • Building up Tier-3 for physics analysis • CPU allocation from NOTUR (87 kh, 4-9.09) • titan@UiO • stallo@UiT • 9 TB dedicated storage • 32 Interactive nodes@usit Hans Eide

  7. Distributed analysis in ATLAS • Ganga is the primary tool in ATLAS to submit user analysis jobs to the WLCG (which has 3 diverse middlewares: VDT, gLite, ARC) • Oslo EPF supports the ARC backend Ganga in action Bjørn Samset

  8. Performance of ARC-enabled NDGF Jan-Sep 2008

  9. Get on the grid ...snip... The default grid middleware that is used by the NorGrid initiative is the Advanced Resource Connector (ARC).You need to install the ARC middleware client on your local desktop. There is a wealth of documentation on ARC middleware. In particular, the ARC User Guide is recommended literature. ...snip...

  10. http://www.nordforsk.org/text.cfm?id=499&path=58,66 eNoria – The Nordic eScience Initiative • Principal goal is to establish a Nordic eScience committee and management structure • Activities include programme plans for resourcing computational grand challenge research (like LHC...) • An expert group on Grid infrastructure is established: NDGF,Nordic participation in WLCG (including LHC upgrade plans) are among central topics in the mandate of the group. 15/09/2014 F. Ould-Saada 10

  11. Establishing a sustainable grid (EGI) Thanks to NorduGrid, NDGF (and others), production grids are reality today F. Ould-Saada

  12. OSLO Workshop: March 11-12 http://indico.cern.ch/conferenceDisplay.py?confId=52786 Next workshop: CERN April 23-24 http://indico.cern.ch/conferenceProgram.py?confId=54910 Common EU application towards end of 2009? Common middleware for LHC and other applications? 15/09/2014 F. Ould-Saada

  13. Summary • Oslo participates in and leads a number of Nordic and European Grid projects • The Norwegian contribution to WLCG is in good shape • The utilization of the ARC-enabled resources is excellent • NDGF (distributed Tier-1) is a great success • The Norwegian grid infrastructure for computational science is well-established and growing • Grid activity in Oslo is strongly influencing the Norwegian, Nordic and European scenes

  14. Distributed! Seen as One site from CERN! F. Ould-Saada

  15. ATLAS Production System Panda prodDB: jobdefs, job states, metadata Task request interface Input: DQ2 datasets Task states Output: DQ2 datasets 3 grids/10 Clouds Monitor sites, tasks, jobs 15

  16. Tier-3 coming along • Norwegian resources useful for LHC analysis (stallo, titan) are ARC-enabled

  17. ARC as part of EGI middleware • NorduGrid participation in EGI_DS middleware task force • UMD session at NorduGrid 2008 conference, including panel discussion • UMD meeting, Rome December 2008 • UMD meeting, Munich, February 2009 • Oslo UMD workshop, 11-12 March 2009 F. Ould-Saada

More Related