1 / 9

MC production for CSA06

MC production for CSA06. N. De Filippis S. My and G. Maggi. Department of Physics and INFN Bari. On behalf of LCG(3) production team. LCG(3) sites. Bari - gridba2.ba.infn.it CNAF - ce03-lcg.cr.cnaf.infn.it

malini
Download Presentation

MC production for CSA06

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. MC production for CSA06 N. De Filippis S. My and G. Maggi Department of Physics and INFN Bari On behalf of LCG(3) production team

  2. LCG(3) sites • Bari - gridba2.ba.infn.it • CNAF - ce03-lcg.cr.cnaf.infn.it • Pisa - gridce.pi.infn.it • Rome - cmsrm-ce01.roma1.infn.it • Legnaro - t2-ce-02.lnl.infn.it • Budapest - grid109.kfki.hu • RAL - lcgce01.gridpp.rl.ac.uk • Imperial College - gw39.hep.ph.ic.ac.uk • RAL PPD - heplnx201.pp.rl.ac.uk • Brunel - dgc-grid-40.brunel.ac.uk Effective support from sites for debugging and solving problems

  3. Software • PRODAGENT versions used: • - PA_0_0_34 up to 0_0_41 with a lot of improvements in functionalities, automatization and bug fixes • PA_0_0_42 under test: stageout working and adapted to fit of requirements of site admins for file store checking (srm exit code 0 , rfcp) • CMSSW: • Started with CMSSW_0_8_1 and completed with CMSSW_0_8_4 • DBS/DLS: • DBS instance was MCLocal_4/Writer and the DLS instance was prod-lfc-cms-central.cern.ch/grid/cms/DLS/MCLocal_4 • Monitoring system: developped “ad hoc” by using BOSS database

  4. Production hw/sw setup pccms27 Apache 2.0 php 4.3.2 MySQL 5.0.22 pccms29 PhEDEx server ProdAgent UI II pccms28 Apache 2.0 php 4.3.2 MySQL 5.0.22 pccms6 DB mirror ProdAgent UI I PA_035, PA_039 PA_041, … various productions monitored Managed By different PA versions pccms30 Test and backup setup + PhEDEx injection ProdAgent UI

  5. Jet calibration soup JET calibration soup : 1.3 M merged

  6. LCG(3) statistics • Minbias: 7.2 M merged with CMSSW_0_8_2 • TTbar: 1.2 M merged with CMSSW_0_8_2 • EWS soup: 1.6 M merged with CMSSW_0_8_3 • JETS calibration soup : 1.3 M merged with CMSSW_0_8_3 • HLT soup: 0.17 merged with CMSSW_0_8_4

  7. Data transfer at CERN • Minbias completely transferred • TTbar: • EWK soup: • Jet calibration soup: transferred • HLT soup: CNAF Budapest Brunel CNAF

  8. Lesson learnt • Monte Carlo production is close to be automatized at all (monitoring was really useful) but a lot of expertize in CMS and GRID computing is still required for running MC production efficienctly. • Anyway checks and controls are always needed to ensures the consistency of what registered in DBS/DLS, what produced successfully and what exists on disk and it is really accessible • Validation of new sites joining the production effort was critical (stageout, local TFC, CMSSW installation) • Merge jobs caused in general an overload of the storage systems due to the intensive file access, almost irrespective of the storage technologies used: CASTOR, DPM, dCache. • GRID middleware and distributed infrastucture was 95% efficient

  9. Contributors Federico CALZOLARI<Federico.Calzolari@cern.ch> Guido Cuscela <Guido.Cuscela@ba.infn.it> Massimo Biasotto <massimo.biasotto@lnl.infn.it> Federica Fanzago <fanzago@pd.infn.it> Maria.Damato<Maria.Damato@ba.infn.it> Marco Corvo <marco.corvo@cern.ch> HAJDU Csaba <hajdu@sunserv.kfki.hu> Simon Metson <s.metson@bristol.ac.uk>, StuartWakefield<stuart.wakefield@imperial.ac.uk> Mona Aggarwal <m.aggarwal@imperial.ac.uk> Olivier van der Aa <o.van-der-aa@imperial.ac.uk> Giuseppe Mazza <g.mazza@qmul.ac.uk> Alex Martin <a.j.martin@qmul.ac.uk> Dave Newbold <dave.newbold@cern.ch> David Colling <d.colling@imperial.ac.uk> t1-admin@cnaf.infn.it Tommaso Boccali <Tommaso.Boccali@cern.ch> Andrea Sciaba' <Andrea.Sciaba@cern.ch> simone gennai <simone.gennai@cern.ch> Sergio Fantinel <sergio.fantinel@lnl.infn.it> Daniele Bonacorsi <Daniele.Bonacorsi@bo.infn.it> Marco Paganoni <Marco.Paganoni@cern.ch> Giacinto Donvito <giacinto.donvito@ba.infn.it> Alessandra Fanfani <Alessandra.Fanfani@bo.infn.it> Giorgio Maggi <giorgio.maggi@ba.infn.it> Stefano Belforte <stefano.belforte@ts.infn.it> Giuseppe Bagliesi <Giuseppe.Bagliesi@cern.ch> Francesco Safai Tehrani <fsafai@gmail.com> Giuseppe Codispoti <giuseppe.codispoti@bo.infn.it> Salvatore My <my@ba.infn.it> Marcello Abbrescia <Marcello.abbrescia@ba.infn.it> Antonio Pierro <antonio.pierro@ba.infn.it> Paolo Capiluppi <capiluppi@bo.infn.it> William Bacchi <william.bacchi@bo.infn.it> Ivano Lippi <ivano.lippi@pd.infn.it> Carlos Kavka <carlos.kavka@ts.infn.it>

More Related