150 likes | 266 Views
Belle MC Production on Grid. 2 nd Open Meeting of the SuperKEKB Collaboration Soft/Comp session 17 March, 2009 Hideyuki Nakazawa National Central University. Contents. Status of MC production Belle MC production procedure with Grid Ganga. MC Production Status.
E N D
Belle MC Production on Grid 2nd Open Meeting of the SuperKEKB Collaboration Soft/Comp session 17 March, 2009 Hideyuki Nakazawa National Central University
Contents • Status of MC production • Belle MC production procedure with Grid • Ganga Belle MC with Grid
MC Production Status • Long down time since last June • Just resumed • New sites • KISTI, Melbourne, Ljubljana, Karlsruhe Belle MC with Grid
Belle VO sites Belle MC with Grid
One Week Statistics Belle MC with Grid
Problems • Storage, HSM busy • Stays inside B system and shared with Belle users • Access to HSM sometimes concentrate on one of four server • Job processing time exceed limits Belle MC with Grid
Belle MC Procedure1. Get Assignment from Web • 4 physics modes (charged, mixed, charm, uds) • 1 slot = 100 run range • Same number of events with experiment data • 10 set (streams) Belle MC with Grid
Belle MC Procedure2. Receive a mail Gen and Bkg files: copy to HSM (in B computer system) and register to SRB “Sregister hoge.pgen srbdir” Generator, Bkg, sh script files are provided by MC manager SRB (Storage Resource Broker) Accessible to/from Grid UI (User Interface) Server you work for Grid Copy script.tgz to UI Belle MC with Grid
Belle MC Procedure3. Submit jobs JDL Executable=Job.sh Stdout=log.out Stderr=log.err • Create a directory for the slot (prepare-job.rb) • Modify sh script and create JDL files (basf2grid.sh) • Add “copy inputs from SRB” and “copy outputs to SRB” • Create a sh script to submit (mksubmit.rb) • “edg-job-submit … job.jdl” • Submit (submit) Belle MC with Grid
Belle MC Procedure4. Monitor running jobs Summary CPU Elapse time Belle MC with Grid
Belle MC Procedure5. Retrieve finished job • Retrieve log files of finished jobs • Checking the job is correctly completed Belle MC with Grid
Ganga http://ganga.web.cern.ch/ganga/index.php • Ganga is an easy-to-use frontend for job definition and management, implemented in Python. It has been developed to meet the needs of the ATLAS and LHCb for a Grid user interface, and includes built-in support for configuring and running applications based on the Gaudi / Athena framework common to the two experiments. Ganga allows trivial switching between testing on a local batch system and large-scale processing on Grid resources. Belle MC with Grid
Ganga “Hello World” • Configure with Job() • Directories • JDL file • Backend = local Configuration Submit Status Belle MC with Grid
Ganga MC Production Backend=LCG → edg-job-submit Belle MC with Grid
Summary • MC Production resumed !! • New sites working correctly with large resouces • Configuration and Job submission tool “Ganga” tried. • Easy to see what we’re doing • Good to unified interface • No convenience about functionality We must write script for scripts, anyway. Belle MC with Grid