1 / 17

GETTING STARTED ON THE GRID:

. W. G. SCOTT (RAL/PPD) RAL PHYSICS MEETING TUES 15 MAY 2007. GETTING STARTED ON THE GRID:. MC STUDY OF RADIATIVE B-DECAYS FOR B-PHYSICS/HLT STUDIES. GENERATED 10K SAMPLES IN EACH CHANNEL ON LXPLUS (IN 2006) SIMULATED/DIGITISDED 1K SUB-SAMPLES ON LXPLUS

xiu
Download Presentation

GETTING STARTED ON THE GRID:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. . W. G. SCOTT (RAL/PPD) RAL PHYSICS MEETING TUES 15 MAY 2007 GETTING STARTED ON THE GRID: MC STUDY OF RADIATIVE B-DECAYS FOR B-PHYSICS/HLT STUDIES GENERATED 10K SAMPLES IN EACH CHANNEL ON LXPLUS (IN 2006) SIMULATED/DIGITISDED 1K SUB-SAMPLES ON LXPLUS BUT LXPLUS TOO SLOW FOR LARGE SAMPLES – MOVE TO GRID?

  2. Generated Bd -> K* gamma Events stored in Castor: /castor/cern.ch/user/s/scottw/gjab02/ RELEASE 12.0.0 csc.018200.B_Kstar_Kplus_PiMinus_gamma4.evgen._00001.pool.root csc.018200.B_kstar_Kplus_PiMinus_gamma4.evgen._00002.pool.root csc.018200.B_kstar_Kplus_PiMinus_gamma4.evgen._00003.pool.root csc.018200.B_kstar_Kplus_PiMinus_gamma4.evgen._00004.pool.root csc.018200.B_kstar_Kplus_PiMinus_gamma4.evgen._00005.pool.root csc.018200.B_Kstar_Kplus_PiMinus_gamma4.evgen._00006.pool.root csc.018200.B_Ksatr_Kplus_PiMinus_gamma4.evgen._00007.pool.root csc.018200.B_Ksatr_Kplus_PiMinus_gamma4.evgen._00008.pool.root csc.018200.B_kstar_Kplus_PiMinus_gamma4.evgen._00009.pool.root csc.018200.B_Ksatr_Kplus_piMinus_gamma4.evgen._00010.pool.root csc no. is not present for these Bd -> K* gamma data sets 10 files @ 1000 events per file = 10,000 B -> K* gamma events total Generation is easy: 1000 events per 8 hr job ~ 30Mb per file

  3. Bs -> phi gamma Events stored in Castor: /castor/cern.ch/user/s/scottw/gjab02/ RELEASE 12.0.0 csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00001.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00002.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00003.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00004.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00005.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00006.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00007.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00008.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00009.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.evgen._00010.pool.root 10 files @ 1000 events per file = 10,000 Bs -> Phi gamma events total Generation is easy: 1000 events per 8 hr job ~ 30Mb per file

  4. USING STANDARD SIMUL+DIGIT TRANSFORMATIONS Simulated and digistsed Bd -> K* gamma Samples: RELEASE 12.0.6 castor/cern.ch/user/s/scottw/gjab02/ B_Kstar_Kplus_PiMinus_gamma4.digi._00001.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00002.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00003.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00004.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00005.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00006.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00007.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00008.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00009.pool.root B_Kstar_Kplus_PiMinus_gamma4.digi._00010.pool.root 10 files @ 100 events per file = 1000 Bd -> K* gamma events total 100 EVENTS PER 1 DAY JOB ON LXPLUS = TOO SLOW !! ~200Mb PER 100 EVENT FILE!!

  5. USING STANDARD SIMUL+DIGIT TRANSFORMATIONS Simulated and digitised Bs -> phi gamma sample: RELEASE 12.0.6 castor/cern.ch/user/s/scottw/gjab02/ csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00001.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00002.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00003.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00004.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00005.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00006.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00007.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00008.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00009.pool.root csc.018201.Bs_phi_Kplus_Kminus_gamma4.digit._00010.pool.root 10 files @ 100 events per file = 1000 Bs -> Phi gamma events total 100 EVENTS PER 1 DAY JOB ON LXPLUS = TOO SLOW !! ~200Mb PER 100 EVENT FILE!!

  6. LVL-! TRIGGER EFFIENCY PLOT (THANKS JULIE!) LVL-1 THR: 3 GeV 4 GeV 5 GeV

  7. MORE JULIE PLOTS!!

  8. ALL QUESTIONS TO S. DALLISON PLEASE!! MOVING TO THE GRID: You need a copy of your Grid Certificate in your home directory: /afs/cern.ch/user/s/scottw/mycertificate.pfx Go to your work directory and use z-shell: cd public/b1206 zsh Execute the following commands to setup Ganga (and Don-Quijote): source /afs/cern.ch/project/gd/LCG-share/sl3/etc/profile.d/grid_env.sh source /afs/usatlas.bnl.gov/Grid/Don-Quijote/dq2_user_client/setup.zsh.CERN export PATH=${PATH}:/afs/cern.ch/sw/ganga/install/slc3_gcc323/4.2.12/bin/ export GANGA_CONFIG_PATH=GangaAtlas/Atlas.ini voms-proxy-init Enter your 18-character pass phrase in response to this last command: ******************

  9. PREPARE A SIMPLE JOB TO RUN ON THE GRID: https://twiki.cern.ch/twiki/bin/view/Atlas/GangaTutorial427 Prepare the “job” as a simple python script (in your work area)t: emacs mygangajob.py j=Job() j.application=Executable() j.application.exe=File('$HOME/public/b1206/myscript.sh') j.backend=LCG() j.submit() Prepare the “exe” referenced above as a simple shell script: emacs myscript.sh #!/bin/sh echo 'myscript.sh running...' echo "----------------------" /bin/hostname echo "----------------------" env This script does essentially nothing except to announce that it is running and list all the environment variables

  10. ganga --gui to use the gui RUN THE JOB USING GANGA: Start Ganga and submit the job: It seems that you run Ganga for the first time …creates /afs/cern.ch/user/s/scottw/.gangarc ganga *** Welcome to Ganga *** Version: Ganga-4-2-12 ....etc. In[1]: execfile(`mygangajob.py’) submitting job 58 to LCG backend …. etc. In[2]:jobs (to see status of all jobs) In[3]:jobs[58] (to see detailed status of job 58) job status changes: submitted /new? running completed /failed When the job is completed, vew the output using !less: In[4]!less /afs/cern.ch/user/s/scottw/gangadir/workspace/Local/58/output/stdout myscript.sh running... ---------------------- wn59.itep.ru ---------------------- ….. etc. e.g. HOSTNAME=wn59.itep.ru HOSTNAME=r4b-s16.local HOSTNAME=wn60.itep.ru HOSTNAME=wn072.athena.hellasgrid.gr …. etc. q (to quit less command) CNTRL D (to quit ganga!)

  11. NEED TO REGISTER FILES IN DON-QUIJOTE: List my input file in castor: nsls -l /castor/cern.ch/user/s/scottw/gjab02/ csc.018200.B_Kstar_Kplus_PiMinus_gamma4.evgen._00011.pool.root Insert the file into the PoolFile Catalog: pool_insertFileToCatalog rfio:/castor/cern.ch/user/s/scottw/gjab02/ csc.018200.B_Kstar_Kplus_PiMinus_gamma4.evgen._00011.pool.root (file name) Now register the file(s) in Don Quijote: dq2_put -p PoolFileCatalog.xml user.billscott.testregister011 (dataset name) List the dataset in Don Quijote: dq2_ls user.billscott.testregister011 List the dataset and the files comprising: dq2_ls -g user.billscott.testregister011 (dq2_ls –h for help on dq2_ls)

  12. MY CURRENT GANGA SIMUL/DIGIT JOB: emacs gsim006.py j=Job() j.application=AthenaMC() j.application.random_seed='1102362401' j.application.production_name='csc' j.application.process_name='B_Kstar_Kplus_PiMinus_gamma4' j.application.run_number='018200' j.application.firstevent='1' j.application.number_events_job='10' j.application.atlas_release='12.0.6' j.application.transform_archive='AtlasProduction_12_0_6_1_noarch.tar.gz' j.application.mode='simul' j.application.geometryTag = 'ATLAS-CSC-01-02-00' j.application.datasets.indirectory="user.billscott.testregister001" j.application.datasets.inputfile="csc.018200.B_Kstar…gamma4.evgen._00011.pool.root" j.backend=LCG() #j.backend.CE='heplnx206.pp.rl.ac.uk:2119/jobmanager-lcgpbs-atlas' j.backend.CE='ce102.cern.ch:2119/jobmanager-lcglsf-grid_2nh_atlas' j.backend.middleware='EDG' j.outputdata=DQ2OutputDataset() j.application.se_name='RALDISK' j.splitter=AthenaMCSplitterJob() j.splitter.numsubjobs = 2 j.splitter.nsubjobs_inputfile = j.splitter.numsubjobs # j.submit()

  13. WHEN THE JOB HAS RUN: Job # Subjob # Use the “less” command to view the Output file: !less /afs/cern.ch/user/s/scottw/gangadir/workspace/Local/27/0/output/stdout unix command prefixed by shriek ! Use Don-Quijote to “Get” the Output file: cd /tmp dq2_get -r user.billscott.testregister001 csc.18200.B_Kstar…gamma4.evgen._00011.ntup.root.61 Remove the job number appended the end of the output file before using root: mv csc.18200.B_Kstar…gamma4.evgen._00011.ntup.root.61 csc.18200.B_Kstar…gamma4.evgen._00011.ntup.root root csc.18200.B_Kstar…gamma4.evgen._00011.ntup.root How do I clean-up/remove all the old jobs/files in Ganga and start fresh?? BIG BROTHER IS WATCHING YOU/ME!!

More Related