1 / 15

Starting with Athena and Experience with ATLAS Documentation

Starting with Athena and Experience with ATLAS Documentation. Steve Lloyd, Queen Mary, University of London. Introduction. Where I'm coming from: TASSO – Fast Monte Carlo, K 0 , Λ Reconstruction

ismail
Download Presentation

Starting with Athena and Experience with ATLAS Documentation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Starting with Athena and Experience with ATLAS Documentation Steve Lloyd, Queen Mary, University of London

  2. Introduction Where I'm coming from: TASSO – Fast Monte Carlo, K0, Λ Reconstruction OPAL – Vertex Detector Reconstruction and Simulation, Physics Coordinator 90-91, OPAL Primer, Heavy Flavour Physics, ... ATLAS – Beam Pipe Studies with Fluka, ... GridPP – Collaboration Chair, Tier-2 Centres, ... (Teaching, College Admin, ...) Currently 50% GridPP, 50% ATLAS till Sept 2007 SIT CERN Dec 2004

  3. Aims Start using Athena – build up experience for analysis Wanted to use the Grid from the start Wanted to first run simple Pythia (in Athena) and get a feel for the events (my e+e- background) Then simulate, reconstruct or read Data Challenge events ... At the time could find no documentation about how to run Athena on the Grid Some complicated recipes involving transforms that I never understood SIT CERN Dec 2004

  4. Athena on the Grid Asked around and finally got a recipe that worked # Set up the correct directory structure for my files (?) export MYPACKAGE="MyAlg" export MYTAG="00-00-01" mkdir ${MYPACKAGE} mkdir ${MYPACKAGE}/${MYPACKAGE}-${MYTAG} mkdir ${MYPACKAGE}/${MYPACKAGE}-${MYTAG}/cmt mkdir ${MYPACKAGE}/${MYPACKAGE}-${MYTAG}/${MYPACKAGE} mkdir ${MYPACKAGE}/${MYPACKAGE}-${MYTAG}/src mkdir ${MYPACKAGE}/${MYPACKAGE}-${MYTAG}/src/components mv ${MYPACKAGE}.cxx ${MYPACKAGE}/${MYPACKAGE}-${MYTAG}/src mv ${MYPACKAGE}_load.cxx ${MYPACKAGE}/${MYPACKAGE}-${MYTAG}/src/components mv ${MYPACKAGE}_entries.cxx ${MYPACKAGE}/${MYPACKAGE}-${MYTAG}/src/components mv ${MYPACKAGE}.h ${MYPACKAGE}/${MYPACKAGE}-${MYTAG}/${MYPACKAGE} mv requirements Makefile ${MYPACKAGE}/${MYPACKAGE}-${MYTAG}/cmt # Build my code export CMTPATH=`pwd`:${CMTPATH} cd ${MYPACKAGE}/${MYPACKAGE}-${MYTAG}/cmt cmt config source setup.sh gmake # Back to base cd ../../.. # Botch required to find PDGTABLE.MeV: cp ${T_DISTREL}/InstallArea/share/PDGTABLE.MeV . # Run the job: athena.py MyJobOptions.py #!/bin/bash # Script to run Athena on the Grid (including my own algorithm) # Steve Lloyd # Choose the release: export LEXOR_T_RELEASE="8.7.0" # Setup all manner of stuff (why isn't this all part of setup.sh?) source $VO_ATLAS_SW_DIR/software/$LEXOR_T_RELEASE/setup.sh GCC_DIR_GCC3=gcc-alt-3.2 GCC_DIR="${GCC_DIR_GCC3}" GCC_SITE="$SITEROOT/$GCC_DIR" export PATH="${GCC_SITE}/bin":${PATH} export LD_LIBRARY_PATH="${GCC_SITE}/lib":${LD_LIBRARY_PATH} export T_RELEASE=$LEXOR_T_RELEASE export T_DISTREL=$SITEROOT/dist/$LEXOR_T_RELEASE source ${T_DISTREL}/AtlasRelease/*/cmt/setup.sh # additional setup (why?) ATLAS_DIR=${VO_ATLAS_SW_DIR}/software/${T_RELEASE}/sw ATLAS_PYTHON=${ATLAS_DIR}/packages/Python/2.2.2/rh73_gcc32 LCG_APP=${ATLAS_DIR}/lcg/app/releases export LD_LIBRARY_PATH=${ATLAS_PYTHON}/lib:${LD_LIBRARY_PATH} export PYTHONPATH=${LCG_APP}/POOL/POOL_1_5_0/rh73_gcc32/bin:${PYTHONPATH} export PYTHONPATH=${LCG_APP}/POOL/POOL_1_5_0/rh73_gcc32/lib:${PYTHONPATH} export SEAL_KEEP_MODULES="true" export SEAL_PLUGINS=${LCG_APP}/SEAL/SEAL_1_3_3/rh73_gcc32/lib/modules:${SEAL_PLUGINS} export SEAL_PLUGINS=${LCG_APP}/POOL/POOL_1_5_0/rh73_gcc32/lib/modules:${SEAL_PLUGINS} export POOL_OUTMSG_LEVEL=8 export LD_LIBRARY_PATH=${VO_ATLAS_SW_DIR}/utils/opt/lcg/lib:${LD_LIBRARY_PATH} export LD_LIBRARY_PATH=${VO_ATLAS_SW_DIR}/utils/usr/local/lib:${LD_LIBRARY_PATH} # Setup the release: source ${T_DISTREL}/Control/AthenaRunTime/*/cmt/setup.sh Surely not the best way! SIT CERN Dec 2004

  5. Athena on the Grid I actually only need this much: # Set up the correct directory structure cmt create MyAlg MyAlg-00-00-01 # Fails to create these for some reason mkdir MyAlg/MyAlg-00-00-01/MyAlg mkdir MyAlg/MyAlg-00-00-01/src/components mv MyAlg.cxx MyAlg/MyAlg-00-00-01/src mv MyAlg_load.cxx MyAlg/MyAlg-00-00-01/src/components mv MyAlg_entries.cxx MyAlg/MyAlg-00-00-01/src/components mv MyAlg.h MyAlg/MyAlg-00-00-01/MyAlg mv requirements Makefile MyAlg/MyAlg-00-00-01/cmt # Build my code export CMTPATH=`pwd`:${CMTPATH} cd MyAlg/MyAlg-00-00-01/cmt cmt config source setup.sh gmake # Back to base cd ../../.. # Botch required to find PDGTABLE.MeV: cp ${T_DISTREL}/InstallArea/share/PDGTABLE.MeV . # Run the job: athena.py MyJobOptions.py #!/bin/bash # Script to run Athena on the Grid # Steve Lloyd # Choose the release: export LEXOR_T_RELEASE="8.7.0" # Setup all manner of stuff (why isn't this all part of setup.sh?) source $VO_ATLAS_SW_DIR/software/$LEXOR_T_RELEASE/setup.sh GCC_DIR_GCC3=gcc-alt-3.2 GCC_DIR="${GCC_DIR_GCC3}" GCC_SITE="$SITEROOT/$GCC_DIR" export PATH="${GCC_SITE}/bin":${PATH} export LD_LIBRARY_PATH="${GCC_SITE}/lib":${LD_LIBRARY_PATH} export T_RELEASE=$LEXOR_T_RELEASE export T_DISTREL=$SITEROOT/dist/$LEXOR_T_RELEASE source ${T_DISTREL}/Control/AthenaRunTime/*/cmt/setup.sh Why? Simple generation but executes my own algorithm and fills my own ntuple SIT CERN Dec 2004

  6. Observations On the Grid (8.7.0) source $VO_ATLAS_SW_DIR/software/$LEXOR_T_RELEASE/setup.sh Fix up GCC source ${T_DISTREL}/Control/AthenaRunTime/*/cmt/setup.sh At CERN (lxplus) (8.7.0) source /afs/cern.ch/sw/contrib/CMT/v1r16p20040701/mgr/setup.sh source cmthome/setup.sh (from login requirements) At QM (9.0.2) source /disk/data23/atlas9.0.2/setup.sh source /disk/data23/atlas9.0.2/dist/9.0.2/Control/AthenaCommon/ AthenaCommon-02-00-21/cmt/setup.sh Documentation says: (https://uimon.cern.ch/twiki/bin/view/Atlas/SetupTheRuningEnvironment) cd /somewhere/AtlasReleases/${release} source setup.[c]sh source dist/${release}/Control/AthenaRunTime/*/cmt/setup.[c]sh Works at QM SIT CERN Dec 2004

  7. Gotchas cmt create MyAlg MyAlg-00-00-01 Fails to create these for some reason: MyAlg/MyAlg-00-00-01/MyAlg MyAlg/MyAlg-00-00-01/src/components So this doesn't do what you want: mv MyAlg.cxx MyAlg/MyAlg-00-00-01/src mv MyAlg_load.cxx MyAlg/MyAlg-00-00-01/src/components mv MyAlg_entries.cxx MyAlg/MyAlg-00-00-01/src/components mv MyAlg.h MyAlg/MyAlg-00-00-01/MyAlg mv requirements Makefile MyAlg/MyAlg-00-00-01/cmt Took ages to work out that this was the magic ingredient: export CMTPATH=`pwd`:${CMTPATH} Why is this necessary? cp ${T_DISTREL}/InstallArea/share/PDGTABLE.MeV . Couldn't use Python versions with 8.0.7 only 8.7.0 SIT CERN Dec 2004

  8. Documentation Not the same name This should be the link Repeated at both levels - confusing Mostly the same but not quite SIT CERN Dec 2004

  9. Documentation Nothing to do with this Misleading title – should be Setting up an ATLAS account Some ancient 2001 document SIT CERN Dec 2004

  10. Documentation Pretty useful Links to useful Glossary ASK no use for Grid Laborious to navigate – better as one html file with internal hyperlinks Should be more prominent Seem pretty old. Still relevant? Reluctant to believe anything not updated this year SIT CERN Dec 2004

  11. Documentation Not obvious what this means Lots of useful information – too deep in the tree? Especially Athena. Sub-menus of the side bar? SIT CERN Dec 2004

  12. Documentation Unnecessary intermediate page SIT CERN Dec 2004

  13. Documentation ATLAS Grid Last updated March 2002 Release 3.2.1 External links and use case documents – no instructions SIT CERN Dec 2004

  14. Documentation ATLAS Grid 2 Same content? Different Coordinator SIT CERN Dec 2004

  15. Conclusion Very difficult (for me) to get started as no clear working recipes. There is lots of documentation but it is fragmented, badly linked and lots of it is out of date or not maintained. There is useful information at many external ATLAS sites but mainly not linked (use Google) but presumably not validated either. Need clear (annotated) maintained examples for each situation (User Guide). Difficult to find out which package to use and what they do. Grid needs to be integrated not a separate activity. Wiki looks very promising and needs to be more prominent (shouldn't be under Developers) (Unfortunately Wikis can become a complete mess if not moderated well) SIT CERN Dec 2004

More Related