1 / 13

PROOF/XROOTD Quick Installation Guide

PROOF/XROOTD Quick Installation Guide. Neng XU University of Wisconsin-Madison. X D. About this instruction. This instruction is for beginners to setup and test an Xrootd/PROOF pool quickly.

amanda
Download Presentation

PROOF/XROOTD Quick Installation Guide

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. PROOF/XROOTD Quick Installation Guide Neng XU University of Wisconsin-Madison X D

  2. About this instruction • This instruction is for beginners to setup and test an Xrootd/PROOF pool quickly. • Following up each step and you should be able to get it work. If not, the main problem may be the Firewall. • There is no explanation of configuration files. To understand more, please check: http://root.cern.ch/twiki/bin/view/ROOT/ProofInstallation • If you have further questions, this forum can help you:http://root.cern.ch/phpBB2/ • The text in those grey boxes are the commands you need to run.

  3. STEP One:Define the system structure: • Xrootd Redirector(PROOF Master)Recommend hardware: Dual Core 2.0GHz, 2GB RAM, 80GB Hard driver. • Data Servers(PROOF Slaves)Recommend hardware: 4xCore 2.4GHz, 8GB RAM, 80GB system hard driver, 500GB data disk or RAID. pcuw101 pcuwsun01 pcuwsun02

  4. STEP Two:Software preparation. • Get ROOT binary package on EVERY machine:If you have 32bit SLC4:> su> cd /opt > wget ftp://root.cern.ch/root/root_v5.18.00.Linux.slc4.gcc3.4.tar.gz > tar zxvf root_v5.18.00.Linux.slc4.gcc3.4.tar.gzIf you have 64bit SLC4:> su> cd /opt > wget ftp://root.cern.ch/root/root_v5.18.00.Linux.slc4_amd64.gcc3.4.tar.gz > tar root_v5.18.00.Linux.slc4_amd64.gcc3.4.tar.gz • Add user “xrootd” on EVERY machine:> su> /usr/sbin/adduser xrootd> mkdir /var/log/xrootd> chown xrootd /var/log/xrootd pcuw101 pcuwsun01 pcuwsun02

  5. STEP Three:Mount your data disks • Mount your data disk on Data servers.(In this sample, the data disk (/dev/sdb1) always mount on /xrootd directory.)> su> mkdir /xrootd> chown xrootd /xrootd> mount /dev/sdb1 /xrootd> df /xrootd pcuw101 pcuwsun01 pcuwsun02

  6. STEP Four:Main configuration files. • They are SAME on ALL the nodes. • The main configure files are: • /etc/xrootd.cf • /etc/proof.conf • The start scripts are: • /etc/init.d/xrootd • /etc/init.d/olbd pcuw101 pcuwsun01 pcuwsun02

  7. /etc/xrootd.cf Change “pcuw101” to your own Xrootd Redirector’s hostname. xrootd.fslib /opt/root/lib/libXrdOfs.so xrd.port 1094 olb.port 3121 if exec olbd xrd.sched mint 10 maxt 100 avlt 20 fi xrootd.export /xrootd/ if pcuw101.cern.ch ofs.redirect remote ofs.forward all else ofs.redirect target fi oss.path /xrootd/ r/w olb.path rw /xrootd/ if pcuw101.cern.ch olb.role manager else olb.role server fi olb.subscribe pcuw101.cern.ch 3121 odc.manager pcuw101.cern.ch 3121 olb.delay startup 30 olb.space 20g 1g if exec xrootd xrd.protocol xproofd:1093 /opt/root/lib/libXrdProofd.so fi xpd.rootsys /opt/root xpd.workdir /xrootd/ xpd.intwait 20 xpd.resource static /etc/proof.conf xpd.role worker xpd.role master if pcuw101.cern.ch xpd.allow pcuw101.cern.ch xpd.poolurl root://pcuw101.cern.ch xpd.namespace /home/xrootd/proofpool pcuw101 pcuwsun01 pcuwsun02

  8. /etc/proof.conf Change “pcuw101” to your own Xrootd Redirector’s hostname. master pcuw101.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd Change “pcuwsun01” and “pcuwsun02” to your own Xrootd data servers’ hostname. /etc/init.d/xrootd/etc/init.d/olbd > su > cd /etc/init.d > wget http://wisconsin.cern.ch/~nengxu/xrootd_install/xrootd > wget http://wisconsin.cern.ch/~nengxu/xrootd_install/olbd > chmod 755 xrootd > chmod 755 olbd pcuw101 pcuwsun01 pcuwsun02

  9. STEP Five:START the whole pool!! • Go to each machine and do: > su > cd /etc/init.d > xrootd start > olbd start pcuw101 pcuwsun01 pcuwsun02

  10. STEP Six:File transfer test: • Follow STEP 2 to install ROOT on your desktop or laptop. • After installation, you can start the test. > source /opt/root/bin/thisroot.sh > xrdcp anyfile.txt root://pcuw101.cern.ch//xrootd/test/anyfile.txt [xrootd] Total 36.03 MB |====================| 100.00 % [49.6 MB/s] > xrdcp root://pcuw101.cern.ch//xrootd/test/anyfile.txt anyfile_back.txt [xrootd] Total 36.03 MB |====================| 100.00 % [49.6 MB/s] pcuw101 your laptop pcuwsun01 pcuwsun02

  11. STEP Seven:PROOF function test • source /opt/root/bin/thisroot.sh • mkdir ~/proof_test • cd ~/proof_test • wget http://wisconsin.cern.ch/~nengxu/xrootd_install/PROOF_test.tgz • tar zxvf PROOF_test.tgz • cd PROOF_test • xrdcp proof_test._00001.root root://your_redirector//xrootd/test/proof_test/proof_test._00001.root • xrdcp proof_test._00002.root root://your_redirector//xrootd/test/proof_test/proof_test._00002.root • Modify run.C, changeTProof::Open("nengxu@pcuw101.cern.ch") to TProof::Open(“yourname@your_redirector") • Modify makechain.C, change chain->Add("root://pcuw101.cern.ch//xrootd/test/proof_test/"+filename) to chain->Add("root://your_redirector//xrootd/test/proof_test/"+filename)

  12. STEP Seven:PROOF function test • Start running the PROOF job: • Then, you should be able to see these windows. > source /opt/root/bin/thisroot.sh > root –l [root] .x run.C Starting master: opening connection ... Starting master: OK Opening connections to workers: 1 out of 8 (10 %) PROOF set to parallel mode (8 workers)

  13. Congratulations!! You have your Xrootd/PROOF pool ready!

More Related