1 / 8

Weekly Work Dates:2010 8/20~8/25 Subject:Condor C.Y Hsieh

Weekly Work Dates:2010 8/20~8/25 Subject:Condor C.Y Hsieh. Introduction. 1988, University of Wisconsin-Madison High Throughput Computing (HTC) High-Performance Computing(HPC),ex:MPI 。 High-Throughput Computing (HTC),ex:Condor 。 How to work?. How to work?. Pool. Job1. CPU1.

zoey
Download Presentation

Weekly Work Dates:2010 8/20~8/25 Subject:Condor C.Y Hsieh

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Weekly WorkDates:2010 8/20~8/25 Subject:Condor C.Y Hsieh

  2. Introduction • 1988, University of Wisconsin-Madison • High Throughput Computing (HTC) High-Performance Computing(HPC),ex:MPI。 High-Throughput Computing (HTC),ex:Condor。 • How to work?

  3. How to work? Pool Job1 CPU1 Job2 CPU2 Condor Job3 CPU3 users upload jobs distribute ： ： ： ： ： ： ： ： ： ： Job4 CPU4

  4. The Architecture of Condor Only one A.collector B. negotiator Central Manager Step3 Step1 Step2 Submit Machine Execute Machine Step4 Any ,more than one Submit Job Any ,more than one Execute job

  5. Setting • Master: central manager submit machine execute machine. • Node1 submit machine execute machine. • Node2 submit machine execute machine. Master Central manager Submit machine Execute machine CPU1 CPU2 Node1 Submit machine Execute machine Node2 Submit machine Execute machine CPU1 CPU2 CPU1 CPU2

  6. Install Condor #download file from websit to /etc/yum.repos.d cd /etc/yum.repos.d wge http://www.cs.wisc.edu/....... wget http://www.cs.wisc.edu/...... #install condor yum install condor # Edit Condor's configuration file vi /etc/condor/condor_config #Globle configuration vi /etc/condor/condor_config.local #Local configuration # Start Condor daemons service condor start

  7. # Check the number of CPU in the pool condor_status Name OpSys Arch State Activity LoadAv Mem ActvtyTime slot1@master LINUX INTEL Unclaimed Idle 0.160 1013 0+00:00:04 slot2@master LINUX INTEL Unclaimed Idle 0.000 1013 0+00:00:05 slot1@node1 LINUX INTEL Unclaimed Idle 0.150 251 0+00:00:04 slot2@node1 LINUX INTEL Unclaimed Idle 0.000 251 0+00:00:05 Total Owner Claimed Unclaimed Matched Preempting Backfill INTEL/LINUX 4 0 0 4 0 0 0 Total 4 0 0 4 0 0 0

  8. # Check if Condor is running ps -ef | grep condor #master condor 4892 1 0 13:12 ? 00:00:01 /usr/sbin/condor_master -pidfile /var/run/condor/condor.pid condor 4893 4892 0 13:12 ? 00:00:00 condor_collector -f condor 4894 4892 0 13:12 ? 00:00:01 condor_negotiator -f condor 4895 4892 0 13:12 ? 00:00:00 condor_schedd -f condor 4896 4892 0 13:12 ? 00:00:04 condor_startd -f root 4906 4895 0 13:12 ? 00:00:00 condor_procd -A /var/run/condor/procd_pipe.SCHEDD -R 10000000 -S 60 -C 103 root 6265 3840 0 13:32 pts/3 00:00:00 grep condor #node condor 3914 1 0 21:16 ? 00:00:00 /usr/sbin/condor_master -pidfile /var/run/condor/condor.pid condor 3915 3914 0 21:16 ? 00:00:00 condor_schedd -f condor 3916 3914 0 21:16 ? 00:00:04 condor_startd -f root 3917 3915 0 21:16 ? 00:00:00 condor_procd -A /var/run/condor/procd_pipe.SCHEDD -R 10000000 -S 60 -C 103 root 3983 3370 0 21:36 pts/2 00:00:00 grep condor

More Related