1 / 15

DCAF (DeCentralized Analysis Farm)

DCAF (DeCentralized Analysis Farm). Kihyeon Cho (CHEP, KNU). Fermilab (CDF). KorCAF (DCAF in Korea). Korea CHEP. (On the behalf of HEP Data Grid Working Group). Production Farm. Ref. Mark Neubauer. CAF (Central Analysis Farm). FCC (Feynman Computer Center). Stage 1 & 2

marcy
Download Presentation

DCAF (DeCentralized Analysis Farm)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. DCAF (DeCentralized Analysis Farm) Kihyeon Cho (CHEP, KNU) Fermilab (CDF) KorCAF (DCAF in Korea) KoreaCHEP (On the behalf of HEP Data Grid Working Group)

  2. Production Farm Ref. Mark Neubauer

  3. CAF (Central Analysis Farm) FCC (Feynman Computer Center) • Stage 1 & 2 • Feynman Computer Center (FCC) at Fermilab • for CDF Experiment • 306 Dual CPUs and 180TByte

  4. Integer CAF Design • CAF design considered: • Submit jobs from 'anywhere‘ • Job output can be sent directly to desktop or stored on CAF for later retrieval Ref. Mark Neubauer

  5. Why DCAF and SAM for CDF? • Requirement set by goal • 200 simultaneous users should analyze 107 events in a day • Need ~700 TB of disk and ~5THz of CPU by end of FY’05  DCAF (DeCentralized Analysis Farm) • SAM (Sequential Access through Meta data) • To handle real data at Fermilab for DCAF around world • Gridification of DCAF via SAM Grid • KorCAF (DeCenteralized Analysis Farm in Korea)

  6. CAF or DCAF in Korea (KorCAF) Proposed Schemes for SAMGrid

  7. A Design of KorCAF for CDF (Fermilab) Grid FCC (CAF) STKen fcdfsam Technical Request stager 1TB buffer (FCC) dCache CDFen (Raw Data) rcp, GridFTP bbftp Calibration Data rcp dCache CHEP (KCAF) User Desktop KCAF Head Node CAFGUI ICAFGUI KCAF Cluster stager SAM Station (KCAF) rcp cp Smaster FSS, Stager RemoteDesktop ICAF FTP server

  8. Schedule for DCAF & SAMGrid • Nov. 2002 – Installed JIM v0.0 and demo on SC2002 • July-August 2003 – Installing DCAF v1.0 • Oct. 2003 – To install JIM (Job Information Management) v1.0 environment based on DCAF • Nov. 2003 – demo on SC2003 by users

  9. Methods for SAMGrid for CDF CDF SAMGrid SAM (for real data) DCAF (DeCentralized Analysis Farm) Installing PBS batch (each institutes) Current CAF(Central Analysis Farm) current

  10. Testbed at CHEP

  11. CDF Grid Testbed at CHEP • DCAF: C73, C46~C49 (5 machines, 10 CPUs) • PBS Batch: (20 machines, 23 CPUs)  Total Grid Test bed: 25 machines (33 CPUs)

  12. 155Mbps US Fermilab 155Mbps APII TEIN … Hyeonhae/I Genkai … Seoul 40Gbps Daegu CHEP 1Gbps 2 x 155Mbps 155Mbps Busan 2 X 1Gbps Network between CHEP and Fermilab • Network Test (Parallel ftp’s are used) • ~60 Mbps (155 Mbps/1Gbps) via Hyeonhae/Genkai • ~30 Mbps ( 155 Mbps) via Star-tap Daejeon

  13. Installation of DCAF & SAMGrid SAM Grid Fermi Lab

  14. SAMGrid Monitoring Page

  15. DCAF Activities • SAMGrid demo was showed at SC2002. • 6 institutes (KNU, Toronto, RAL, Rutgers, Texas Tech, Glasgow) were involved for CDF experiment. • At KNU, 12 CPUs were allocated for SAM Grid Demo • UCSD made testbed for DCAF. • KorCAF(DCAF in Korea) is the first for analysis farm at CDF experiment as DCAF • For the first step, to use the KorCAF as MC production farm. Later, real data… • Prepare for SC2003 Demo for SAMGrid

More Related