1 / 37

Network Plan for High Energy Physics

January 29, 2009 GLORIAD Kick-off workshop KISTI, Daejeon. Network Plan for High Energy Physics. Kihyeon Cho. To do list. To study b physics at CDF Bring files from Fermilab to KISTI 12 TByte of J/psi Production files (4fb^-1) ICAF@Fermilab -> File server @KISTI Run Pacific CAF

senona
Download Presentation

Network Plan for High Energy Physics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. January 29, 2009 GLORIAD Kick-off workshop KISTI, Daejeon Network Plan for High Energy Physics Kihyeon Cho

  2. To do list • To study b physics at CDF • Bring files from Fermilab to KISTI • 12 TByte of J/psi Production files (4fb^-1) • ICAF@Fermilab -> File server @KISTI • Run Pacific CAF • To bring/send files from KEK to KISTI => Network studies • To participate at SC09 data challenge => History of bandwidth challenge

  3. Networks yesterday vs. today • CHEP-abroad Nov. 2005 • TEIN • 현해-겐까이 • 한-중 • GLORIAD • KISTI-abroad Jan. 2009 • GLORIAD

  4. BW: Upper bound of TCP throughput MSS: Max Segment Size RTT: Round Trip Time P: Packet Loss Network Mathis Equation • TEIN • 현해-겐까이 • 한-중 • GLORIAD

  5. USA Kreonet Gloriad 10G 5G->10G TransPAC/LA LHCnet 2.5G 10G APII/H-G Japan 1.2 G * 2 1 G CERN/Geneva KOREN TEIN 155 M 1 G KNU CC 1 G Cisco7606 CHEP Cisco6509 Network Test PC … … Servers/PCs … 100 M … … HSM Servers Networks between CHEP and abroad (Nov. 2005)

  6. APII KR-JP (2Gbps) JP KR CN VN HK PH TH MY SG ID AU North America (via TransPAC2, 10Gbps) APII KR-CN (155Mbps) EU 622 622 622 622 155 622 45 622 TEIN2(2006.1) EU 155 3 x 622 45 4 x 155 45 Ref. 김병규박사

  7. TEIN(CHEP, Korea – ETH, Europe) • Nov. 10~24, 2005 (2 weeks) • RTT (340ms) • Packet loss is low.

  8. APII Hyeonhae-Genkai(CHEP, Korea – Kyushu Univ., Japan) • Nov. 10~24 (2 weeks) • Packet loss is low. • However, problems after Nov. 17 • Routing problem -> 200ms RTT (Routing was a detour thru Sinet)

  9. KR-CN 155Mbps(CHEP – China) • China: cernet.edu.cn • Nov. 10~24 (2weeks) • Periodical Packet loss • Problem of Routing? -> 200 ms

  10. GLORIAD(CHEP, Korea – Fermilab, USA) • Nov. 10~24 (2 weeks) • Packet loss is low. • RTT is unstable.

  11. Problems of International Networks (2005) • Routing is frequently changed so that it is difficult for users to use it stably. • In China and Japan, some times it gives very long RTT due to routing changing. • In USA, RTT is sometimes unstable. • We need more servers and monitoring to check it

  12. CERN/ IN2P3 GLORIAD/1Gbps Chicago StarLight/10Gbps Seattle Fermilab ESnet/10Gbps GLORIAD-KR/10Gbps KISTI GLORIAD-KR/10Gbps KEK CSTNet-APAN-JP/1Gbps Hong Kong Networks between KISTI and abroad (Jan. 2009)

  13. KISTI-CERN (1/6~1/20/09)

  14. KISTI-Fermilab

  15. IN2P3

  16. KEK 100 ms?

  17. KEK -> KISTI

  18. Problems of International Networks (2008) • GLORIAD is stable. • However, only GLORIAD is available i.e.10Gbps is maximum at KISTI while 20Gbps is maximum at KNU. • In Japan, it gives very long RTT. • We need more servers and monitoring to check it

  19. Ref. Harvey Newman

  20. Kreonet KOREN HPSS Network 경로 SC2004, USA APII/KREONET2 2 X 622 M 2.5G TransPAC 2.5G->LA, 10G->Chicago DataTaG 10G APII/H-G 2 X1 G Japan CERN/Geneva 1 G TEIN 155 M 1 G KNU CC 1 G 1 G Cisco7606 Cisco4506 Cisco6509 1 G Network Test PC (RAID Disk) Network Test PC … … Servers/PCs … CHEP 100 M … … HSM Clustered PCs Servers Ref. 권기환

  21. World Record (101.13Gbps)

  22. Domestic Records (1.6Gpbs)

  23. Press released word breaking record news! 전자신문 2004년 12월 2일

  24. Demonstration @ SC2005 • Date: Nov. 14 ~ 18, 2005 • Place: Seattle, USA • Using GLORIAD network • Participating on Bandwidth Challenge • With Caltech partner • Most are CMS Collaborations Bandwidth Award

  25. Data Flow to Caltech Booth • 22X10GE Waves: - Fermilab, Clatech, SLAC, BNL, CERN과 other partner Grid Service sites including Michigan, Florida, Manchester, Rio de Janeiro(UERJ) and Sao Paulo(UNESP) in Brazil, Korea(KNU) and Japan(KEK) • 결과 • 24시간이내 물리자료 475Terabyte 전송 • 131.57 Gbps with 17waves - SC2004결과: 101Gbps

  26. Seattle-Korea Traffic • Iperf test From Seattle to Korea (Max 7.051 Gbps)

  27. SC07 (Reno) KNU, KISTI

  28. Results of SC07

  29. SC08 (Austin) – KNU 참가

  30. Result of SC08 110Gbps (114Gbps peak) Bandwidth Challenge Award

  31. To do list • To study b physics at CDF • Bring files from Fermilab to KISTI • 12 TByte of J/psi Production files (4fb^-1) • ICAF@Fermilab -> File server @KISTI • Run Pacific CAF • To bring/send files from KEK to KISTI => How to bring files? • To participate at SC09 data challenge => What to do at the bandwidth challenge

  32. Back-ups

  33. CDF J/psi(dimuon) Trigger Data xpmm = xpmm0d+xpmm0h+xpmm0i+xpmm0j xpmm0d File Count: 4,060 Average File Size: 277.76MB Total File Size: 1.08TB Total Event Count: 24,782,207 xpmm0h File Count: 1,149 Average File Size: 904.94MB Total File Size: 1015.41GB Total Event Count: 20,632,030 xpmm0i File Count: 1,531 1,281 Average File Size: 1.33GB 1.32GB Total File Size: 1.98TB 1.65TB Total Event Count: 44,560,758 32,262,419 xpmm0j File Count: 1879 1365 Average File Size: 1.32GB 1.31GB Total File Size: 2.42TB 1.75TB Total Event Count: 43869292 30388072 Total File Size ~ 4.08 TB  6.17 TB : 5.5TB Total Liminosity ~ 1.6 fb-1 > 2 fb-1 : > 2fb-1 Sep. 2007 Nov. 2007 • Collected b/w 2002.2 ~ 2007.7 • Detector • Silicon vertex Tracker • Central Tracker • Muon detector • Trigger • L1 - charged track (PT>1.5 GeV) matched muon detector • L2 - di-muon, opposite charge • L3 – di-muon mass (2.7 – 4.0 GeV)

  34. KNU & CHEP KREONET KOREN IPv6 Lambda Deegu Daejeon IPv6 KNU CHEP 203.255.252.192/29 2001:220:404::/64 1G 5G->10G 1G UTP CISCO 3550-12T 203.255.252.197 1G CISCO ONS15454 100M UTP 155.230.20/22 1G 1G 1G 1G 100M Border Router CISCO 7606 CISCO 6509 LCG Farm 134.75.85.160/29 2001:320:0201::/48

More Related