220 likes | 346 Views
The 3 rd International HEP DataGrid Workshop. Large File Transfer on 20,000 km - Between Korea and Switzerland -. 2004.8.26 Yusung Kim, Daewon Kim, Joonbok Lee, Kilnam Chon yskim@cosmos.kaist.ac.kr. Korea Advanced Institute of Science and Technology. Content. 1. Objective
E N D
The 3rd International HEP DataGrid Workshop Large File Transfer on 20,000 km- Between Korea and Switzerland- 2004.8.26 Yusung Kim, Daewon Kim, Joonbok Lee, Kilnam Chon yskim@cosmos.kaist.ac.kr Korea Advanced Institute ofScience and Technology
Content 1. Objective 2. Factors Affecting Performance 3. Experiment Overview 4. Experiment on 20,000 km between Korea and Switzerland 5. Experiment on 10,000 km between Korea and USA 6. Experiment Result Summary 7. Issues 8. Further Work 9. Conclusion Appendix
1. Objective • To obtain maximum throughput on 20,000 km between Korea and Switzerland
2. Factors Affecting Performance 1) Distance 2) Number of Streams 3) Transport Protocol 4) Routing 5) Server • CPU, RAM, OS (Linux,…)
4.1 Network Diagram : 20,000 km between Korea and Switzerland 622M 1 G 10 G Korea USA/Canada Switzerland KAIST CA*net 4 StarLight DataTag / CERN host 1GbE OC 192 3Com 4924 Juniper T320 Juniper T320 10 GbE 1GbE KREONET 1 GbE Cisco 7609 Cisco 7609 1 GbE 1GbE Daejeon Seattle Chicago 2 x 1GbE host 1GbE 1GbE 2 x OC 12 Starlight Force10 GSR 12406 ONS 15454 ONS 15454 ONS 15454 Edoardo Martelli / CERN
BIC TCP FAST TCP TCP Reno 4.2 Experiment results on 20,000 km between Korea and Switzerland throughput (Mbps) RTT : 360 ms (5hops) Effective Bandwidth : 622 Mbps number of streams
Abilene LA CENIC 5.1 Network Diagram : 10,000 km between Korea and USA Daejeon, KoreaKREONET Seattle, US PNG 1 G 10 G 622 Mbps 2 x 1GbE ONS 15454 GSR 12406 2 x OC 12 ONS 15454 1GbE 1 GbE Foundry BigIron 400 Cisco 7609 KAIST OC 192 Caltech 1GbE host Cisco7606 OC 192 3com 4924 1GbE host ONS 15454 OC 192 ONS 15454 Yang Xia / Caltech
TCP Reno by SLAC* BIC TCP FAST TCP TCP Reno • 10,000 km between Stanford Linear Accelerator Center (SLAC) and CERN, RTT 170 ms, 622 Mbps (see Appendix A) 5.2 Experiment results on 10,000 km between Korea and USA throughput (Mbps) RTT : 203 ms (7hops) Effective Bandwidth: 622 Mbps number of streams
5.3 Result comparison : 20,000 km, 10,000 km, and 200km Link utilization (%) 20,000 km : Korea – Switzerland 10,000 km : Korea – USA 200 km : Korea – Korea number of streams
6. Experiment Result Summary • BIC TCP performed better than others.
7. Issues 1) Lambda Networking can support higher throughput on high speed and long latency network? 2) We need to analyze TCP behavior including window sizemanagement on TCP Reno, FAST TCP, and BIC TCP. 3) Some multiple streams showed lower throughput thanthose with smaller number of streams.(specially on 10,000 km)
8. Further Work • Large File Transfer experiment with 10 Gbps on 20,000 km in late 2004 or early 2005
9. Conclusion • We experimented large file transfer on 20,000km with 3 kinds of transport protocols. • BIC TCP performed better than others. • We need a further investigation of the multiple stream performance.
Appendix A. 10,000 km experiment between SLAC and CERN on 2003.10.23 • RTT : 170 ms • Effective Bandwidth : 622 Mbps • Each transfer for 20 min [http://www-iepm.slac.stanford.edu/bw/tcp-eval/cern/index.html] * SLAC : Stanford Linear Accelerator Center, http://www.slac.stanford.edu/ * CERN : Conseil Européen pour la Recherche Nucléaire, http://www.cern.ch/
B. 10Gbps experiment on 10,000 km between Caltech and CERN on 2004.5.6 • 10959 km (172 ms) • 7Gbps: transferred 860 GB in 16 min • Using 8 streams [http://ultralight.caltech.edu/lsr-winhec/]
D.1. Network Diagram: KAIST - Kyungpook Univ. KREONET KAIST Kyungpook Univ. Daejeon Daegu 3Com 4924 host 2.5 G 1GbE 1GbE Cisco 7609 Cisco 7507 1GbE host
BIC TCP FAST TCP TCP Reno D.2 Experiment results on 200km between KAIST and Kyungpook Univ. throughput (Mbps) RTT : 2.7 ms (2 hops) 1 Gbps link number of streams