200 likes | 396 Views
GNET-1:Gigabit Ethernet Network Testbed. Y. Kodama, T. Kudoh, R. Takano, H. Sato, O. Tatebe , S. Sekiguchi Grid Technology Research Center National Institute of Advanced Industrial Science and Technology (AIST). Outline. About GNET-1 Aims of GNET-1 Hardware components of GNET-1
E N D
GNET-1:Gigabit EthernetNetwork Testbed Y. Kodama, T. Kudoh, R. Takano, H. Sato, O. Tatebe, S. Sekiguchi Grid Technology Research Center National Institute of Advanced Industrial Science and Technology (AIST)
Outline • About GNET-1 • Aims of GNET-1 • Hardware components of GNET-1 • Usages of GNET-1 • Comparison with NIST Net • Emulation of a network with bit error • Measurement of precise one-way delay/jitter • Smooth traffic shaping • Conclusion and Future Plans CLUSTER 2004
Aims of GNET-1 • A network emulator is required for developing grid middleware. • Reproducible environment to verify the performance • Changing parameters • Latency, bandwidth, bit error rate, buffer size, buffer control … • More accuracy and performance • Software-based emulators are not enough. • Flexibility for adding functions with keeping the performance • Required functions are depend on the situations GNET-1: a hardware emulator based on a FPGA CLUSTER 2004
The Look of GNET-1 GNET-1 GNET-1 Control SNMP Agent Width:19inch, Height:1U(1.7inch) GBIC: 4 ports USB CLUSTER 2004
Block Diagram of GNET-1 via GBIC I/F CLUSTER 2004
GNET-1 GNET-1 GNET-1 GNET-1 GNET-1 Usage of GNET-1 • Emulation • Changing a delay, bit error rate, output bandwidth, buffer size, buffer control, etc. • Measurement • Precise network statistics • input/output bandwidth in every 100 microsecond. • Synchronize the local clock using GPS. • New Protocol prototyping • Proposing protocol in feasibility study. Internet CLUSTER 2004
Outline • About GNET-1 • Aims of GNET-1 • Hardware components of GNET-1 • Usages of GNET-1 • Comparison with NIST Net • Emulation of a network with bit error • Measurement of precise one-way delay/jitter • Smooth traffic shaping • Conclusion and Future Plans CLUSTER 2004
Comparison with NIST Net --- latency --- • NIST Net: average differences and variances were almost 100 us. • In GNET-1, they were almost zero. NIST Net version 2.0.11 using 2-way SMP of Xeon 2.4 GHz with three INTEL/PRO 1000 NICs on Red Hat 9.0 CLUSTER 2004
Comparison with NIST NET --- throughput --- NIST Net: throughputs with delays were about 100Mbps decreased from throughput with no delay. GNET-1: throughputs in all cases were the wire-rate speed. These results show that GNET-1 can emulate networks with accurate latency and high throughput. CLUSTER 2004
Emulation of a network with bit error GNET-1 • Insert delay (50ms), • Generate random bit error (1.0x10-10), • Measurement bandwidth(100ms) GNET-1 is usefull for new protocol development and evaluations. CLUSTER 2004
1. Clock synchronized with GPS 2. Send packets with send time (MTU:1500) 1 1 3. Receive packets and forward them with receive time (MTU:64) 3 2 4 4. Capture packet, then calculate latency and jitter offline. Measurement of precise one-way latency (experiment environment) GPS Internet GNET-1 GNET-1 Sending time Sending time and Receiving time 40Mbps Capture for 1Gbps stream CLUSTER 2004
Measurement of precise one-way latency (measured network) SC03(PHOENIX) GNET-1 SuperSINET(via NewYork) 1G 1G APAN/TransPAC(via LA) GNET-1 AIST(JAPAN) CLUSTER 2004
Measurement of precise one-way latency (result) Measured jitter of latency will be introduced in GNET-1. CLUSTER 2004
Peak 1Gbps RTT RTT RTT > 2.4 Gbps Smooth traffic shaping (problem) • Why traffic on Long Fat Pipe is not stable ? But sometimes packets are lost ! 500Mbps Stream A 500Mbps Stream B 1.5Gbps < 2.4Gbps 500Mbps Stream C LongFatPipe 2.4Gbps TCP has software pacing by self clocking of ACK packet, but it is not always effective. CLUSTER 2004
Smooth traffic shaping (function) • GNET-1 has hardware pacing by adjusting IFG (Inter Frame Gap) • GNET-1 can set IFG by the value adapted to the frame length, as well as it can set it to a fixed value. 1Gbps 500Mbps GNET-1 0Mbps IFG = Frame Len. CLUSTER 2004
Peak 1Gbps RTT RTT RTT Smooth traffic shaping (will be solved) • Traffic on Long Fat Pipe become stable. GNET-1 500Mbps Stream A < 2.4Gbps GNET-1 500Mbps Stream B 1.5Gbps GNET-1 500Mbps Stream C LongFatPipe CLUSTER 2004
Smooth traffic shaping (experiment) Bandwidth Challenge in SC'03 Trans-Pacific Gfarm Datafarm testbed 147 nodes 16 TBytes 4 GB/s SuperSINET Indiana Univ Titech Trans-Pacific thoretical peak 3.9 Gbps Gfarm disk capacity 70 TBytes disk read/write 13 GB/sec SuperSINET NII 2.4G 10 nodes 1 TBytes 0.3 GB/s Abilene Univ Tsukuba NY 2.4G(1G) SC2003 Phoenix KEK 7 nodes 4 TBytes 0.2 GB/s OC-12 ATM 32 nodes 23 TBytes 2 GB/s 500M Chicago Tsukuba WAN APAN Tokyo XP Maffin 16 nodes 12 TBytes 1 GB/s AIST LA 2.4G 16 nodes 12 TBytes 1 GB/s APAN/TransPAC SDSC CLUSTER 2004
Smooth traffic shaping (results of BWC03) 950 Mbps in NY (+20) 500 Mbps in Chicago 800 Mbps in LA3 750 Mbps in LA2 780 Mbps in LA1 (-20) 930 Mbps in NY 500 Mbps in Chicago 800 Mbps in LA3 750 Mbps in LA2 800 Mbps in LA1 • Achieved stable 3.78Gbps Disk to Disk data transfer on 3.9 Gbps,144ms long-fat network. • Currently the shaping bandwidth is defined by user, we will make automatic tuning facility. CLUSTER 2004
Conclusion and Future Plan • GNET-1 is a useful tool for developing network-aware software. • Other functions • SNMP agent for GNET-1 • Emulation • tail-drop, RED, credit-base bandwidth control • Frame capture, etc. • Refer to http://www.gtrc.aist.go.jp/gnet/ about details of GNET-1. • Developing a new tool for 10GbE CLUSTER 2004
Photograph of GNET-10 19 inch rack mountable 2U height FPGA:XC2VP75 x 2 Memory: 1GByte x 2 10GbE: LR 2 ports 1GbE: GBIC 2ports CLUSTER 2004