1 / 17

Network monitoring on 10GbE

Network monitoring on 10GbE. Y. Kodama ITRI (Information Technology Research Institute) AIST (National Institute of Advanced Industrial Science and Technology). ITRI, AIST. GTRC (Grid Technology Research Center) was finished March 2008.

lanza
Download Presentation

Network monitoring on 10GbE

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Network monitoring on 10GbE Y. Kodama ITRI (Information Technology Research Institute) AIST (National Institute of Advanced Industrial Science and Technology) NEGST2008 @ Toulouse 2008/6/24

  2. ITRI, AIST • GTRC (Grid Technology Research Center) was finished March 2008. • Research activities of GTRC were merged to ITRI (Information Technology Research Institute), and continues research of Grid middleware and infrastructure. • The director of ITRI is Sekiguchi who was the director of GTRC. NEGST2008 @ Toulouse 2008/6/24

  3. GtrcNET-10 • GtrcNET is a fully programmable hardware network box. • GtrcNET-1, which has 4 ports of GbE, was produced in 2003. • GtrcNET-10, which has 3 ports of 10GbE, was produced in 2005. NEGST2008 @ Toulouse 2008/6/24

  4. SO-DIMM DDR333 10GbE XENPAK. SO-DIMM DDR333 10GbE XENPAK SO-DIMM DDR333 10GbE XENPAK Architecture of GtrcNET-10p3 1GBytes 4bit x 3.125GHz FPGA (XC2VP100) 64bit x 162MHz x 2 10GbE MAC 10GbE MAC 64bit x 156.25MHz 10GbE MAC System ACE/CF USB2.0 MICTOR GPS NEGST2008 @ Toulouse 2008/6/24

  5. Functions • Delay emulation: Up to 800 ms delay without packet losses by 1 us step. • Random frame loss: The rate of frame losses is controlled by 2-31. • Output bandwidth Control: pacing (154Mbps-10Gbps) or shaping / policing by token bucket (1Mbps-10Gbps) • Buffer size control: It controls the buffer size storing input frames up to 1 GByte by 1 KByte step. • Frame generation: It generates UDP frames with several parameters, such as frame length, bandwidth, burstiness, VLAN tag, etc. • Bandwidth measurement: It measures all of input and output bandwidth every 10ms. Two of ports are measured more precisely every 100 us. • Per-stream bandwidth measurement:using stream ID specified by any 8 bit field in header, per-stream bandwidth is measured every 1 ms. • Frame capture:Itcaptures frames in 1 GBytes of memory. It is available to capture any combination of all frames or filtered frames, and whole fields or selected header fields. • Capture Forwarding:Captured header fields are transmitted by frames. The number of captured data in a frame is controlled. Destinations are distributed up to 16 nodes. NEGST2008 @ Toulouse 2008/6/24

  6. Per-stream bandwidth 1/ge01 1/xg1 1/xg2 1/ge25 CH0 CH1 grmpi01 grmpi02 1/ge02 1/ge26 DELL 6248 vlan100 GtrcNET-10p3 (S/N:4) DELL 6248 vlan1 grmpi04 grmpi03 Str 1 Str 2 Stream ID Field NEGST2008 @ Toulouse 2008/6/24

  7. Capture frames 1/ge01 1/xg1 1/xg2 1/ge25 CH0 CH1 grmpi01 grmpi02 CH0.Rx or CH1.Rx DELL 6248 vlan100 GtrcNET-10p3 (S/N:4) DELL 6248 vlan1 duplicate CH2 Store off-chip memory 1GB USB gnetctrl3 • Capture only one-way traffic • Speed of reading captured data is slow via USB. • Duration of capture is very short • full frames: 800ms for wire-rate traffic • select header: 17sec for wire-rate traffic, when first 64bytes in 1500 bytes frame are captured, NEGST2008 @ Toulouse 2008/6/24

  8. Capture Forwarding 1/ge23 1/xg1 1/xg2 1/ge25 CH0 CH1 grmpi01 grmpi02 eth1: 192.168.2.101 CH0.Rx or CH1.Rx eth1: 192.168.2.102 GtrcNET-10p3 (S/N:4) DELL 6248 vlan100 DELL 6248 vlan1 duplicate 1/ge19 Store off-chip memory 1GB 1/xg4 grmpi05 CH2 eth1: 192.168.2.105 (00:07:E9:5C:34:9C) USB Application data gnetctrl3 Captured data 150.29.149.156 • capture forwarding traffic: 550Mbps if 64 bytes of header in 1500 bytes IP length are captured in wire-rate traffic, and 10 date are packed in a forwarding frame. NEGST2008 @ Toulouse 2008/6/24

  9. CH0 CH1 CH0 CH1 1/ge23 1/xg1 1/xg2 1/ge25 grmpi01 grmpi02 eth1: 192.168.2.101 eth1: 192.168.2.102 1/ge21 1/xg3 CH1.Rx DELL 6248 vlan100 GtrcNET-10p3 (S/N:4) GtrcNET-10p3 (S/N:2) DELL 6248 vlan1 grmpi04 CH2 eth1: 192.168.2.104 (00:07:E9:3A:C5:9F) CH0.Rx 1/ge19 1/xg4 grmpi05 CH2 eth1: 192.168.2.105 (00:07:E9:5C:34:9C) Application data USB USB Captured data gnetctrl3 150.29.149.156 Capture bidirectional traffic (1) • two GtrcNET are required. NEGST2008 @ Toulouse 2008/6/24

  10. Gi1/23 Te1/49 1/xg2 1/ge25 CH0 CH1 grmpi01 grmpi02 eth1: 192.168.2.101 eth1: 192.168.2.102 DELL 6248 vlan100 GtrcNET-10p3 (S/N:4) C4948 vlan2 Mirror: Rx/Tx/Both Gi1/19 Te1/50 grmpi05 CH2 CH2.Rx eth1: 192.168.2.105 (00:07:E9:5C:34:9C) Application data Gi1/47 USB Mirrored data gnetctrl3 Config:192.168.2.232 150.29.149.156 Captured data Capture bidirectional traffic (2) • sum of bidirectional traffic should be less than 10Gbps. • mirrored port should be able to receive packets. NEGST2008 @ Toulouse 2008/6/24

  11. Gi1/23 Gi1/18 Gi1/32 Gi1/25 grmpi01 grmpi02 eth1: 192.168.2.101 eth1: 192.168.2.102 Mirror :Rx Gi1/21 C4948 vlan1 Te1/49 C4948 vlan2 grmpi04 CH0 GtrcNET-10p3 (S/N:2) eth1: 192.168.2.104 (00:07:E9:3A:C5:9F) Mirror: Tx Gi1/47 Gi1/19 Te1/50 CH1 USB Config:192.168.2.232 grmpi05 gnetctrl3 Application data eth1: 192.168.2.105 (00:07:E9:5C:34:9C) 150.29.149.156 Mirrored data Captured data Capture bidirectional traffic (3) NEGST2008 @ Toulouse 2008/6/24

  12. 1/ge23 1/xg3 1/xg4 1/ge25 grmpi01 grmpi02 Mirror: Rx, Tx eth1: 192.168.2.101 eth1: 192.168.2.102 DELL 6248 vlan100 1/xg1 CH0 DELL 6248 vlan1 GtrcNET-10p3 (S/N:2) 1/ge19 1/xg2 grmpi05 USB CH1 Application data gnetctrl3 eth1: 192.168.2.105 (00:07:E9:5C:34:9C) Mirrored data 150.29.149.156 Captured data Capture bidirectional traffic (4) NEGST2008 @ Toulouse 2008/6/24

  13. 1/ge23 1/xg3 1/xg4 1/ge25 CH0 CH1 grmpi01 grmpi02 eth1: 192.168.2.101 eth1: 192.168.2.102 Mirror: Rx, Tx DELL 6248 vlan100 GtrcNET-10p3 (S/N:4) DELL6248 vlan1 1/xg1 1/ge19 1/xg2 grmpi05 CH2 CH2.Rx eth1: 192.168.2.105 (00:07:E9:5C:34:9C) Application data USB Mirrored data gnetctrl3 150.29.149.156 Captured data Capture bidirectional traffic (5) NEGST2008 @ Toulouse 2008/6/24

  14. 1/ge23 1/xg3 1/xg4 1/ge25 grmpi01 grmpi02 Mirror: Rx, Tx eth1: 192.168.2.101 eth1: 192.168.2.102 Gi1/21 DELL 6248 vlan100 1/xg1 CH0 DELL 6248 vlan1 grmpi04 GtrcNET-10p3 (S/N:2) eth1: 192.168.2.104 (00:07:E9:3A:C5:9F) 1/ge19 1/xg2 grmpi05 USB CH1 Application data gnetctrl3 eth1: 192.168.2.105 (00:07:E9:5C:34:9C) Mirrored data 150.29.149.156 Captured data Distributed destination • Destination are changed in round-robin up to 16 nodes. • Traffic and stored data are divided to the destination nodes. NEGST2008 @ Toulouse 2008/6/24

  15. 1/ge1 1/xg1 Te1/49 1/ge1 grmpi01 grmpi02 Mirror: Rx, Tx eth1: 192.168.2.101 eth1.101:192.168.101.101 eth1.102:192.168.102.101 eth1: 192.168.2.102 eth1.101:192.168.101.102 eth1.102:192.168.102.102 Cisco 4948 1/xg3 CH0 DELL 6248 GtrcNET-10p3 (S/N:2) 1/ge26 1/xg4 grmpi05 USB CH1 gnetctrl3 Application data eth1: 192.168.2.105 (00:07:E9:5C:34:9C) Mirrored data 150.29.149.156 Captured data Packet filtering in capture mark = ((pos0 & mask0)== val0) and/or ((pos1 & mask1) == val1) NEGST2008 @ Toulouse 2008/6/24

  16. Example of packet filtering • capmark 0 0f 8000 8000: • TTL >= 128 • capmark 1 0a ffff 8100 and 0b ffff 0065 • VLAN tag is 101(0x65) • capmark 1 15 ffff 1389 or 16 ffff 1389 • Either srcport or dstport is 5001 • capmark 2 02 00ff 0001 • Random 1/256 • VLAN frame detect mode is supported. NEGST2008 @ Toulouse 2008/6/24

  17. Summary • Many monitoring functions are available on GtrcNET-10. • Requirements for these functions are given by co-research with AIST and INRIA Lyon. • Experimental results and analysis on real network monitoring will be presented by Paulo INRIA Lyon. • Please visit our web page http://www.gtrc.aist.go.jp/gnet/ NEGST2008 @ Toulouse 2008/6/24

More Related