120 likes | 233 Views
Monitoring the 10 Gigabit Abilene Backbone. J örg Micheel <joerg@nlanr.net>. Passive measurement hardware. Collect all data without loss (buffer, indicate loss) Flexible payload discard, early Provide accurate local/global timing of packet arrivals
E N D
Monitoring the10 Gigabit Abilene Backbone Jörg Micheel <joerg@nlanr.net> Joint Techs, Columbus, OH
Passive measurement hardware • Collect all data without loss (buffer, indicate loss) • Flexible payload discard, early • Provide accurate local/global timing of packet arrivals • Have host CPU(s) available for analysis and display • Optionally accelerate analysis computation Joint Techs, Columbus, OH
PCI bus vs. network links Joint Techs, Columbus, OH
NICs vs. NMCs • NICs have inherent packet rate limit due to per packet buffer and interrupt handshake • Interrupts are more costly than ever before! • Do away with classic NIC driver, specialized driver and API library • NMCs use single circular buffer with overflow control • Handshake between HW and application • Zero copy data transfer (DMA into user space) • Network analysis at uncached RAM performance (i.e. 1450 MByte/sec on Dell 2650) Joint Techs, Columbus, OH
Some performance tests • GigE cards: D-Link, SysKonnect 9843, DAG4.3GE • OC48c PoS cards: Lucent OptiStar, Dag4.3 OC48c • libpcap interface (straight, mmap), DAG API library • Fake application: CRC32 computation • Result: line rate performance for all NMCs • Result: can do full bidirectional Gigabit to RAID0 array Joint Techs, Columbus, OH
DAG6 OC192c/10GigE Joint Techs, Columbus, OH
Abilene backbone 2004 Joint Techs, Columbus, OH
IPLS installed NLANR gear • Two NLANR OC192MONs, one OC48MON, CDMA time synchronization via Praecis Ct and TDS-24 • Instrumented all present Abilene backbone links (IPLS-KSCY, IPLS-CHIN, IPLS-ATLA) • Planned to stay there for the lifetime of the backbone Joint Techs, Columbus, OH
Measurement and Analysis • Collect substantial backbone data set (Abilene-3) • Stratified random sampling over weeks (Abilene-4) • Landspeed record load; impact studies on application and network performance • Monitoring TCP happiness via real time application • NLANR real time applications • Router delay studies • More challenges from collaborators! Joint Techs, Columbus, OH
Abilene-3 data set analysis Joint Techs, Columbus, OH
Acknowledgements • Koryn Grant, Endace • Matt Zekauskas, Rick Summerhill, Caroline Carver, Internet2 • John Hicks, TransPAC/Indiana Joint Techs, Columbus, OH
References • http://198.202.123.33/Special/ipls3.html • http://198.202.123.33/Sites/ipls-2004/ • http://198.202.123.33/Special/ipls3/ • ftp://198.202.123.33/traces/long/ipls/3/ Joint Techs, Columbus, OH