1 / 15

Technology for Using High Performance Networks or How to Make Your Network Go Faster….

Technology for Using High Performance Networks or How to Make Your Network Go Faster…. Robin Tasker (r.tasker@dl.ac.uk) UK Light Town Meeting 9 September 2004. Throughput? What’s the problem?. One Terabyte of data transferred in less than an hour.

wesley
Download Presentation

Technology for Using High Performance Networks or How to Make Your Network Go Faster….

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Technology for Using High Performance Networks or How to Make Your Network Go Faster…. Robin Tasker (r.tasker@dl.ac.uk) UK Light Town Meeting 9 September 2004

  2. Throughput? What’s the problem? One Terabyte of data transferred in less than an hour On February 27-28 2003, the transatlantic DataTAG network was extended, i.e. CERN - Chicago - Sunnyvale (>10000 km). For the first time, a terabyte of data was transferred across the Atlantic in less than one hour using a single TCP (Reno) stream. The transfer was accomplished from Sunnyvale to Geneva at a rate of 2.38 Gbits/s

  3. Just the Internet2 Land Speed Record… So you thought 2.38 Gbits/s was good? OK We can get transatlantic rates of 6.5 Gbits/s, but how was that done? What’s the magic?

  4. Just a Well Engineered End-to-End Connection End-to-End “no loss” environment from CERN to Sunnyvale! At least a 2.5 Gbits/s capacity pipe on the end-to-end path Processor speed and system bus characteristics TCP Configuration – window size and frame size (MTU) Network Interface Card and associated driver and their configuration A single TCP connection on the end-to-end path Memory-to-Memory transfer; no disk system involved No real user application That’s to say the devil is in the detail… Client Campus Regional Internet Regional Campus Server Sorry. No magic here…..

  5. Just a Well Engineered End-to-End Connection End-to-End “no loss” environment At least a 2.5 Gbits/s capacity pipe on the end-to-end path Processor speed and system bus characteristics TCP Configuration – window size and frame size (MTU) Network Interface Card and associated driver and their configuration A single TCP connection on the end-to-end path Memory-to-Memory transfer; no disk system involved No real user application Even with UK Light, the devil is in the detail …and it’s harder! Client Campus UK Light Campus Server And how about the same across UK Light?

  6. The Easy Bits…. :-) • End-to-End “no loss” environment • At least a 2.5 Gbits/s capacity pipe on the end-to-end path • Processor speed and system bus characteristics • TCP Configuration – window size and frame size (MTU) • Network Interface Card and associated driver and their configuration

  7. Read the Details Here http://grid.ucl.ac.uk/nfnn.html

  8. Now for the hard bits…

  9. A Single TCP Connection

  10. Fortunately there’s good news! Comparison of TCP stack performance under loss rate of 1 in 10**6, RTT=108ms High Speed TCP Rapid recovery Scalable TCP Very rapid recovery Standard TCP Recovery >10 minutes

  11. Memory to memory; no disk system High Speed TCP transfer using Iperf, i.e. no disk system and no application Web100 records of High Speed TCP during a http-Get data transfer, i.e. disk system but no application

  12. Understanding disk systems

  13. No real user application High Speed TCP transfer using Iperf, i.e. no disk system and no application Web100 records of High Speed TCP during a http-Get data transfer, i.e. disk system but no application Web100 records of High Speed TCP during a GridFTP data transfer, i.e. disk system and real user application

  14. Understand your Application It’s YOUR application, so remember Three Golden Rules Benchmark! Benchmark!! Benchmark!!!

  15. Book Early!!! - Provisionally - Tuesday 1st – Wednesday 2nd March 2005 NeSC http://grid.ucl.ac.uk/nfnn.html

More Related