130 likes | 269 Views
Discussion of Methodology for MPLS QoS & High Performance High throughput Investigations. MAN OSM-4GE-WAN-GBIC. UCL OSM-4GE-WAN-GBIC OSM-1OC48-POS-SS. MCC OSM-4GE-WAN-GBIC OSM-1OC48-POS-SS. WorldCom. SJ4 Dev C-PoP Warrington 12416. Leeds. SuperJANET4 Production Network. SJ4 Dev
E N D
Discussion of Methodology forMPLS QoS & High Performance High throughput Investigations MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
MAN OSM-4GE-WAN-GBIC UCL OSM-4GE-WAN-GBIC OSM-1OC48-POS-SS MCC OSM-4GE-WAN-GBIC OSM-1OC48-POS-SS WorldCom SJ4 Dev C-PoP Warrington 12416 Leeds SuperJANET4 Production Network SJ4 Dev C-PoP London 12416 SJ4 Dev C-PoP Reading 12416 UCL OSM-4GE-WAN-GBIC WorldCom WorldCom MB – NG SuperJANET4 Development Network Gigabit Ethernet 2.5 Gbit POS Access 2.5 Gbit POS core MPLS Admin. Domains RAL/ UKERNA OSM-4GE-WAN-GBIC Dark Fiber (SSE) MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
High Performance High Throughput Show and Tell & Deliverables • Bringing Gigabit throughput to the Grid applications • Show and tell demos • TCP streams operating • GridFTP operation • 100 Mbit long transfers • 500 Mbit long transfers • 1 Gbit long transfers • Multiple host-host – Host-striping • High Throughput operations between multi-MPLS domains • High Throughput & QoS – Realtime (EF - spq) / best-effort / Scavenger (qbss) • Deliverables - Reports • PC Lab tests • Protocol monitoring tools • Gigabit WAN tests • Enhanced TCP stacks • Non TCP • Best practice for TCP & GridFTP in Grid Middleware and Applications MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
High Performance High Throughput Show and Tell & Deliverables • Bringing Gigabit throughput to the Grid applications • Show and tell demos • TCP streams operating • GridFTP operation • 100 Mbit long transfers • 500 Mbit long transfers • 1 Gbit long transfers • Multiple host-host – Host-striping • High Throughput operations between multi-MPLS domains • High Throughput & QoS – Realtime (EF - spq) / best-effort / Scavenger (qbss) • Deliverables - Reports • PC Lab tests • Protocol monitoring tools • Gigabit WAN tests • Enhanced TCP stacks • Non TCP • Best practice for TCP & GridFTP in Grid Middleware and Applications MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
Defining Background Traffic • Regular traffic - constant size packet, regular spaced in time • Poisson traffic - constant size, exponential spacing to form transient queues • IETF traffic mix - different sizes and different probability of each size sent • Play back of real traffic patterns generated from packet headers pre-recorded from suitable points of the production network. This might include: • Video Conference traffic -> play back - rude/crude tools • General traffic captured at edge of a site, e.g. Manchester • Web-bursty traffic – web mirror – wget MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
High Performance High Throughput Tests on Intermediate Systems • Understand the management & configuration of routers • IP operation • MPLS • QoS/Diffserv management & configuration • Understand the performance of routers and (LAN) interconnects • Latency vs frame size • Throughput vs message size • Link framing overheads • The effect of load on switch/router thoughput • Offered vs achieved thoughput MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
High Performance High Throughput Tests on the WAN 1 • TCP/IP Throughput vs rtt • Throughput vs window-size • Dependency of Latency & Throughput on end system hardware • Throughput using multiple TCP streams, and effect on the Network- how does the background throughput change? • The effect of background traffic loads • Effect of different TCP stacks and TCP tuning • Reno • New Reno • Vegas • Enhanced TCP algorithms – Sally Floyd • Delayed-Ack, SACK, … • ECN MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
High Performance High Throughput Tests on the WAN 2 • TCP Behaviour in QoS environment • Marking • Rate / Congestion Control CAR RED ECN • Configurable Scheduling • WFQ weighted fair queuing • Priority / realtime • WRR weighted round robin / DRR • … • … • Bringing Gigabit throughput to the Grid applications • GridFTP at Gigabit • BBftp and BBscp at Gigabit • Data Replication GDMP • Use of non-TCP protocols, and effect on the Network • UDP Blast • via MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
High Performance High Throughput Time-Lines (1) Month1 NOW • Investigate NICs & End System behaviour • Investigate Monitoring techniques – Code modifications ? • Purchase end systems & monitoring tools ! • Define test traffic Month 2 • Install / configure End systems at sites • Set up GridFTP between sites – minimum Globus RH7.1? K2.4.14? • Set up BBftp BBscp • Test on SJ4 at 100 Mbit • Investigate TCP/IP Stacks & Tuning – Agreement on Kernel / details of tests /.. • Define MPLS needs – multi-loop to extend the rtt Month 3 • Delivery & installation of routers and access links (TM1) • Understand configuration of 7600s – IP only and MPLS • Understand LAN and blade performance of routers – Lab tests • Configuration of Development GSRs at PoPs Discussion! Time MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
High Performance High Throughput Time-Lines (2) Month4 • Gigabit WAN tests e.g. UDP and TCP mem – mem streams • End-to-end IP only 2 sites / no background / with background • 1 MPLS domain / n MPLS domains • Test with QoS – Realtime (EF - pf) / best-effort / Scavenger (qbss) • Think about results! Month 5 • Simple Test GridFTP / BBscp BBftp over the development network • Transfers with QoS Realtime (EF - spq) / best-effort / Scavenger (qbss) Discussion! Time MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
High Performance High Throughput Time-Lines (3) Month 6 • Initial demo of sustained throughput for different traffic classes (TM1) • Establish connection between systems with real data e.g. BaBar HEP Month 9 • Demonstration of GridFTP operation • 100 Mbit long transfers, 500 Mbit long transfers (TP1) Month 12 • Initial demo & report of end-to-end guaranteed BW & Qos (TM2) Month18 • Advanced demos including use of Qos Techniques (TM2) • Demo of reliable transport at > 1Gbit/s - including with QoS (TP1) • Grid Data Replication GDMP Month 24 • Final report on High throughput transport across the WAN (TP1) • Final report on end-to-end traffic management over multiple MPLS domains (TM2) Discussion! Time MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
Next Steps • Draft document on High Performance Throughput Investigations to be circulated. • Technical “bits&bytes” meetings to discuss workplans and doc Discussion! Time MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester
Test PC 4 * 1 Gigabit Ethernet blade Monitor PC NIC 2.5 Gbit POS NIC Hardware & Software Tools High Bandwidth High Throughput Protocol Investigations (mainly) • Optical splitter or opto-electrical tap • opto-electrical tap constructed for logic analyser • Software use of : • tcpdump tcptrace MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester