1 / 11

DataTAG - WP3

DataTAG - WP3. Objectives, activities and progress by UvA: Wim Sjouw, Hans Blom, Jason Lee, Cees de Laat INRIA: Mathieu Goutelle CERN: tbd. Contents. Objectives Tasks Activities Experiences with SURFnet Lambda Pointers. WP3 objectives.

azra
Download Presentation

DataTAG - WP3

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. DataTAG - WP3 Objectives, activities and progress by UvA: Wim Sjouw, Hans Blom, Jason Lee, Cees de Laat INRIA: Mathieu Goutelle CERN: tbd

  2. Contents • Objectives • Tasks • Activities • Experiences with SURFnet Lambda • Pointers

  3. WP3 objectives • Bulk data transfer and application performance monitoring: • innovative monitoring tools are required to measure and understand the performance of high speed intercontinental networks and their potential on real Grid application.

  4. Tasks in WP3 • Task 3.1. Performance validation (month 1-12) • Create, collect, test network-tools to cope with the extreme Lambda environment (high RTT, BW) • measure basic properties and establish a baseline performance benchmark • Task 3.2 End user performance validation/monitoring/optimization (month 6-24) • Use “out of band” tools to measure and monitor what performance a user in principle should be able to reach • Task 3.3 Application performance validation, monitoring and optimization (month 6-24) • Use diagnostic libraries and tools to monitor and optimize real applications to compare their performance with task 3.2 outcome.

  5. Task 3.1 Performance validation • Performance Test Tools • http://carol.wins.uva.nl/~jblom/datatag/wp3_1/ • Lambda's are a Layer 1-2 environment • use end to end traffic generating tools • not ICMP based tools since those need routers in the path • tools must work in Gigabit environment • Netperf • TCP bulk transfer, UDP unusable (no shaping) • modifications made to enhance IPv6 support • Iperf • TCP and UDP shaped bulk transfer • lightweight multiple streams test support • IPv6 support • modifications made to introduce TCP shaping, debugging

  6. Task 3.1 Performance validation (cont’d) • UDPmon (by Richard Hughes-Jones) • each packet contains seq. # / time stampinfo receiver can deduce: • # packets lost • # packets out-of-order • UDP bandwidth • very precise timing • not intrusive • tool is in continuous development

  7. Task 3.1 Performance validation (cont’d) Tools under investigation which are either not released yet or incomplete: • Pathload : estimate available bandwidth • Magnet : network software performance • Netprobe : one way delay + variance, jitter

  8. Task 3.1 experiencesusingNetherlight SURFnet Lambda AMS-CHIfull duplex GE  2.5 Gbps SDH , 100 ms RTT • single stream TCP: max. throughput 80 - 150 Mbps, dependent on stream duration • similar for BSD and Linux and different adaptors • UDP measurements show effects of hardware buffer-size in ONS equipment when assigning lower SDH bandwidths,see: www.science.uva.nl/~wsjouw/datatag/lambdaperf.html

  9. Task 3.2 End user performance validation/monitoring/optimization • Toolset for monitoring • Re-use as much as possible WP7 stuff • rTPL(end user performance monitoring): • http://195.169.124.55/rtpl/netherlight/table/ • MRTG (to monitor router interfaces): • http://195.169.124.55/mrtg/ • SmokePing (history and statistics of rtt’s): • http://195.169.124.55/smokeping/smokeping.cgi?target=SARA • Not so ideal tools (for the time being): • Cricket (to monitor large number of router interfaces): • http://195.169.124.55/cricket/grapher.cgi?target=%2Fssr-interfaces

  10. Task 3.2 and 3.3 • set up tool RTPL for end user performance check, can be expanded when DataTAG lambda becomes available. See:http://195.169.124.55/rtpl/netherlight/table/ • task 3.3 will most probably use netlogger, did not yet start. • all info can also be found via:www.datatag.org

  11. Summary of status • Tools have been investigated, selected and where necessary adapted to benchmark and characterize Lambda networks • http://carol.wins.uva.nl/~jblom/datatag/wp3_1/ • New tools appear and need to be studied to add to the set • Influence layer 1 and 2 infrastructure properties on TCP throughput is under study on SURFnet Lambda testbed and NetherLight • Monitoring setup is underway, inclusion of WP7 toolset is next step • Application performance monitoring and optimization should start soon • Preparation for iGrid2002 which also gives us: • a 2.5 gig connection Amsterdam-CERN • for duration of iGrid2002 10 Gbit/s connection Starlight-Amsterdam by Level3! • WWW.IGRID2002.ORG in Amsterdam 23-26 september

More Related