1 / 33

Introduction to the PPNCG Networking for the PPARC Community

Learn about the PPNCG network, UK network topologies, external connectivity to Europe and the US, and monitoring of astronomy and astrophysics sites. Get an introduction to QoS and active network monitoring.

victoriaj
Download Presentation

Introduction to the PPNCG Networking for the PPARC Community

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Introduction to the PPNCGNetworking for the PPARC Community • Introduction to the PPNCG • UK Network Topologies • External Connectivity – Europe & US • Astronomy & Astrophysics Sites • Grid Network Monitoring • PingER – World wide Monitoring • QoS – a micro Introduction Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  2. Introduction to the PPNCG Membership includes HEP and Astronomy users Dave Terrett , Bob Bentley, Ralph Spencer Remit Ensure the community has the required networking facilities Monitor end-to-end performance Investigate new network applications / technologies Provide advice on kit / facilities Active Network Monitoring PPNCG ping, ftp and traceping ICFA monitoring Report problems to UKERNA Regular meetings with UKERNA invited Recognised as a subject group in JNUG and JISC Links to several Grid Projects Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  3. SuperJANET4: Backbone and Access links • Worldcom supplied the transmission • UKERNA layer the IP service • Core PoP IP router at Worldcom • Backbone Access Router at MANs • Access Links: • Large MAN 2.5 Gbit -> 10-20 Gbit • Medium MAN 622 Mbit -> 2.5 Gbit • 4 node DWDM development net • Deployment Status: • Backbone Oct 00 Routers Nov 00 • All sites Mar 01 • Proved to be Stable • Constant growth of traffic • Upgrade Backbone to 10Gbit Jun 02 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  4. SuperJANET4: ping rtt Core routers Jun 01 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  5. SuperJANET4: ping rtt Site nodes Glasgow Lancaster MAN / LAN Issues Bristol Cambridge Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  6. London MAN Upgrade UDP Packet loss % UDPmon Tests Manchester – London MAN was 155 Mbit ATM UDP Throughput Mbit/s 1st Oct Time interval in Weeks Richard HJ Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  7. Previous External Connectivity • Europe: • TEN-155 • 155Mbit Access link • US: • 6 * 155 Mbit links • Peer in Hudson St. • 622 Mbit to Esnet • 622 Mbit to Abilene. Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  8. Europe – Access links (1) ICFAMON Plot from RAL to CERN for 19th Oct to 1st Nov 2001 • UK Access link 155 Mbit ATM • Sustained rate 130 Mbit • Contract to end of Nov 01 • Bad news for users ! Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  9. Europe – Access links (2) Traceping Oxford to CERN for 31st October 2001 loss around ten155-gw.ja.net router J. Macallister Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  10. New External Connectivity • 6 * 155 Mbit links • 2.5Gbit line installed • IP commodity peer in London • Research traffic over 2.5G bit • Peer in Hudson St. • 622 Mbit to Esnet • 622 Mbit to Abilene. Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  11. Connectivity to Europe : Geant • Start mid November 2001 • UKERNA switched off TEN-155 3 Dec 2001 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  12. Connectivity to Europe ICFAMON Plot from DL to CERN for 18th Feb to 3rd Mar 2002 • UK Dante Access link 2.5 Gbit POS • Remember 19th Oct to 1st Nov 2001 • Access link over loaded Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  13. Monitoring: US Traffic UKERNA Traffic data Kbit/s. Blue Traffic from US; Maroon Traffic to US 7 day periods 1 hour averages 14 Jan 2002 (800Mbit/s) peak 86% of total 930 Mbit 17 Jan 2002 Peering altered 22 Jan 22 Jan 2002 Weed day peak 175 Mbit/s Weekend-Before Weekday-After Weekday-Before Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  14. Monitoring: US Traffic UKERNA Traffic data Kbit/s. Blue Traffic from US; Maroon Traffic to US 7 Dec 2001 (900kbit/s) 29 Jan 2002 (175kbit/s) peak is 88% of total BW 930 Mbit 10 minute averages10 minute averages Last 7 days 1 hour averages Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  15. Astronomy & Astrophysics Sites Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  16. Connectivity to Australia ICFAMON Plot from DL to Anglo-Australian Observatory for 11th Apr to 24th Apr 2002 • Packet loss reasonable • rtt improves ~420 ms to ~300 ms • Variations ~100ms Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  17. Connectivity to US ICFAMON Plots for 11th Apr to 24th Apr 2002 DL to NOAO, Arizona DL to Goddard GSFC NASA Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  18. Connectivity to Hawaii ICFAMON Plot from DL to The Joint Astronomy Centre for 11th Apr to 24th Apr 2002 • Packet loss good • rtt ~210 ms • Variations – queuing • traceroute: • Cross SuperJANET4 to NY OK • Cross Abilene to Seattle OK • Enters uhnet • Stops after 2-3 routers • No connectivity to La Palma • traceroute ends in iac.es network Tenerife ? Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  19. Grid NetworkMonitoring • Several tools in test – plugged into a coherent structure: • PingER, RIPE one way times,iperf, UDPmon, rTPL, GridFTP, and NWS prediction engine • continuous tests for last few months to selected sites: • DL Man RL UCL CERN Lyon Bologna SARA NBI SLAC … • The aims of monitoring for the Grid: • to inform Grid applications, via the middleware, of the current status of the network – input for resource broker and scheduling • to identifyfault conditions in the operation of the Grid • to understandthe instantaneous, day-to-day, and month-by-month behaviour of the network – provide advice on configuration etc. • Network information published in LDAP schema • Will be used by UK GridPP and e-science centres • AstroGrid ? Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  20. Network Monitoring Architecture LDAP Schema Grid Apps GridFTP Backend LDAP script to fetch metrics Monitor process to push metrics PingER (RIPE TTB) IperfER UDPmon rTPL NWS etc Local Network Monitoring Store & Analysis of Data (Access) local LDAP Server Grid Application access via LDAP Schema to - monitoring metrics; - location of monitoring data. Access to current and historic data and metrics via the Web, i.e. WP7 NM Pages, access to metric forecasts Robin Tasker Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  21. Clients WEB Display Predictions Grid Broker Analysis LDAP LDAP LDAP LDAP LDAP Web I/f Table Table Table plot plot plot raw raw raw raw raw Scheduler control control Cron script Cron script Cron script Tool Ping Netmon UDPmon iPerf Ripe Network Monitoring Components Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  22. Ping & UDP throughput MAN-RAL From 20 Oct 01 PingER rtt (ms) dl – RAL 1000 byte packet Forecast UDPmon Zero packet loss! UDPmon throughput Mbit/s man – RAL 300 * 1400 byte frames Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  23. Ping & UDP throughput MAN-CERNFrom 20 Oct 01 PingER rtt (ms) dl – cern 1000 byte packet Forecast UDPmon throughput Mbit/s man – cern 300 * 1400 byte frames Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  24. iperf TCP & UDP throughput MAN-SARA From 20 Oct 01 Iperf TCP throughput Mbit/s ucl – sara 262144 byte buffer Forecast UDPmon throughput Mbit/s man – sara 300 * 1400 byte frames Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  25. iperf & Pinger UK-Bologna From 20 Oct 01 Iperf throughput ucl – Bologna 262144 byte buffer Forecast in green PingER rtt (ms) dl – Bologna 1000 byte packet Forecast Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  26. UDPmon Loss Throughput Mbit/s MAN – SARA Iperf Throughput Mbit/s UCL – SARA 262144 byte buffer Geant Enabled Routing Stable iperf throughput UCL-SARA From 1 Nov 01 – Geant Operational Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  27. PingER PingER deploymentLes Cottrell • Measurements from • 34 monitors in 14 countries • Over 600 remote hosts • Over 72 countries • Over 3300 monitor-remote site pairs • Measurements go back to Jan-95 • Reports on RTT, loss, reachability, jitter, reorders, duplicates … • Countries monitored • Contain 78% of world population • 99% of online users of Internet • Lightweight (100bps/host pair) • Very useful for inter-regional and poor links, need more intensive for high performance & Grid sites Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  28. Losses: World by region, Jan ‘02 • Russia, S America bad • Balkans, M East, Africa, S Asia, Caucasus poor • Packet loss <1%=good, <2.5%=acceptable, < 5%=poor, >5%=bad Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  29. Quality improvement seen from SLAC & NASA • NASA results courtesy of Andy Germain, NASA, GSFC Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  30. Iperf mem-mem vs file copy disk to disk 100 Fast Ethernet Over 60Mbits/s iperf >> file copy OC3 Disk limited File copy disk-to-disk 0 400 Iperf TCP Mbits/s Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  31. Configurable Queues Discard Test Dequeue Identify & Classify Police Fail Sort QoS: Terms and Concepts • Identifying frames – marking / setting IP precedence bits • Sorting frames into queues • Selecting which frame to send • Action taken when a queue is full Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  32. QoS: What Next? • Dante propose the following services: • IP Premium (EF) (AF) difficult to define in a way that suits most NRNs • Best Efforts • Scavenger “Less than best efforts” • UKERNA ran a Think Tank to Study QoS requirements in the UK • MB-NG Network development project to test MPLS and QoS • SuperJANET is expected to offer similar services to Dante • Applications need end to end QoS – so we need to cross: • LAN • SuperJANET4 • Dante • Remote NRN • Remote LAN Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

  33. More Information Some URLs • PPNCG Home page with Stop Press: http://ppncg.rl.ac.uk/ • PPNCG Page for monitoring Astronomy & Astrophysics Sites http://icfamon.dl.ac.uk/ppncg/astronomy.html • and e-mail: hepgripe@rl.ac.uk • DataGrid WP7 Networking: http://www.gridpp.ac.uk/wp7/index.html • IEPM PingER home site: http://www-iepm.slac.stanford.edu/ • IEPM-BW site: • http://www-iepm.slac.stanford.edu/bw Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester

More Related