1 / 20

Networking

Networking. Paul Mealor. DataGrid WP7. Meetings: Amsterdam, November Bologna, Jan Deliverables, reports D7.2 QoS. Deliverable 7.2 Demonstration of enhanced monitoring tools. Delivered PingER, RTPL, IperfER, UDPmon, MapCenter, RIPE NCC Test Traffic Measurements LDAP Publication

roden
Download Presentation

Networking

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Networking Paul Mealor GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  2. DataGrid WP7 • Meetings: • Amsterdam, November • Bologna, Jan • Deliverables, reports • D7.2 • QoS GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  3. Deliverable 7.2Demonstration of enhanced monitoring tools • Delivered • PingER, RTPL, IperfER, UDPmon, MapCenter, RIPE NCC Test Traffic Measurements • LDAP Publication • Future: Prediction and forecasting; NetSaint GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  4. Monitoring tools - EDG-PingER • Available in TB1 v1 • Modification of PingER • PingER used extensively in HEP community • Measures RTT, Loss (and therefore connectivity) • Centrally configured GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  5. Monitoring tools - EDG-PingER • Configuration system • On install: sends Franck Bonnassieux an email • Every night, cron job gets an individual configuration file from ccwp7.in2p3.fr • Consultation between WP7 and local sysadmin • Easy way to set up all network monitoring hosts GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  6. Monitoring tools - EDG-PingER Apache cgi-bin scripts ping scripts log files cron GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  7. Monitoring tools • EDG-IperfER • Based on PingER • Measures TCP throughput • UDPmon • Based on PingER • Measures UDP Ping and 1-way loss; calculates throughput GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  8. Inter-packet time Time to receive Time to send Monitoring tools - UDPmon Zero stats OK done Send data frames at regular intervals Get remote statistics Send statistics GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  9. Monitoring tools - RTPL • Remote throughput, ping, load • Tests are made between pairs of machines • Centrally controlled • Results presented using Java applets GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  10. Monitoring tools - MapCenter • Provides various views showing the connectivity of various nodes on the Grid GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  11. Monitoring tools - website • http://ccwp7.in2p3.fr/ • Links to other monitoring tools (MapCenter, RIPE NCC, NetSaint, RTPL) • Links to sites with WP7’s monitoring tools installed - 9 with PingER so far GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  12. Monitoring tools - NetSaint • A thing “to do” in D7.2 GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  13. Monitoring tools - others • Other systems under consideration are • RIPE NCC Test Traffic Measurements • Surveyor • NIMI • MRTG • Traceping • Netflow and cflowd • NWS GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  14. Publication of monitoring data - LDAP • LDAP backend script to publish data from PingER • Available with TB1 • Part of the standard WP3 information system • Script is installed using an extra RPM • Slow-burning update cycle • Extra information providers for RTPL and NWS on their way GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  15. Publication of monitoring data - LDAP • How it looks Mds-Vo-Name=ucl,Mds-Vo-Name=uk,Mds-Vo-Name=datagrid,o=grid in=netmon netmonrou=netmon.rl.ac.uk rou=netmon.dl.ac.uk netmontool=pinger netmonpacketsize=256 netmonpacketsize=512 GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  16. Publication of monitoring data - R-GMA • Relational implementation of the grid monitoring architecture • Under development • WP7 is the first real user of it • Seems to be far better suited to publishing network monitoring data than the LDAP tree structure GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  17. Publication of monitoring data - R-GMA • Much to decide • schemas, what to publish, where, how Archiver SE/CE/NM associations CE GridFTP logging Archiver CE Archiver NM Monitoring SELECT nm1.rtt, cenm.ceid, cenm.ceid FROM nm nm1, nm nm2, cenm, senm WHERE cenm.nmid=nm1.nmid AND senm.nmid=nm2.nmid AND nm1.othernm=nm2.nmid AND mm1.rtt<100 GridFTP logging SE SE GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  18. Other Stuff • Gigabit ethernet performance measurements • characterisation of NICs, Richard Hughes-Jones GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  19. Other stuff • Tests of scavenger mode (DiffServ / QoS) • Cern External Network Division • Tests of TCP in high-bandwidth situations • Antony Antony • Tests of various other hardware • Routers and switches and things • Security (will be D7.5) GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

  20. END GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL

More Related