1 / 17

Grid Network Performance Monitoring for e-Science

Grid Network Performance Monitoring for e-Science. Mark Leese - Daresbury Laboratory Thursday 15/5/2003 m.j.leese@dl.ac.uk http://gridmon.dl.ac.uk/~mjl. Contents. Purpose of the work GridMon: what it does & how it does it Progress & examples The future Conclusion Questions?.

khuyen
Download Presentation

Grid Network Performance Monitoring for e-Science

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Grid Network PerformanceMonitoring for e-Science Mark Leese - Daresbury Laboratory Thursday 15/5/2003 m.j.leese@dl.ac.uk http://gridmon.dl.ac.uk/~mjl

  2. Contents • Purpose of the work • GridMon: what it does & how it does it • Progress & examples • The future • Conclusion • Questions?

  3. Purpose of the work “…design and deploy an infrastructure for network performance monitoring within the UK e-Science community.” • Fault finding • Performance prediction Key aspects: • Publish results  (adaptive) Grid middleware and Grid apps • Visualisation for humans • End-to-end • ability of TCP wrt high b/w networks

  4. Monitoring: What?

  5. Monitor Node 30 mins Tools installed on dedicated & similar node at each centre MESH Monitoring: How(1)? IperfER PingER UDPmon MiperfER bbcp/ftp Publication service Grid middleware Monitoring Architecture www.visualisation

  6. Monitoring: How(2)?

  7. Progress • Intitial toolkit (IperfER, PingER, UDPmon) at 11 of 12 e-Science centres. Other useful UK sites being added. • MiperfER on beta trial at Cambridge, Cardiff, MCC and Newcastle. • Active map also on trial. • Click for AMAZING live demo

  8. Examples: PingER

  9. Examples: IperfER(1)

  10. Examples: IperfER(1)

  11. Examples: IperfER(2)

  12. Examples: MiperfER

  13. Examples: bbcp & bbftp

  14. The Future (Tasker’s) Trident Longer term: • More sites…but mesh doesn’t scale! • Wishlist features (but perhaps not all 3,000,000) • Investigate other issues: window sizes, QoS… And… Tools www i/f bbcp/ftp GridFTP Web service

  15. TCP Best Practice • Demo TCP best practice to users – “this is what you can achieve, if you ‘tune’ your machine like this...” • Possibles “variables”: • Kernel versions and patches • MTU • Interrupt handling • However: • “...performance from copper-based GigE cards are intimately connected with judicious use and understanding of the corresponding driver(s)...” Gray and Betz • Bus speed, bus width… No new fangled gizmos – using what we already have!

  16. Conclusion • Near national infrastructure • A little basic, but improving • Poised for web i/f into historic data • …. then web i/f tests on demand • What do YOU do next?......... • http://gridmon.dl.ac.uk/

  17. Network Monitoring for e-Science Questions m.j.leese@dl.ac.uk http://gridmon.dl.ac.uk/~mjl ? ? ? ? ?

More Related