120 likes | 135 Views
Deploying Measurement Systems in ESnet Joint Techs, Feb. 2006. Joseph Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory. Outline. Deployed Tools & Capabilities ESnet Performance Centers SNMP & Flow Stats Owamp PerfSONAR Utilization Measurement Archive
E N D
Deploying MeasurementSystems in ESnetJoint Techs, Feb. 2006 Joseph Metzger ESnet Engineering GroupLawrence Berkeley National Laboratory
Outline • Deployed Tools & Capabilities • ESnet Performance Centers • SNMP & Flow Stats • Owamp • PerfSONAR • Utilization Measurement Archive • Traceroute Visualization • Future plans
ESnet Performance Centers A web interface that lets ESnet users perform tests to points in the ESnet core • Ping • Traceroute • Iperf • Pathload • Pathrate • Pipechar
2 SNMP Collection Systems • One system based on MRTG • Collects interface utilization, error and discard data every minute from ~1383 physical and logical interfaces • Used for day to day operations. • Portions accessible via http://netinfo.es.net • Second collection system based on netSNMP • Collects interface utilization • Monthly reporting • Details back to 1990 • http://www1.es.net/pub/esnet-stats/ • The two systems back each other up
Netflow • Collect at ESnet ingress points • Trending • Identify large traffic flows • Observation: About 100 host pairs generate 30% of all ESnet traffic • Peering Analysis • ESnet has around 100 peers • Most of them at multiple locations • Look at “what if” scenarios for traffic engineering • Diagnosing problems • Identifying endpoints of a flow that saturated a site access link
OWAMP • Initially deployed to measure & compare • DOE Lab to DOE Lab performance • DOE Lab to University performance • Mesh between • FERMI, LBNL, BNL • OSU, NCS, SDSC • Very small network changes can generate measurable differences in latency. • OWAMP monitors deployed in most ESnet hubs
Metro DWDM RerouteAdded about 0.35 ms Latency Fiber Re-Route
Asymmetric Routing betweenFERMI and SDSC(LBL to CENIC link Maintenance)
PerfSONAR Utilization MA • Provide ESnet users and network researchers access to ESnet link utilization data • Deployed a PerfSONAR Measurement Archive (MA) • Uses the “EGEE” tagged release of PerfSonar Java MA • Provides a web services interface using NMWG V2 schema • Data source is RRD files populated by SNMP system • Copied to MA every 5 minutes • Provides link capacity and link utilization information for over 800 ESnet interfaces. • Software that uses the ESnet MA • EGEE network diagnostic tool • CNM (DFN Customer Network Management tool) • PerfSONARUI • Traceroute Visualizer
PerfSONAR Traceroute Visualizer • Displays a web form • User pastes a traceroute output into the form • Parses the form data to find IP addresses • Displays the traceroute with interface utilization graphs for all the interfaces it can find. • A quick demo developed to show the value of a standardized measurement infrastructure • Show demo if time permits
Future Plans 1 • General • Continue the PerfSONAR collaboration with Internet2, GEANT, and the European National Research & Education Networks • Deploy additional components of the PerfSONAR architecture as it is developed • Lookup service • Topology service • Bandwidth measurement points • Latency measurement points • Authentication service • Enhance & extend our end to end monitoring efforts • Include more LHC sites • Interoperate with other tools used in LHC community
Future Plans 2 • SNMP • Use PerfSONAR to continue to publish ESnet interface data • Latency • Integrate existing ESnet latency MPs with PerfSONAR • Deploy new latency MP’s in new hubs • Bandwidth • Integrate ESnet Performance Centers with PerfSONAR • GE capable bandwidth MPs • Deploy new PerfSONAR bandwidth MPs • 10 GE capable