1 / 12

Flow monitoring (Netflow)

Status report 12/10/2006 Alessadro Inzerilli - GARR. Flow monitoring (Netflow). General subtask info. Design and implement of flow monitoring architecture for JRA1; Integration with perfSonar framework; Partners involved: Surfnet (subtask leader- Hans Trompert), CARNet , GARR, Uninett;

wriehle
Download Presentation

Flow monitoring (Netflow)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Status report12/10/2006 Alessadro Inzerilli - GARR Flow monitoring (Netflow)

  2. General subtask info • Design and implement of flow monitoring architecture for JRA1; • Integration with perfSonar framework; • Partners involved: Surfnet (subtask leader- Hans Trompert), CARNet , GARR, Uninett; • All working documents (evaluation reports, test bed specification, design docs, ..) on wiki: http://wiki.perfsonar.net/jra1-wiki/index.php/Flow_monitoring.

  3. Status report • Netflow existing tools evaluation: • Collector: • nfdump chosen among other tested tools as netflow collector tool for JRA1 flow monitoring infrastructure implementation; • Visualisation/analyser: • tools selected for later evaluation: Stager, Nfsen; • All evaluation documents on wiki page.

  4. nfdump overview • Developed by SWITCH (Peter Haag) http://nfdump.sourceforge.net/ ; • set of tools to collect and process netflow data; • supports all important netflow format versions (v.5, v.7, v.9), supports IPv6; • has built-in replaying and anonymization functionalities; • has a graphical font-end (Nfsen).

  5. Status report (cont.) • Defined overall architecture of flow monitoring infrastructure; • Two services in implementation phase: • RRD based Netflow MA; • Netflow Flow Subscription MA; • Third service in design phase: • Netflow Selection and Aggregation MA; • PerfSonar integration in progress;

  6. Overall architecture (Functional design)

  7. Flow Subscription MA • Goal: to implement a Netflow Subscription MA that allows a client to request a live stream of Netflow data that can be processed locally by any standard Netflow collector. • Design document on wiki: • http://wiki.perfsonar.net/jra1-wiki/images/4/44/JRA1_Netflow_subscription_MA_-_v0.4.pdf

  8. Flow Subscription MA Functional design

  9. Flow Subscription MA Implementation status • Surfnet implemented a working client-server communication model to setup an encrypted, anonymized and custom filtered flow stream; • written in Python; • plan to integrate the code with the perfSONAR framework (using the Python Ping MP code as an example); • first draft of the XML schema's for communication, provided by Martin and Jason, available.

  10. RRD Netflow MA • Goal: to implement RRD MA that allows to publish flow-specific information; • Metrics published at the moment: flows/sec, packets/sec, bytes/sec; • RRD data files provided by Nfsen tool (graphical front-end of Nfdump); • Possibility to extend metrics (es. AS matrix, network prefix, protocols).

  11. RRD Netflow MA implementation status • CARNet works on two versions of MA • Python version • Java version • Python version of MA available at http://noc-mon3.srce.hr:8090/ • Java version soon available at http://monstera.man.poznan.pl/jra1-wiki/index.php/RRD_type_MA_Service_Installations

  12. Y3 Action Plan • Netflow Subscription MA • Implementation of basic functionalities (server/client applications); • Integration with perfSonar framework; • Netflow RRD MA • Implementation of basic functionalities; • Client application and LS communication; • Implementation of Netflow Selection and Aggregation MA • Design; • Implementation of RRD MA basic functionalities; • Netflow visualization • Report on existing tools (Nfsen, Stager); • Web based query front-end on top of Netflow Selection and Aggregation MA; • Integration with AA infrastructure; • Anonymization; • Deployment of software on three test bed boxes (Carnet, Garr, Surfnet).

More Related