1 / 39

Advanced architecture for INTER-domain quality of service MONitoring, modelling and visualisation

IST-2001-34123 http://www.ist-intermon.org. Advanced architecture for INTER-domain quality of service MONitoring, modelling and visualisation. Project Review No.1 Brussels, Belgium March 12, 2003. Project Overview. WP1, WP 2. Ulrich Hofmann (Salzburg Research). Architecture. WP3.

falala
Download Presentation

Advanced architecture for INTER-domain quality of service MONitoring, modelling and visualisation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. IST-2001-34123http://www.ist-intermon.org Advanced architecture for INTER-domain quality of service MONitoring, modelling and visualisation Project Review No.1 Brussels, Belgium March 12, 2003

  2. Project Overview WP1, WP2 Ulrich Hofmann (Salzburg Research) Architecture WP3 Mauro Gargiulo (CINI/ITEM) Monitoring & Measurements WP4 Sandra Tartarelli (NEC) Modelling & Simulation WP5 Matthias Scheidegger (Uni Bern) Visual datamining WP6 Stefan Michaelis (Uni Dortmund) INTERMON Demo INTERMON partners Outline

  3. Project Overview WP1, WP2 Ulrich Hofmann (Salzburg Research) Architecture WP3 Mauro Gargiulo (CINI/ITEM) Monitoring & Measurements WP4 Sandra Tartarelli (NEC) Modelling & Simulation WP5 Matthias Scheidegger (Uni Bern) Visual datamining WP6 Stefan Michaelis (Uni Dortmund) INTERMON Demo INTERMON partners Outline

  4. SAG NEC-E Siemens PSE, Austria NEC Europe, Germany I&C manufacturer T-NOVA TID TILAB T-Syst. Deutsche Telekom, Germ. Telefonica, Spain Telecom Italia Lab., Italy ISP and Network Operators SAR FOKUS Uni Be DTT-BUTE WIT CINI/ITEM Uni Do SalzburgResearch, Austria Frauenhofer- FOKUS, Germany Uni Bern, Switzerland Uni Budapest, Hungary Waterford Institute, Ireland CINI/ITEM, Italy Uni Dortmund Universities and Research Institutes Consortium

  5. Role of partners SAG NEC-E Requirements, VoIP scenarios, modelling IPFIX, standard., modelling, integr., exploit. WP2 Leader WP4 Leader T-NOVA TID TILAB Traffic analyser, user interface, integr,exploit. Topology discovery, Modelling,Integr.,exploit. Traffic Measurement, Modelling, Integration WP7 Leader FOKUS Uni Be BUTE WIT CINI/ITEM Uni Do SAR Coord., fluid simul., mod.,DB,QoS tools,integr. Architecture,delay meas.,topology tool,integr. Hybrid modelling, simulation, integration Time series modelling, ARIMA forecasting Visual data mining, architecture, integration Architecture, services, integration Visual data mining, filters, VoIP model., integr. WP1 Leader WP3 Leader WP5 Leader WP6 Leader

  6. Project Meetings and Co-Operation • Project Meetings • Kick Off Meeting , Salzburg 4/2002 • Project Meeting, Berlin 6/2002 • Project Meeting, Waterford 9/2002 • Project Meeting, Turin 11/2002 • Project Meeting, Salzburg 2/2003 • Concertation Meetings • 6/2002 Brussels • 3/2003 Brussels • Next Generation Networks (NGN) Activities • IP QoS & MoMe Roadmap , Benchmarking 7-9/2002 • NGNi MoMe Workshop 6/2002 Berlin

  7. Project Meetings and Co-Operation • Cluster Activities MoMe ( Monitoring & Measurement) • Integration of AQUILA results into INTERMON • IPS workshop presentations from AQUILA, CADENUS • Initiation by INTERMON of the first International Workshop on Inter-domain Performance and Simulation (IPS 2003) , Salzburg 20/21.2003 • International cooperation with ITA Brazil, NCIT Canada • tools used for education in ITA • INTERMON exploitation for Tele-Haptics with NCIT

  8. Title Date WP D1 Analysis and Requirements Report Jun 02 WP2 D2 System Architecture und Specification Aug 02 WP3 D3 Specification of Inter-Domain QoS Monitoring and structure discovery components Sept 02 WP4 D5 Specification of inter-domain QoS data base with policy controlled data collection Sept 02 WP4 D6 Specification of inter-domain QoS modelling and Simulation toolkit Dec 02 WP5 D7 Specification of visual data mining and user interface Dec 02 WP6 D4 Architecture components and interactions (additional deliverable) Feb 03 WP3 Deliverables (all in time)

  9. Objectives • Enhance the inter-working of tools in largescale, multi-domain Internet networks to support: • QoS and traffic analysis and forecasting • Network planning and traffic engineering • Collect, process and present(in an automaticfashion) information about: • Network topology, Traffic flows, QoS, and SLA fulfillment • Integrating various components and methods: • Topology detection and traffic measurement tools • Distributed information base • Measurements based analytical models and simulations ! • Visual data mining techniques

  10. Objectives (2) Tools, data base, interactions, architecture InterDomain topology discovery Path structure BGP Monitoring Tools - active QoS - passive traffic, IPFIX Policy Controlled DataBaseAccess Flexible Configuration of DataBase Sources Simulation Tools using measurement based load models Visual Data mining Traffic Matrix QoS analysis

  11. Project Highlights (1) • INTERMON Toolkit • first experience feedback from the users ( ISP, I&C ) • important step before integration (6/03) • Scalable and efficient Inter-Domain simulation technologies • fluid using differential equations • hybrid integrating analytical models • time series data • Measurement based modelling and simulation • trace based models (CBTM) • forecasting models (ARIMA considering outliers) • Design of an advanced inter-domain QoS analysis architecture with topology discovery, QoS and traffic monitoring, modelling, simulation and visual data mining using data base with policy control

  12. Project Highlights (2) • IPS Workshop • 26 presentations distributed over 9 sessions • Contributions from European countries, but also US, Canada, Brazil • 2 Tutorials • 50 participants + students • Standardisation IPFIX PSAMP • Contributed to the establishment of a new IETF WG (PSAMP) • Co-chairing IETF PSAMP • Submitted 1 Internet Drafts (2 versions) to IETF PSAMP • International research contributions • 32 publications - www.ist-intermon.org

  13. Innovations (1) • Policy based Monitoring and Measurement • Different kinds of QoS analysis need different policies for tool interworking and data base access • Dependency of end-to-end QoS on inter-domain routing • Dependency of end-to-end QoS on inter-domain topology path • Inter-domain QoS inferencing (tomography) from end-to-end • measurements and inter-domain topology discovery • IPFIX • combination of tools for • multivariate QoS & traffic • analysis • event detection /“outliers“ • INTERMON CM Toolset • extension for QoS inferencing • (tomography)

  14. Innovations (2) • Modelling, Simulation • Load models • measurements <--> load models • load models <--> simulation models • Structured load models • class based : monitor only heavy load • analyse outliers • Measurement based QoS modelling and forecasting toolkit • modelling considering abnormal events? • Novel forecasting models? • VoIP Modelling Measurement based modelling and simulation environment by policy driven measurement Measurement based modelling and forecasting toolkit QoS prediction based on ARIMA and further models considering „outliers“ application model generators (VoIP,..) integration in CM Toolset

  15. Innovations (3) Simulation Models

  16. Innovations (4) • Visual data mining • Scalable and flexible data preparation/visualisation • Customisable visual data mining for application QoS in interdomain environment • Spatial composition • Inter-domain traffic analysis Generalised Pipline Concept - configurable filters, mappings and applications Spatio-temporal QoS analysis (QoS patterns, „outliers“) for enhanced QoS provision Flexible traffic matrix concept for inter-domain capacity planning

  17. Innovations (5) • New toolkits for the network operator and end user • Architecture which integrates • components and their interfaces • database • Interface to the user • Command GUI • Visualisation • Management • Innovations must be validated INTERMON toolkit INTERMON database XML interfaces and adapters Flexible data source integration Local-global controller Configurable application integration into INTERMON Toolkit-GUI Statistical-, 2-,3-D Visualisation Test bed field trial feedback loop to inter-domain modelling

  18. Achievements (1) • WP2 Requirements : D1 6/02 (Siemens) • Intermon architecture and toolkit requirements - general concepts for tool integration, policy based tool interaction and data base control • Architecture and INTERMON-integrated Toolkit requirements • Policy based monitoring, Modelling, Simulation, Visual data mining and data base requirements • Application requirements • QoS / SLA monitoring, modelling, simulation and validation of applications (VoIP, ..) in inter-domain environment • Border router traffic flow monitoring, modelling and simulation for traffic engineering and capacity planning • Requirements for services and business scenarios • Cooperations (GEANT, ..) • Results presented at EURESCOM Conference

  19. Achievements (2) • WP3 Architecture D2 8/02 ( SR, FHG), D4 2/03 (CINI) • D2 8/02 based on the Requirements deliverable • defines tools and their conceptual interfaces • specifies menus and configurable user interface • D4 2/03 Extended Architecture Deliverable March 2003 with implementation oriented view of the architecture and service concepts • global / local controller • abstractions from specific tools (e.g. different meters) • Information model for configuring an IETF IPFIX meter (which can serve to produce further contributions to the IETF) • dedicated presentation planned at today Review

  20. Achievements (3) • WP4 Policy controlled data collection&monitoring, database D3 9/02 (NEC), D5 9/02 (SR) • Specification of Inter-Domain QoS Monitoring and structure discovery components • IPFIX traffic measurement • CM Toolset • topology discovery • Specification of inter-domain QoS data base with policy controlled data collection • INTERMON data base • policy controlled usage of tools for QoS analysis • flexible configuration of data sources

  21. Achievements (4) • WP 5 : Modelling, Simulation D6 12/02 (UBE) • Several novel simulation concepts and prototypes • => see innovations • Inter-Domain models • Router and domain models based on neural networks • Models of traffic aggregate behavior of several application types • Pure analytical approach for QoS • Measurement based traffic modelling • Trace based traffic model - CBTM methodIPS • Application based models (VoIP for IP-Backbones)IPS

  22. Achievements (5) • Modelling and prediction of measured time series data of QoS parameters considering “outliers” • Usage of Box&Jenkins (or ARIMA) methodology (differencing the process to remove non-stationarity) and preliminary outliers eliminationIPS • Measurement based QoS forecasting • ARIMA considering outliersIPS

  23. Achievements (6) • WP 6 Visual Data Mining for inter-domain D7 12/02 (UDO) • Generalised filter pipeline concept for scalable and flexible data preparation/visualisation • Visual data mining for inter-domain topology, traffic and QoS • Topology • flexible configurable and parameterizable traffic matrix conversion to meet data mining demands for traffic flow analysisIPS • spatio-temporal analysis based on statistical models and pattern analysisIPS • Modular user interface for tool integration

  24. Achievements (7) • WP 7 Rapid Prototyping Integration ( T-SYS) • First INTERMON integrated Toolkit version is working in a lot of facilities • Intention - development to get experience and to facilitate real usage and experiments • INTERMON toolkit (current state, business scenarios, functions, future work) • dedicated presentation planned at today Review

  25. INTERMON Toolkit Tools (Topology Discovery, Modelling, Simulation, Monitoring) Data Base (INTERMON, other data sources) Objects (Visual data mining „dictionary“) INTERMON integrated Toolkit INTERMON results stored in documents Controls -Topological and geographical mapping of tools and data bases

  26. Inter-domain Performance and Simulation Workshop (IPS)20/21.02.2003 Salzburg www.ist-intermon.org/workshopinitiated by INTERMON project next IPS 2004 Workshop in Budapest further steps : IPS conference and IPS Forum for industry and research

  27. IPS workshop motivation • lack of european research and projects in inter-domain issues • to improve competiveness with rest of the world • network tomography • interdomain routing • toplogy discovery • events, anomalies • QoS models • IPS establishment • joint effort of research and industrial partners • IPS experts from • different disciplines : internet engineers, mathematicians

  28. Standardisation • IETF Drafts • IETF IP Flow Information eXport (IPFIX)working group • J. Quittek, T. Zseby, B. Claise, S. Zander: Requirements for IP Flow Information Export draft-ietf-ipfix-regs-09.txt, February 2003 • IETF Packet Sampling (PSAMP)working group • T. Zseby, M. Molina, F. Raspall: Sampling and Filtering Techniques for IP Packet Selection draft-ietf-psamp-sample-tech-01.txt, March 2003 • J. Quittek • On the Relationship between PSAMP and IPFIX draft-quittek-psamp-ipfix-01.txt, February 2003

  29. Next Steps and future Plans • Implementation - WP4, WP5, WP6 • Integration WP7 - first steps 6/2003 Berlin • Validation of Models • Policy based QoS Analysis • Specification Test Bed, Exploitation, Services and Business Scenarios • European and international scenarios for INTERMON toolkit usage • Madrid, Salzburg, Berlin and other sites • Brazil , Canada • Real Date : GEANT • Policy based QoS Analysis Concepts • Testscenario and Validation concepts • IPS workshop 2004 • MoMe Cluster • CeBit 2003 Hannover

  30. Outline • Project Overview (WP1) • Architecture (WP3) • Monitoring & Meas. (WP4) • Modelling & Simulation (WP5) • Visual Datamining (WP6) • INTERMON Demo • Ulrich Hofmann (SalzburgResearch) • Mauro Gargiulo (CINI/ITEM) • Sandra Tartarelli ( NEC) • Matthias Scheidegger ( Uni Bern) • Stefan Michaelis ( Uni Dortmund) • .......

  31. WP slides will be stored on this computer ( sunday) • .... • ....

  32. Outline • Project Overview (WP1) • Architecture (WP3) • Monitoring & Meas. (WP4) • Modelling & Simulation (WP5) • Visual Datamining (WP6) • INTERMON Demo • Ulrich Hofmann (SalzburgResearch) • Mauro Gargiulo (CINI/ITEM) • Sandra Tartarelli ( NEC) • Matthias Scheidegger ( Uni Bern) • Stefan Michaelis ( Uni Dortmund) • .......

  33. WP slides will be stored on this computer ( sunday) • .... • ....

  34. Outline • Project Overview (WP1) • Architecture (WP3) • Monitoring & Meas. (WP4) • Modelling & Simulation (WP5) • Visual Datamining (WP6) • INTERMON Demo • Ulrich Hofmann (SalzburgResearch) • Mauro Gargiulo (CINI/ITEM) • Sandra Tartarelli ( NEC) • Matthias Scheidegger ( Uni Bern) • Stefan Michaelis ( Uni Dortmund) • .......

  35. WP slides will be stored on this computer ( sunday) • .... • ....

  36. Outline • Project Overview (WP1) • Architecture (WP3) • Monitoring & Meas. (WP4) • Modelling & Simulation (WP5) • Visual Datamining (WP6) • INTERMON Demo • Ulrich Hofmann (SalzburgResearch) • Mauro Gargiulo (CINI/ITEM) • Sandra Tartarelli ( NEC) • Matthias Scheidegger ( Uni Bern) • Stefan Michaelis ( Uni Dortmund) • .......

  37. WP slides will be stored on this computer ( sunday) • .... • ....

  38. Outline • Project Overview (WP1) • Architecture (WP3) • Monitoring & Meas. (WP4) • Modelling & Simulation (WP5) • Visual Datamining (WP6) • INTERMON Demo • Ulrich Hofmann (SalzburgResearch) • Mauro Gargiulo (CINI/ITEM) • Sandra Tartarelli ( NEC) • Matthias Scheidegger ( Uni Bern) • Stefan Michaelis ( Uni Dortmund)

  39. demo slides will be stored on this computer ( sunday) • .... • ....

More Related