140 likes | 253 Views
Network Monitoring and Usage. Introduction to OGF Standards. But the Network just works !. Grids always used resource information about: CPUs, memory, disks, Job queues But later Grids need information about the Network resource: Decisions by the Middleware Resource Broker
E N D
Network Monitoring and Usage Introduction to OGF Standards
But the Network just works ! • Grids always used resource information about: CPUs, memory, disks, Job queues • But later Grids need information about the Network resource: • Decisions by the Middleware Resource Broker • Performance investigations • Network Operators & Capacity planning • Many monitoring frameworks – all different but need to interoperate • Must be able to describe the topology: • Monitoring • Policy • Dynamic control • Networks are becoming dynamic – multi-domain on demand operation from the middleware. • Need for standard mechanisms to describe and publish network descriptions, performance characteristics, & enable dynamic control. 2
Infrastructure Area: Networking Use Cases Best Practices Standards • The relation between the working groups Network Measurements NM-WG Network Measurement & Control NMC-WG Network Mark-up Language NML-WG Grid High Performance Networking GHPN-RG Grid-Network GNI-BOF Network Service Interface NSI-WG spawn Network-Network DNMR-BOF merge DICE Grid Virtualisation WG; Firewall Virtualisation WG 3
Network Measurements WG • Focuses on Network Characteristics of interest to grid applications. • Developed standard mechanisms to describe and publish these characteristics to the Grid middleware, network operators etc. • Created a document categorising the Network Performance Characteristics for Grid Applications. • Created XML Schemata to publish and exchange the values of the observations of these characteristics along with attributes describing the measurement conditions. 4
Characteristic HierarchyDoc • “A Hierarchy of Network Performance Characteristics for Grid Applications and Services” • Document defines terms & relations: • Network characteristics • Measurement methodologies • Observation • Nodes & Paths • Defines the meanings • Discusses the use & relations • For each Characteristic • Defines the meaning • Stated the attributes that SHOULD be included • Discusses the issues to consider when making an observation • GGF Proposed Recommendation GFD-R.023www.gridforum.org/documents/GWD-R/GFD-R.023.pdf 5
perfSONAR: Using NM-WG Schema • perfSONAR uses the NM-WG Recommendations and Schemata for the API • Proposed the NMC-WG for protocols • perfSONAR is performance middleware • Modular • Web services-based • Decentralized • Integrates: • Network measurement tools • Network measurement archives • Discovery • Authentication and authorization • Data Manipulation • Topology • Visualization 6
perfSONAR is a joint effort: ESnet GÉANT2 JRA1 Internet2 RNP (Brazil) ESnet includes: ESnet/LBL staff Fermilab Internet2 includes: University of Delaware Georgia Tech SLAC Internet2 staff perfSONAR Uptake & Deployment • GÉANT2 JRA1 includes: • Arnes • Belnet • Carnet • Cesnet • CYNet • DANTE • DFN • FCCN • GRNet • GARR • ISTF • PSNC • Nordunet (Uninett) • Renater • RedIRIS • Surfnet • SWITCH • Other contributions & installations: • CLARA (Latin American Cooperation of Advanced Networks) • LHC Network • JANET An OGF success story: 27 partners 7
Network Mark-up Language WG • Working to describe network topologies with a standardized network description ontology and schemata • The work will: • facilitate interoperability between different projects. • allow creation of inter-domain network graphs at various abstraction levels • provide an information model for service discovery • facilitate on-demand multi-domain network provisioning such as QoS, point-to-point lightpaths, Lambdas • Feed into standards from other OGF working groups 8
IP layer Ethernet layer STS layer OC-192 layer UTP layer SONET switch with Ethernet intf. Ethernet & SONET switch SONET switch with Ethernet intf. fiber layer End host SONET switch End host Université du Quebec CA★Net Canada StarLight Chicago MAN LAN New York NetherLight Amsterdam Universiteit van Amsterdam An example of the descriptive task to be done 9
Dirac SURFNET DCN Internet2 & ESNET AutoBAHN GÉANT & NRENs The Network Service Interface: Driver Dynamic domains are trying to inter-work NOW 10
Network Service Interface WG • First WG meeting in OGF24 • Interest & support from industry – grid operators, network equipment vendors • industry partners include NTT, KDDI, Nortel and Alcatel-Lucent Bell Labs • Build on research projects including: • Phosphorus, AutoBahn, DICE, and G-Lambda • Involves currently deployed dynamic networks such as • ESnet, Internet2, GÉANT, Surfnet • There is a real demand from users 11
Summary • There is a real demand from users for advanced network facilities • The need for inter-operation between domains & providers drives the need for standards • OGF facilitates • co-operation & collaboration • A document series for Standards 12