1 / 6

DRAFT: SIP Performance Metrics Author: Daryl Malas 66 th IETF Meeting - Montreal

This document addresses the lack of standardization in SIP performance metrics, proposing a set of standard terms, methods, and metrics for benchmarking SIP application and network device performance. It also discusses the relevance and industry acknowledgment of these standards.

kyser
Download Presentation

DRAFT: SIP Performance Metrics Author: Daryl Malas 66 th IETF Meeting - Montreal

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. DRAFT: SIP Performance MetricsAuthor:Daryl Malas66th IETF Meeting - Montreal

  2. Motivation • With widespread implementation of SIP the following problems have surfaced: • No standard terms • No standard metrics • No standard methods • No standards between vendors and operators • Current reliance on PSTN metrics • Operator and vendor problem!!!

  3. Industry Acknowledgment & Relevance • SIPPING WG develops standard to benchmark end-to-end SIP application performance • BMWG develops standard to benchmark SIP networking device performance • SPEC to develop industry-available test code for SIP benchmarking in accordance with IETF’s BMWG and SIPPING standards. • ITU-T (Study Group 12) focused on detailed failure/success scenarios and end-to-end benchmark guidance. -----Original Message-----From: Poretsky, Scott Sent: Thursday, June 22, 2006 8:00 PMTo: 'Malas, Daryl'; acmorton@att.com; gonzalo.camarillo@ericsson.com; mary.barnes@nortel.comCc: vkg@lucent.com; Poretsky, ScottSubject: RE: (BMWG/SippingWG) SIP performance metricsYes Daryl.  I absolutely agree.  The item posted to BMWG focuses on single DUT benchmarking of SIP performance.  Your work in SIPPING is focused on end-to-end application benchmarking.  It would be great (and I would even say a requirement) that the Terminologies for these two work items remain consistent with each other. 

  4. Proposed Metrics (Solution) • Create standard metrics with consistent terms and methods of calculations • The metrics: • Session Request Delay • Measures time from the initiation request to an acknowledgment • Session Completion Delay • Measures time from a completion request to an acknowledgment • Average Hops per INVITE • Measures the average hops an INVITE takes to traverse the network • Average Hops per Session • Measures the average hops of origination messages, associated with a session, taken to traverse the network • Session Duration Time • Measures time from the initiation message to the completion message • Session Establishment Rate • Ratio of number of initiation requests to established sessions

  5. Proposed Metrics Cont’d • Session Defects • Identifies the number of persistent failures “defects” in dialog processing • Ineffective Session Attempts • Identify attempts described as ineffective due to failure or congestion • Session Disconnect Failures • Identify issues causing sessions to fail after they were established • Session Completion Rate • Measures the number of sessions completed without failure due to timeouts. • Session Success Rate • Identifies the number of successful calls by removing the percentage of Ineffective Session Attempts and Session Disconnect Failures

  6. Feedback and Next Steps • Interest in making a working group item? • Should end-to-end media performance metrics be included? • Should terminology be extracted and included only in BMWG terminology draft? • Additional metrics? • Reduce number of metrics? • SIP MIB incorporation?

More Related