1 / 16

Delay Variation Applicability Statement draft-morton-ippm-delay-var-as-04

Delay Variation Applicability Statement draft-morton-ippm-delay-var-as-04. December 3, 2007 Al Morton Benoit Claise. Applicability Problem: “How will the results be used?”. Krzanowski introduced the Delay Variation Problem at IETF-64 “How” Question asked at IETF-65, no suggestions yet

efia
Download Presentation

Delay Variation Applicability Statement draft-morton-ippm-delay-var-as-04

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Delay Variation Applicability Statementdraft-morton-ippm-delay-var-as-04 December 3, 2007 Al Morton Benoit Claise

  2. Applicability Problem: “How will the results be used?” • Krzanowski introduced the Delay Variation Problem at IETF-64 • “How” Question asked at IETF-65, no suggestions yet • RFC 3393 lists two key uses for the Delay Variation Metric • Memo Considers these 3 Tasks and N Special Circumstances Network Characterization: Inferring Queue Occupation on a Path Application Performance Estimation: Sizing of De-Jitter Buffers What about Spatial Composition ? DST SRC What if circumstances are challenging?

  3. Inter-Packet Delay Var. (selection func = previous packet) Src Dst T1 IPDV(2) = (R2-R1) – (T2-T1) R1 T2 R2 T3 R3 T4 (5)(2) (4) (3) T5 R4 IPDV(4) = (R4-R3) – (T4-T3) R5

  4. Packet Delay Variation(selection func = minimum delay pkt in stream) Src Dst T1 PDV(3) = (R3-T3) – (R2-T2) R1 T2 (1,3,5) R2 (minimum) T3 R3 T4 (2) (4) T5 R4 PDV(4) = (R4-T4) – (R2-T2) R5

  5. 1.  Introduction1.1.  Background Literature in IPPM and Elsewhere1.2.  Organization of the Memo 2.Purpose and Scope 3.Brief Descriptions of Delay Variation Uses (four) 3.2.  De-jitter Buffer size 4.Formulations of IPDV & PDV 5.Earlier Comparisons 6.Additional Properties and Comparisons6.1.  Packet Loss6.2.  Path Changes6.2.1.  Lossless Path Change6.2.2.  Path Change with Loss6.3.  Clock Stability and Error6.4.  Spatial Composition6.5.  Reporting a Single Number6.6.  Jitter in RTCP Reports6.7.  MAPDV26.8.  Load Balancing 7.Applicability of the Delay Variation Forms and Rec7.1.  Uses7.1.1.  Queue Occupancy 7.1.2.  De-Jitter Buffer Size7.1.3.  Spatial Composition7.1.4.  Service Level Specs 7.2.  Challenging Circumstances7.2.1.  Clock Issues7.2.2.  Frequent Path Changes7.2.3.  Frequent Loss7.2.4.  Load Balancing7.3.  Summary Table 8.Measurement Considerations for Vendors, Testers, and Users8.1.  Measurement Stream Charac.8.2.  Measurement Devices 8.3 Measurement Units8.4.  Test Duration8.5.  Clock Sync Options8.6.  Distinguishing Long Delay - Loss8.7.  Accounting for Packet Reordering8.8.  Results Representation and Reporting… 12.Appendix on Reducing Delay Variation in Networks 13.Appendix on Calculating the D(min) in PDV Current Outline of the Draft

  6. Recap of activity: IETF-69 and Updates in 04 • Strong support for this work and its current conclusions during the IPPM Session • No opposition, either • Alan Clark’s comments: • Added ref to G.1050 (and G.1020) in the background • Added new Section 5.5, summarizing metric comparisons in Contribution COM12-D98 (Task: estimate DJB discards) • Percentile based approaches are particularly suitable for SLA agreements. Easy to specify and implement an SLA of the type “no more than x% of packets shall arrive later than y milliseconds” – added to section 6.5 • Suggested text for Section 3.5 Separation of scheduling/ smoothing PDV from PDV introduced by the network • Let’s add this if we complete the analysis and find a solution, we have a placeholder now… • Stephen Konish Jr.: Support for draft, fix Fig #s sec 6

  7. Recap of activity: IETF-69 and Updates in 04 (2) Loki Jorgenson’s Comments (much summarizing!): • there are implicit assumptions that should be made more explicit, like stream characteristics that are typical and what information is measurable • New paragraph in Background on streams – Neither form is independent of stream characteristics • New section 4.3 – Both forms are 2-point metrics, derived from 1-way Delay (need timestamps) • Addressed in Measurement Considerations Section 8.1 • references to "optimizing de-jitter buffer“… motivate the choice of jitter definition - is that related to the (anticipated) mandate of PMOL/APM? • Scope is an Applicability Statement on two forms of IPPM’s metric, using realistic uses for Delay Variation meas. • If this info is applicable elsewhere, so be it. New paragraph in the Scope section 2 gives some cautions.

  8. Recap of activity: IETF-69 and Updates in 04 (3) Loki’s Comments (much summarizing!): • Need more discussion of typical implementation requirements - there is only passing mention of: data processing for statistics with implications on memory req. and reference value D(min), quantiles non available as a running measure. Possibly emphasize G.1020/MAPDV2? • Introduced G.1020 more thoroughly in Background • 7.2.1 discusses storage implications, MAPDV2 and RFC3550 Jitter • Added material to Measurement Devices section 8.2 • “quick variation” explain as short timescale variation • Explained and replaced in section 5.1 • Why no consideration of the practical case where packet arrival times are known but not transmission times for a periodic stream? Does this suggest that there is no meaningful implementation of IPDV without transmission times? • We are comparing the fundamental properties of the DV forms (4.3) • AND, the implications of the definitions on Methods of Measurement – material in Measurement Streams, section 8.1, list item 3

  9. Recap of activity: IETF-69 and Updates in 04 (4) Loki’s Comments (much summarizing!): • Sec. 8.1 Measurement Stream Characteristics, there should be some description of the impact of sampling methodology, where not all the packet D(i) are sampled. This should include some suggestion for methodology references (provided). • Added it, and the references • Sec 8.3, Test Duration, some references to the stability of networks would be useful. • Added discussion and references (now 8.4) • Sec 8.5, Distinguishing Loss from Delay • Add ref. to draft-morton-reporting-metrics & summary • Appendix 12 include equipment & config dysfunction • Another comment suggested to remove this section… • Appendix 13 consider including code fragments for the described method 

  10. Recap of activity: IETF-69 and Updates in 04 (5) Carsten Schmoll’s comments: • “For me it is clearly the most complete comparison PDV vs. IPDV up to now and very helpful to understand the nitpicks of each definition. (Thanks!) • Although PDV is a shifted version of the delay itself, … I believe it has its own justification and use • mentioned in sec 4.2 • For IPDV it would be nice to know, how symmetrical it is in practice. Does anyone have results on this? • Packet spacing influences it, see the Ciavattone et al. reference. • Esp. for IPDV it is not clear to me the effect of the packet selection function: Does the size of the gaps between selected packets have an influence on the distribution of the resulting IPDV values? (in theory yes (I could give an example), but in practice?) • See the Li and Mills Reference. • Conclude with something like a table which recommends clearly the use of PDV or IPDV and suggested stats per desired application. (OK see section 7.3)

  11. Recap of activity: IETF-69 and Updates in 04 (6) Bob Holley’s comments: • IPDV distributions are time dependent – complicates analysis (Agree) • Agrees that PDV results are relevant to setting buffer size – and operational perspective • From the engineering perspective, the efficiency of queue algorithms is of interest – possible that IPDV can be useful for this (TBD). • Symmetrical IPDV dist. means one side is redundant • But this is not assured – see section 5.2 DV>inter-pkt time • Clock stability is Demichelis’ strongest argument • See discussion of Clock error in 6.3, IPDV will not have zero mean, so analysis based on that assumption, or that the IPDV distribution is symmetric will be affected.

  12. Recap of activity: IETF-69 and Updates in 04 (7) Bob Holley’s comments (continued): • Did not see how IPDV reacted to the lossless path change. • Brief example added • 6.2.2 Path change with Loss is the common case, yet IPDV does not detect it at all! This needs further study. • Do we rely on DV to detect path changes? • Does 7.2.2 Frequent Path Changes conflict with this? • Again it depends on what you want to learn from a DV metric. If you want to count path changes with loss, IPDV is not the metric to use. • Measurement Units (8.2) discusses implementation • Re-titled Measurement Devices

  13. Summary of Comparisons • Challenging Circumstances for measurement: • IPDV form offers advantages when • Path changes are very Frequent and lossy • Meas. System Clocks exhibit “some” Skew • PDV form is less sensitive to Packet Loss • Spatial Composition of DV metric: • All validated methods use PDV, • IPDV sensitivities to sequence and spacing changes is an issue, and tend to break the IID requirement. • Estimate of Queuing Time & Variation: • PDV estimates this, especially when sample min = true min • Determine De-jitter Buffer Size Required • PDV “pseudo-range” reveals this property by anchoring the distribution at the minimum delay • Specification Simplicity (SLA or SLS) • one constraint for PDV single-sided positive distribution

  14. Summary Table (section 7.3)

  15. Newest Sections and Questions!!! • Section 8: Measurement Considerations • This section provides guidance in many areas – Useful? • Do we want to recommend measuring BOTH IPDV and PDV? • Do we want to reconstruct the IPDV and DV later on, with a different interval? • Appendix: Guidance for reducing DV in networks • Useful? • One comment at IETF-69 to leave this out

  16. Summary • IPDV and PDV each have their Strengths and Weaknesses • Initial (00) Conclusions have seen agreement • Suggestions for additional Tasks & Circumstances • Need Feedback on Questions & proposed sections and questions raised in the text of the draft • Thanks to readers for their comments help finishing this up

More Related