1 / 46

ABSTRACT

TD-xxxxxxxxx. ABSTRACT

angus
Download Presentation

ABSTRACT

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TD-xxxxxxxxx ABSTRACT As indicated in liaison presentations to SG12 over the last 2 years, TIA TR30.3 has been working on a proposed new revision to TIA-921 (Project: PN-3-0062-RV2) and the ITU-T version of the document G.1050, Network Model for Evaluating Multimedia Transmission Performance Over the Internet Protocol. TIA TR30.3 has now completed this work and has prepared a draft of TIA-921-B for TIA ballot. TR30.3 has also prepared a harmonized draft of ITU-T G.1050 Revised. TR30.3 and submits this draft document as a liaison to the upcoming Q13/12 meetings in Geneva. We request comments and feedback during the session of the attached draft of G.1050 Revised with a goal of achieving possible consent during January session. As Chairman of TR30.3, I am submitting the proposed revision to G.1050 and electronic attachments for review and consideration by SG12 Question 13 as an update to Recommendation G.1050 at the January2011 meetings in Geneva. TIA TR-30.3 has approved submitting this document and associated materials to ITU-T SG12. This presentation provides an overview of the proposed revision of G.1050 and electronic attachments. Attention: This is not a publication made available to the public, but an internal ITU-T Document intended only for use by the Member States of ITU, by ITU-T Sector Members and Associates, and their respective staff and collaborators in their ITU related work. It shall not be made available to, and used by, any other persons or entities without the prior written consent of ITU-T.

  2. Proposed Revision to G1050Network Model for Evaluating Multimedia Transmission Performance over the Internet Protocol Liaison to ITU-T SG12 – Q13, Q14, Q17 TIA TR30.3 Committee Jack Douglass, Chairman, TIA TR30.3 PacketStorm Communications January 18 to 27, 2011

  3. Agenda • G.1050-2007 / TIA-921A • Proposed G.1050 Revision • IP Network Simulation Source Code • IP Network Simulation • Network Models: Core, Core to LAN, LAN to LAN • Impairment Combination Tables • Inputs to IP Network Simulation • IP Network Simulation Outputs • Electronic Attachment • Possible Uses for IP Network Impairment Simulation • Future TIA-921/G.1050 Work • Requests for SG12

  4. ITU-T G.1050 and TIA-921Test Profiles based on ITU-T Y1541 Different test profiles for different Service Level Agreements (SLAs)

  5. ITU-T G.1050-2007 and TIA-921A Network Topologies Core IP Network LAN A LAN B DUT B Local Access A Local Access B DUT A Route flapping Link Failures One-way delay Jitter Packet loss Packet Reorder Access Rates ---------------- Occupancy level Qos Edge Router Access Rates ---------------- Occupancy level Qos Edge Router LAN Rates ----------------- Occupancy level Packet loss LAN Rates ----------------- Occupancy level Packet loss LAN-to-LAN IP Network Model Core IP Network DUT A LAN B DUT B Local Access B Route flapping Link Failures One-way delay Jitter Packet loss Packet Reorder Access Rates ---------------- Occupancy level Qos Edge Router LAN Rates ----------------- Occupancy level Packet loss Core-to-LAN

  6. ITU-T G.1050-2007 and TIA-921A Impairment Severity Table LAN / Access Rate Tables 1344 General Model 120 Core to LAN ≤ 3 Mbit/s 48 Core to LAN > 3 Mbit/s (IPTV) IP Impairment Combinations (Delay and Loss)

  7. Proposed G.1050 Revision • G.1050 proposed update to Recommendation • Proposed ITU-T G.1050 Revised Recommendation harmonized with draft of TIA-921 Ballot • 43 Test Cases • Request comments and feedback during the session • Achieve possible consent during January session • Electronic Attachments • Normative (Simulator Inputs, Outputs and Results) • Informative (C++ Source Code and Related Files)

  8. IP Network Model Simulation Source Code (Appendix) • C++ • Windows XP / 7: Cygwin 1.7 • Linux: OpenSUSE 11.3 (i386), Fedora 9 • Other Linux and Windows Tools • TCL Versions 8.4 and 8.5 • Perl 5.10 • GNUPlot 4.4 • Simulation environment running on PC • Sample data, voice, video or audio PCAP files can be run through the model and captured the output as PCAP files for analysis and comparison

  9. IP Network Model Simulation • General purpose discrete Event Simulator • Event Models simulate Network Elements • Switches • Routers • Access Technologies • Firewalls • Buffers • Connections via wires • Types of Events for Network Elements • Packet Arrival • Packet Departure • Other types of events are also possible

  10. Model Basic IP Network Element

  11. CORE Simulation Model

  12. CORE-to-LAN Simulation Model

  13. LAN-to-LAN Simulation Model

  14. Well Managed Network

  15. Partially Managed Network

  16. Unmanaged & Core Network

  17. Inputs to Network SimulationNetwork / Interferer PCAPs • Network / Interferer Traffic • IPTV Video, VoIP, Over-the-Top Video, Peer-to-Peer, HTTP, FoIP • Standard PCAPs or user provided PCAPs • PCAP – Packet Events drive Discrete Events Simulator • Packet size • Packet Timestamps • PCAP Payload • Payloads if present in the PCAP are carried through the simulator.

  18. Input PCAP File Characteristics

  19. Input PCAP FilesManaged Bandwidth Characteristics IPTV HD IPTV SD VoIP

  20. Input PCAP FilesResidual Bandwidth Characteristics Progressive Download (OTT1) Adaptive Streaming (OTT2) Peer-to-Peer HTTP FoIP

  21. Aggregate Bandwidth Characteristics Well Managed Partially Managed Unmanaged Core

  22. Simulation Outputs • Output and Result files • .out (CSV) • Time Series of Packet Loss and Delay • Packet Delay Variation (PDV) Histogram • Cumulative Distributive Functions (CDF) • Summary of results • Output PCAPs • Analysis of impaired packets can be performed if payload is included.

  23. .out File (CSV)Example: HDTV1 / DSL / Well Managed Network

  24. .out File Time Series of Packet Loss and DelayExample: HDTV1 / DSL / Well Managed Network Dw1 Dw2 Dw3 Dw4 Dw5 Dw6 Dw7 Dw8

  25. .out File PDV HistogramsExample: HDTV1 / DSL / Well Managed Network Dw1 Dw2 Dw3 Dw4 Dw5 Dw6 Dw7 Dw8

  26. .out File PDV Histograms and CDFsExample: HDTV1 / DSL / Well Managed Network

  27. Simulation Results SummaryExample: HDTV1/ DSL / Well Managed Network

  28. .pcap fileExample: HDTV1/ Dw1

  29. .out File (CSV)Example: SDTV2 / DSL / Well Managed Network

  30. .out File Time Series of Packet Loss and DelayExample: SDTV2 / DSL / Partially Managed Network Dp1 Dp2 Dp3 Dp4 Dp5 Dp6

  31. .out File PDVExample: SDTV2 / DSL / Partially Managed Network Dp1 Dp2 Dp3 Dp4 Dp5 Dp6

  32. .out File PDV Histograms and CDFsExample: SDTV2 / DSL / Partially Managed Network

  33. Simulation Results SummaryExample: SDTV2/ DSL / Partially Managed Network

  34. .pcap fileExample: SDTV2/ DP1

  35. .out File Time Series of Packet Loss and DelayExamples: Managed Bandwidth HDTV2 HDTV1 SDTV2 SDTV1 VoIP

  36. .out File PDV HistogramsExamples: Managed Bandwidth HDTV1 HDTV2 SDTV1 SDTV2 VoIP

  37. .out File Time Series of Packet Loss and DelayExamples: Residual Bandwidth OTT1 OTT2 HTTP Peer-to-Peer FoIP

  38. .out File PDV HistogramsExamples: Residual Bandwidth OTT1 OTT2 HTTP Peer-to-Peer FoIP

  39. Electronic Attachment • Compressed File Archive (approx 1.2G compressed) • G.1050 Document (PDF) • Input PCAP files (without payloads) • TCL files for 43 Test Case scenarios • .out files • Output PCAPs • PNGs • Results Summary (.csv) • Impairment Combination Table • Simulation Code – C++ Code (Informative)

  40. Possible Uses for IP Network Impairment Simulation • Simulate Real-World IP network impairments • PDV Histogram and Packet Loss characteristics • Test any type of IP stream(s) (PCAP) under simulated network conditions • Standard Test Cases or user define simulated network conditions • Test with or without payload • Capture output PCAP for analysis and comparison • Test any type of IP stream using Hardware Emulation of simulated network model • Standard Test Cases or user define simulated network conditions

  41. Example CORE-to-LAN Simulation QoS Test Stream(s) 2 HD VBR IPTV MOS Calculated from captured PCAP Interferers PDV & Loss Interferers Bandwidth QoS VoIP Down 1 2 HD CBR IPTV Interfering Stream(s) 2 SD VBR IPTV 7 HTTP OTT1 7 OTT2 7

  42. Example MOS Calculation Derived from Simulation Output PCAP Video Stream Analysis: ============================================= Stream source: 192.168.69.110:49713 Stream destination: 234.5.6.101:2345 Stream duration: 00:09:59.936 Stream CODEC: H.264 Stream transport: RTP (SSRC=0x11223344) Stream transport: MP2TS (PID=481, Ctrl=0x0000) Packet counts: received 2469009 lost 649 (0.00026) discarded 819 (0.00032) out-of-seq 6 (0.00000) duplicate 0 (0.00000) corrected 0 (0.00000) MOS-V (min/avg/max/inst): 2.74/3.93/4.56/3.19 MOS-AV (min/avg/max/inst): 2.89/3.82/4.32/3.29 Simulation Output PCAP • Captured output PCAPs can be use to analyze and compare competing algorithms Simulation .out Packet Delay and Loss Characteristic can be used to cause impairments on test streams

  43. Hardware Emulation from IP Network Simulation • Select a standard test case that includes a technology similar to the test stream • Configure the emulator with the standard .out filefor the selected test case • Run the test stream through the emulator, and evaluate the effect of the network impairments on the stream

  44. Advanced Use of the Network ModelUser-Defined Test Cases • Replace any of the standard interferer pcap files with user interfere pcap files • Change the traffic mix • Change network conditions • number of switches • bit error ratio • access technology parameters, • etc.

  45. Future TIA-921/G.1050 Work • Active Network Emulation using Interferer PCAP files • Add Cable Access Characteristics • Add Wireless Access Characteristics • Update as IP Network evolves

  46. Requests to SG12 • Provide comments and feedback on G.1050 Revised during session • Document • Simulation and Results • Electronic Attachments • Consider possible Consent of G.1050 Revised during the January session

More Related