250 likes | 440 Views
“ ITU-T Standardization and other key ITU Activities ” Havana, Cuba 8 - 9 February 2011. “ Evaluation of the QoE in NGN starting from UIT recommendations .”. NGN. Eng. Luis Enrique Conde del Oso. ETECSA. Cuba luis.conde@etecsa.cu. Eng. Luis Enrique Conde del Oso. ETECSA. Cuba
E N D
“ITU-T Standardization and other key ITU Activities” Havana, Cuba 8 - 9 February 2011. “Evaluation of the QoE in NGN starting from UIT recommendations.” NGN Eng. Luis Enrique Conde del Oso. ETECSA. Cuba luis.conde@etecsa.cu Eng. Luis Enrique Conde del Oso. ETECSA. Cuba luis.conde@etecsa.cu
Background. • Obsolescence of TDM Technology. • Requirements for new services and increase of the current services. • - Fixed telephone service growth. • - Mobile service growth • - Wide development of data services. • - Introduction of novel services such as IPTV. Current scenario of Telecom Carriers • Development of Services on NGN networks with NAM (GIE). • Optimization of National Transport Network IP/MPLS. • Designs and implementation of Local and Regional Metro • Networks. • Introduction of the objective quality validation of services in real • time (and its extension to quality profile of telecommunications • network). Proposal of Development Beginning of the scheduled development
The Metro Ethernet like support of the Broadband. To the Service POP Ring To the Service POP To the Service POP Ring Ring Standards defined in the T-MPLS: G.8110.1 NetworkArchitecture of T-MPLS G.8113 Requirements OAM G.8114 OAM G.8112 UNI/NNI G.8131 Lineal Protection G.8132 Rings Protection G.8121 Equipment T-MPLS G.8151 EMF G.8152 Infomodel Source: Telecom Italia – VPDT ETECSA.
Pseudo rings of the Provincial Metro Ethernet of Havana. Network simulations in TILAB.
Punto 3 Validación Punto 2 Validación Punto 1 Validación (Signal no encrypted) VoD Platform of IPTV VoD ADM ADM ADM ADM ADM ADM (Signal encrypted) • Different levels of a NGN Network. IP/MPLS AR BRAS PE AR BRAS PE The Operators of Telecommunications generally use unique network which include the return channel, and they are IP broadband network with solutions FTTH, FTTB and FTTC and last mile TechnologiesADSL, ADSL2 +, VDSL, VDSL2 + and GPON. In these network protocols like PIM, IGMP and BGP should be activated. Service PoP Service PoP METRO REGIONAL METRO PROVINCIAL E1 STMn FE Eth/SDH GE Source: VPDT. ETECSA.
Quality Profile on networks, according to the following ITU-T Recommendations G.1050, and ITU-T Y.1541. Source: UIT-T. • DSL Forum's WT-126 • SD. 1 pack./loss every 30 minutes. • (MLR=0.004 pack/seg) • HD 1pack./loss. every 4 hours • (MLR=0.0005 pack/seg) Source: DSL Forum's WT-126
Quality Profile of ToIP, according to the ITU-T Recommendations. ITU-T G.114 Delay ≤ 300 mseg. (Bidirectional). Source Asistencia Técnica de Telecom Italia.
Obtaining of the information for the validation of the quality of the video signal. A video signal to be transmitted over a IP network should be compressed. The codec MPEG defines a sequence of images I, B and P, which a GOP conforms. In the header of these packets they are fields that possess outstanding information's to be able to make the validation of the quality of the video signal Source: Shenick.
They group in 3 levels of priority: Priority 1. Correct decoding. Priority 2. Quality Tx of the IP Package. Priority 3. It Influences in specific applications. • Main fields of the header in Transport Stream. 8 Bytes Source: UIT-T
Human Vision Constraints. • QoE and QoS. Perceived Quality (QoE), at service level end to end. STB influence Data Metrics “Same value of PSNR” Quality dependence of the Service SLA SLA SLA Network Quality (QoS), transport packet function Source: VPDT. ETECSA.
Correlation Ref. Complete. Ref. Reduced. Without Reference. Objective Metrics Picture Metrics Flows of Video Metrics Data Metrics T- Factor (Deep Inspection of the flow of the Video (TS and UDP). The impact of the disturbances of the Network depends on the Codec, the losses and its propagation (space and time). MDI (Slight Inspection of the Video flow (TS and UDP). Independent of the Codec IP Network.). Analysis of Videos Decoded. MSE PSNR (Evaluation of Packages) Analysis of the Information visual contained. VHS Metric. (Aspects of the Human vision) • State of the art of validation Metrics for video quality. ITU-T Metrics (VQM) BT.500.11 (Images of TV). P.910 (Aplic. of Multimedia), Video Quality. P.911 (Aplic. of Multimedia), Audiovisual Quality. Subjective Metrics MOS Implicit comparison (DSCQS). Explicit comparison (DSIS) Absolute valuations (SSCQE) Valuations with Absolute Category (ACR). Source: VPDT. ETECSA.
FreeProbe with T- Factor Metric. Freeprobe for Codec H.264 AVC. FreeProbe with MDI Metric. FreeprobeJPER (ToIP Service) • Development of metrics in FreeProbe Tools. (Software open source). Source: Telecom Italia - VPDT. ETECSA.
Test with the FreeProbe (T-factor), simulation of the solution of Orange. This test allowed the evaluation of the potentialities and the weaknesses of the ETECSAaccess network to support a service of BTV, MPEG-2, and it consisted on the design of a Hybrid Network that simulates the solution used by Orange in its service of IPTV, which allows to increase the covering of a service of BTV in areas where you cannot offer an appropriate band width for this service. It facilitates the determination of Eligible and Not Eligible Users 200 Watts Not Eligible Users 2 Km. @ 512 Kbps DVB-T Elegible Users ≤ 500 m @ 4 Mbps Source. VPDT. ETECSA. Here the impact of the transcodificación of the signal was evaluated due to not having the contents the same code format as well as the employment of a Hybrid solution in Havana City and its repercussion starting from the behavior of the error accountants SAE, SDE and SIE in the period of evaluation of the quality and its correlation with the subjective observation of the sign.
IPTV Service Testing Model applied at ETECSA test. The introduction of the metric MDI in the Freeprobe and the necessity of making experimental tests to define the necessary objective-subjective correlation and to determine the respective thresholds in each disturbance type, made necessary the design of a laboratory testing model. Source VPDT. ETECSA.
ASP ( Active Server Page) ODBC (Open DataBase Connectivity) C ++ C ++ C ++ • Services implemented in IPTVPlatform in Testing Model. Source: VPDT. ETECSA.
Trainingpreparation of the subjective observer. Delay Jitter Packet Loss NetDisturb Video Server Source VPDT. ETECSA. MOS DMOS (5) (4) (3) UIT-T J.144R y UIT-R BT.1683. (2) Source: Telecom Italia – VPDT ETECSA. Muy Molesto Presencia elevada de errores que perjudican el audio y el video (1)
Test results done in the testing model (Channel SD to 4 Mbps) Results of the Simulations Tests. Uniform packet loss: Superior losses to 0.001% are inadequate for a service of IPTV and they have bigger impact in the audio one that in the video. Packet Loss in Burst: Bigger affectation in the video that in the audio one, however they are less annoying for the user than the uniform losses. Delay and the Jitter: Affectations are not observed in the range between 0 and 50 mseg, what demonstrates the recommendations of the WT-126 of the DSL Forum´s.
FreeProbe FreeProbe FreeProbe • Centralization of QoE Validationwith FreeProbe to substitute solutions with Shadow Router. (Cisco, Tektronix, JDSU, Huawei). FreeProbe Server SNMP SNMP SNMP Metric MDI Pseudo ring Ethernet Serv POP 1 Serv POP 2 Pseudo ring Ethernet DWDM Serv POP 4 Serv POP 3 Pseudo ring Ethernet IPTV Head End Metric MDI Measurement point Data collect Source: Telecom Italia - VPDT. ETECSA. Metric T-Factor
Results of the Tests of the Triple Service Play with FreeProbe (MDI). Electric Network ETECSA National Intranet BPL QoS VLAN QoS Results of the tests of a Triple Play service with the use of the FreeProbe with metric MDI in the testing model, with the services BTV (1.5 Mbps MPEG-2), Access to Internet and ToIP (G.729A) on a Network with QoS and without implemented QoS (Network BPL vs Intranet of ETECSA). VLAN 10 VLAN 20 VLAN 30 Source: VPDT. ETECSA.
Methodology for the measurement of the capacity of memory of temporary storage (Buffer) of the STB AmiNET110. Video Server 4 Mbps and codification MPG2 HUB (Without Packets Loss) 1.5 seg Methodology for the measurement of the capacity of memory of temporary storage (Buffer) of the STB AmiNET110. Capacity of Memory = 6 Mb. Source: VPDT. ETECSA.
Conclusions. The design of the IP network of broadband in ETECSA with the implementation of protocols like the PIM, IGMP and BGP among others constitutes the fundamental pillar of the development of the Objective Network of ETECSA, allowing the expansion of the NGN and the possibility of offering novel services like the IPTV. The valuable theoretical and investigative experiences developed for the appropriate correlation of the QoS and the QoE with the employment of the probe FreeProbe, with metric T-factor and MDI, they have allowed ETECSA to have a tool personalized for the validation of the quality of the service of IPTV, which was extended, with the addition of new metric in the Freeprobe that include the validation of the service of ToIP (at the moment in test). The Platform of Services of IPTV developed in ETECSA, jointly with the laboratory testing model that incorporates a IP network emulator was an important aspects that minimized the costs of the investments of the investigative stage were and they allowed to obtain important theoretical and practical results. The proposal of use of the FreeProbe (MDI) to validate the Profile of Quality of the IP Network of ETECSA, it transforms it into an important alternative in front of the expensive acquisition of the Shadow Router dedicated to this only function.
Dependent of the codification Metric with capacity of identification of errors at level of MPEG-2 caused by losses of packagesUDP/RTP. Delay Metric of macro indicatorsSA,SD y SI Jitter Packet Loss Fuente Telecom Italia - VPDT. ETECSA. • Windows (GUI) of FreeProbe (T-Factor Metric ) . It is based on the propagation of errors inside the GOP, among images I, P and B during the transport of the same one in the IP network, taking in consideration the behavior of the error accountants SAE, SDE and SIE, in the period of analysis of the quality, having in bill determined preset thresholds and the priority defined in the obtained parameters of the head of the packages. SA: Service Availability. SD: Service degradation. SI: Service Impairment.
Propuesta Metric Media Delivery Index DF= Delay Factor MLR= Media Loss Rate DF:MLR Delay Jitter Packet Loss • Windows (GUI) of FreeProbe (Metric MDI) . It is based on the analysis of the behavior of the buffer, “Underflow” or “Overflow” of the same one, that which can cause the freezing of the image or the appearance of defects in the same product of excessive losses of packages, having bigger repercussion if these lost packages contain images of the type I or P. It doesn't depend on the codification DF: MLR A Buffer Virtual minimum 1Mb, requires which adds a retard of 266.67 mseg (1Mb / 3.75 Mbps) DF = [VB(max) – VB(min)] / MR MLR = (Prospective packages-Received Packages) / interval of time in seconds Fuente Telecom Italia
Original video VS Original video with 1% Packet Loss Rate. • Video with 1% Packet Loss Rate. • Original Video. Source VPDT. ETECSA.