270 likes | 283 Views
Learn how to assess and optimize Quality of Service (QoS) for popular mobile services, focusing on user experience. Explore typical measurement procedures, post-processing methods, and network-based QoS measures.
E N D
Content and presentation of Recommendation E.MQoS Joachim Pomy, SG 12 Rapporteur Consultant, Opticom GmbH Consultant@joachimpomy.de ITU Workshop on “Benchmarking QoS Evaluation of Multimedia Networks” (Ouagadougou, Burkina Faso, 18 July 2013) Ouagadougou, Burkina Faso, 18 July 2013
Draft New Rec. E.MQoS • E-series: • Overall network operation, telephone service, service operation and human factors • E.800-series: • Quality of telecommunication services: concepts, models, objectives and dependability planning • Title: • QoS Aspects for Popular Services in Mobile Networks
Scope of E.MQoS (1/2) • Assessment of Quality of Service • Summary of basics of QoS, always seen from the user's perspective • Differences to Quality of Experience (QoE) • Guidance to assure QoS assessments conducted in a meaningful way • Definition of Quality of Service parameters and their computation • QoS parameters and their computation for popular services • abstract definition = generic description of parameters • abstract equation • user and technical trigger points • Harmonized definitions are prerequisites for the comparison of QoS measurements and measurement results • Typical procedures for Quality of Service measurement equipment • Measurement procedures needed to perform the measurements of QoS parameters
Scope of E.MQoS (2/2) • Requirements for QoS measurement equipment • Defines minimum requirements of QoS measurement equipment • values and trigger points needed to compute the QoS parameter • allow performing measurements in a reliable and reproducible way • Definition of typical measurement profiles • Specifies typical measurement profiles • required to enable benchmarking of different mobile networks • both within and outside national boundaries. • Post processing and statistical methods • Describes procedures for statistical calculations • for QoS measurement of mobile networks using probing systems. • Network based Quality of Service measurements • E2E QoS measurements inside the network • without direct access to the end point terminal.
Popular Services • Services are not standardized • Focus on popular services • Widely used in the market • Test results are meaningfull to customers • Examples • Web radio • E-mail clients • Web portals
Main structure of E.MQoS • 6 Assessment of Quality of Service • 7Definition of Quality of Service parameters and their computation • 8Typical procedures for Quality of Service measurement equipment • 9Requirements for Quality of Service measurement equipment • 10Definition of typical measurement profiles • 11Post processing and statistical methods • 12Network based Quality of Service measurements • Appendices (informative)
6 Assessment of Quality of Service • 6.1QoS Background • 6.2QoS Assessment Process • 6.3Basic Settings for QoS Assessments • 6.4Service Independent QoS Criteria • 6.5Service dependent QoS Criteria
7Definition of Quality of Service parameters and their computation • 7.1QoS Parameter Basics • 7.2Service independent QoS Parameters • 7.3Direct Services QoS Parameters • 7.4Store‑and‑forward (S&F) Services QoS Parameters
7.2 Service independent QoS Parameters • 7.2.1Radio Network Unavailability [%] • 7.2.2Network Non Accessibility [%] • 7.2.3Attach Failure Ratio [%] • 7.2.4Attach Setup Time [s] • 7.2.5PDP Context Activation Failure Ratio [%] • 7.2.6PDP Context Activation Time [s] • 7.2.7PDP Context Cut‑off Ratio [%] • 7.2.8Data Call Access Failure Ratio [%] • 7.2.9Data Call Access Time [s] • 7.2.10DNS Host Name Resolution Failure Ratio [%] • 7.2.11DNS Host Name Resolution Time [s]
7.3 Direct Services QoS Parameters • 7.3.1File Transfer (FTP) • 7.3.2Mobile Broadcast • 7.3.3Ping • 7.3.4Push to Talk over Cellular (PoC) • 7.3.5Streaming Video • 7.3.6Telephony • 7.3.7Video Telephony • 7.3.8Web Browsing (HTTP) • 7.3.9Web Radio • 7.3.10WLAN service provisioning with HTTP based authentication • 7.3.11Wireless Application Protocol (WAP) • 7.3.12IMS Multimedia Telephony • 7.3.14Group Call • 7.3.13E-mail
7.4 Store‑and‑forward (S&F) Services QoS Parameters • 7.4.1Generic Store‑and‑forward Parameters • 7.4.2E‑mail • 7.4.3Multimedia Messaging Service (MMS) • 7.4.4Short Message Service (SMS) Short Data Service (SDS)
8Typical procedures for Quality of Service measurement equipment • 8.1Aim of measurement • 8.2Classification of services • 8.3General aspects for all types of services • 8.4Telephony measurements • 8.5Store-and-forward services measurement • 8.6Data measurements
8.4 Telephony measurements • 8.4.1General aspects • 8.4.2Speech telephony • 8.4.4Group Call • 8.4.3Video telephony
8.5 Store-and-forward services measurement • 8.5.1General aspects • 8.5.2SMS measurements • 8.5.3MMS • 8.5.4E-Mail • 8.5.5SDS
8.6 Data measurements • 8.6.1Common aspects • 8.6.2FTP • 8.6.3HTTP • 8.6.4E-mail • 8.6.5WAP • 8.6.6Streaming Video • 8.6.7Media Download
9Requirements for Quality of Service measurement equipment • 9.1Overview • 9.2General requirements • 9.3Fixed QoS Test-equipment (FQT) • 9.5Mobile based measurement equipment • 9.4Mobile QoS Test-equipment (MQT)
10Definition of typical measurement profiles • 10.1Measurement profiles • 10.1.3Usage Profiles for Data Sessions • 10.1.1Classification of measurement environments • 10.1.2Service profiles
11Post processing and statistical methods • 11.1Important measurement data types in mobile communications • 11.2Distributions and moments • 11.3Visualization techniques • 11.4Time series modelling • 11.5Data aggregation • 11.6Assessment of performance indices
12Network based QoS measurements • 12.1Network Measurement Basics • 12.2Measuring QoS Parameters in the Network • 12.3Comparing Network and End- point Test Measurements
Appendices (informative) • I Examples for measuring trigger points • II Streaming explanations • III Push to Talk over Cellular Information • IV QoS parameter export • V Which parameters have an impact on the effect of blocking ? • VI Reference {SMS | SDS} • VII Content integrity checking • VIII Transfer times versus used data rate and content size • IX Examples of statistical calculations • X The concept of QoE reporting • XI Examples of Network Based QoS Measurements • XII 3GPP SA5 "UE Management"
Confidence Intervalls for Different Sample Sizes (1) • The following examples show the effect of different sample sizes in a measurement campaign. It is also based on the Pearson-Clopper formulas for the calculation of confidence intervals. Therefore, the examples are valid in a generic way and even for small sample sizes. For higher sample numbers, the calculation of confidence intervals based on the approximation of a normal distribution can be applied. • Three different graphs are depicted: Sample sizes in the range: • between 100 and 1 100 samples; • between 1 100 and 2 100 samples; and • between 1 000 and 11 000 samples.
Schedule for draft new Rec. E.MQoS • 31 August 2013 • Final timeline for submitting comments directly to the editors • 7 November 2013 • Submission as Contribution to SG 12 • 20 November 2013 • Deadline for Contributions submitted to TSB • 12 December 2013 • Planned Consent of SG12 Plenary • January 2014 • Start of Alternate Approval Procedure (AAP) • March 2014 • Pre-Publication • ??? 2014 • Publication
Any questions ? Joachim Pomy Telecommunications & Int'l Standards Germany Tel.: +49 177 78 71958 Email: consultant@joachimpomy.de