1 / 24

Monitoring QoS/QoE of mobile networks-novel approach

ITU Regional Standardization Forum for Africa (Kampala, Uganda, 23-25 June 2014). Monitoring QoS/QoE of mobile networks-novel approach. Tahitii Obioha Network Planning and Optimisation Engineer Planet Network International, France. Why Monitor QoS/ QoE of mobile networks. Reasons.

petra
Download Presentation

Monitoring QoS/QoE of mobile networks-novel approach

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ITU Regional Standardization Forum for Africa (Kampala, Uganda, 23-25 June 2014) Monitoring QoS/QoE of mobile networks-novel approach Tahitii ObiohaNetwork Planning and Optimisation EngineerPlanet Network International, France.

  2. Why Monitor QoS/ QoE of mobile networks Reasons • Monitoring = observing, checking and keeping a continuousrecord of the progress or quality of something. • It is the use of any available technical tool to assess permanently or for a given period of time a particular QoS parameter, e.g. call set up time. (ETSI EG 202 009-2) • For end-users : Satisfaction, get the best value for their money amidst others • For operators : end-user Satisfaction, Increase revenue, achieve customer loyalty, maintain competitive edge amidst others. Surveys have shown that about 90% of customers will not complain before defecting. • For Regulators: protect consumers, ensure end-user satisfaction, create a level playing field for operators to compete amidst others. They all share a common Objective CUSTOMER SATISFACTION

  3. QoE Measurement • Quality of Experience(QoE) has become an important concept since the growth of mobile services. • QoE is very SUBJECTIVE in nature as it involves human dimensions. • Measuring and improving QoE though challenging, should be undertaken in order to assess the most accurate and complete vision of the value offered by the provider to end-users. • If the QoE is high, the user is happy, satisfied and loyal while poor QoE will result in dissatisfied customers.

  4. QoE Measurement QoE KPIs Reliability QoE KPIs • USER EXPECTATIONS CAN BE GROUPED UNDER TWO MAIN CATEGORIES 1. RELIABILITY (Service quality of Accessibility and Retainability KPIs) 2. COMFORT (Service quality of Integrity KPIs)

  5. QoE Measurement Comfort QoE KPIs

  6. QoE Measurement Two pratical approaches to measuring QoE • Service level approach using Statistical Samples • Approach relies on a statistical sample of the overall network users to measure the QoE for all the users in the network. (Mean Opinion Score (MOS)) • Network Management system approach using QoS parameters • Approach relies on using NMS to collect QoS KPIs from network elements and comparing them with predefined target Knowing full well that the holy grail of subjective measurements is to predict it from the objective measurements i.e. predict QoE from a given set of QoS parameters. NMS approach provides high accuracy than Service level because of its deterministicand objective nature. Using both methods nevertheless provides a better and more accurate picture of the users’ experience

  7. Relationship between QoS and QoE QoE = f(AQoS, NQoS) + other subjective factors (expectations, mood, etc.) • Strong Correlation between QoS and QoE Relationship Between QoE and QoS may be near-linear for a voice call but non-linear for a video call

  8. Relationship between QoS and QoE • There is an exponential relationship between QoS and QoE • End-to-end QoS is an important enabler for QoE in otherwords a better network QoS in many cases will result in better QoE • QoE can be predicted from a given set of QoS parameters and vice versa (ETSI TS 102 250-1) • QoE may be improved with the right QoS mechanisms. Relationship Between QoE and QoS may be near-linear for a voice call but non-linear for a video call

  9. QoS Measurement 85% Key Performance Indicators(KPIs) Performance Key Quality (Assurance) Indicators(KQIs) 15% Assurance • Quality of Service(QoS) arrived with 2nd Generation Networks • Ability of a Network to provide a service with an assured service level. • It is intrisincally a technical concept, measured and understood in terms of networks and network elements. • An objective metric that refers to the ability of the network to achieve a more deterministic behaviour. Service Qualification is based on six 6 primary components as defined in ITU-T Rec E-800: Operability Accessibilty Retainability Integrity Security Support QoS can be measured using KPIs and KQIs

  10. Relationship between NP and QoS Network related QoS QoS aspects of service usage(ETSI TS 102 250-1) Strong Correlation between NP and QoS In otherwords Poor Network Performance ultimately results to Poor QoS

  11. Relationship between NP and QoS Qos Criteria Non network related QoS criteria Network related QoS criteria 85% 15% Mapping Network PerformanceIndicators/Parameters Target - range or limit < 2%< 90% …… <= x% CALL DROP RATECALL SETUP SUCCESS RATE …… PARAMETER N

  12. QoS NP Non-NP QoS Measurement Objective Subjective Active Passive Surveys, churn-rate, etc… Intrusive Non-Intrusive Ex.NMS: RPM System, Net Act,imanager M2000 … Walk/Drive Test Around test OMC-R Counters using NMS Ex. DT Tools: Nemo, XCAL, TEMS …

  13. Relationship between NP,QoS and QoE NP QoS & QoS QoE • NP is a subset of QoS which in turn, is a subset of the overall QoE scope • NP parameters ultimately determine the QoS • QoE can be predicted from a given set of QoS parameters and vice versa (ETSI TS 102 250-1)

  14. QoS/QoE Assesement • TWO DIFFERENT AND COMPLEMENTARY APPROACHES TO MOBILE QoS (ETSI EG 202 057-3) • Walk/Drive- round tests • Measurements based on network element counters using NMS • Monitoring :use of any available technical tool to assess permanently or for a given period of time a particular QoS parameter. (ETSI EG 202 009-2)

  15. Difference Between NMS and DT

  16. Draw backs of DT illustrated

  17. Draw backs of DT illustrated

  18. Draw backs of DT illustrated

  19. Quest for a Monitoring Tool • Monitor simultaneously 24H/7 the state of all network elements/acess technologies in an operator network passively without compromising their daily operations • Put a check on service degradation and sometimes outages to the benefit of the government and the masses. • Quest for a system that can monitor the performance of mobile operators independent of the vendor and technology  • Flexible Benchmark Audit; weekly, monthly or quarterly. • Track the evolution and expansion of the mobile operators network. • Reduce churn rate of end-users directly or indirectly • A robust  system that is easily upgraded to meet the rapid evolution of mobile technology. • A platform that will facilitate  actionable decision making to the benefits of all parties involved with little or no OPEX. • Create a level playing field for all operators and protect the interest of all consumers not just those in the urban areas.

  20. Network Management Systems EXAMPLES OF NMS solutions in the market today For REGULATORS (Vendor-Independent) Regulators (QoS)Performance Management (RPM)system- compatible with all major network vendors (Huawei, ZTE, Ericcsson, Alcatel and NSN) FOR OPERATORS (Vendor –dependent) • imanager M2000 for Huawei vendor • NetNumen U31 for ZTE vendor • NEtAct for Nokia Siemens Vendor • NetOp EMS for Ericsson and Omnivista 2500 for Alcatel vendor

  21. RPM SYSTEM OVERVIEW Regulators’ (QoS) Performance Management System is the novel NMS solution that handles the task of interfacing all the operators’/service providers’ network monitoring systems, collect perfomance data records and create KPI reports that renders a given network performance against published benchmarks. MainFeatures • QoS monitoring and reporting 24/7 all year round • Unlimited number of Users/ Single License • Multi vendor Multi access technology • Automatic Reporting and 3D GIS display(compatible with google earth • Friendly and intuitive web user interface • No running costs and upgrades easily as mobile access technology evolves • Built in compliance with ETSI TS 102 250-4&7/ ETSI EG 202 057-3 and ETSI EG 202 009-2

  22. Conclusion The assessment of the QoS/QoE is expected to be evaluated in checking criteria against reference values. These criteria are measured either objectively via technical means or subjectively via surveys amongst the users. Experts agree that a mix of objective(intrusive and non-intrusive) and subjective measurements remains the best means to get the whole QoS picture. Today, four out of five Regulators only employ Drive Test(intrusive) both for one-time snap shot, benchmarking and continuous QoS monitoring(reactive sense). Given DTs drawbacks and inaccuracy with respect to continuous QoS monitoring, its high-time Regulators, gaining from operators’ perspective, adopted the novel, practical and more efficient approach – the use of Network Management Systems (NMS) for proactive continuous QoS monitoring.

  23. Recommendations Regulators, as recommended in ETSI EG 202 009-1 clause 7, in the quest for effective continuous QoS monitoring and assessment should perform the measurements themselves and make the results available publicly rather than entrust in mobile operators to provide the QoS information Thus Regulators should procure RPM system or any other NMS that facilitates the complex task of enforcing mobile operators to adhere to agreed KPIs, put a check on service degradations /outright outages and even penalities for repeated failure to achieve minimum QoS/ QoE targets.

  24. THANK YOU FOR YOUR ATTENTION For more information on RPM system or any other NMS Feel free to contact me or email cblanchard@planetworkint.com

More Related