1 / 28

Equipment for Testing Mobile QoS

ITU Workshop on “Workshop on Practical measurement of QoS/QoE Parameters for Regulatory Compliance” (Cotonou, Benin, 16-17 July 2012). Equipment for Testing Mobile QoS. Joachim Pomy, SG 12 Rapporteur Consultant, Opticom GmbH Consultant@joachimpomy.de. [Content].

oren
Download Presentation

Equipment for Testing Mobile QoS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ITU Workshop on “Workshop on Practical measurement of QoS/QoE Parameters for Regulatory Compliance”(Cotonou, Benin, 16-17 July 2012) Equipment for Testing Mobile QoS Joachim Pomy, SG 12 Rapporteur Consultant, Opticom GmbH Consultant@joachimpomy.de

  2. [Content] ITRs: Setting the stage for a connected world • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic

  3. Measurement of QoS in Mobile Measured from the perspective of an expert Assessing the network to see if it delivers the quality that the network planner targeted (cf. Rec. ITU-T G.1000) Tools and Methods for Operation and Maintenance Protocol analysers are connected to BTSs, BSCs, and MSCs for a period of time to check for problems in the cellular network Drive test (also walk tests) are used for monitoring operationally achieved QoS

  4. Measurement of QoS in Mobile Drive tests allow the mobile network to be tested through the use of a team of people who take the role of users Rate the QoS of the network Not applicable to the entire network Always a statistical sample In Operation and Maintenance Centres (OMCs), counters are used for various events Providing the network operator with vendor specific information on the state and quality of the network Also, customer complaints are a vital source of feedback on the QoS, and must not be ignored

  5. End-to-end QoS Testing in Mobile Minimum requirement for QoS measurement equipment to ensure that for all QoS parameters trigger points are well defined values are determined following wqell defined procedures Test-equipment fulfilling the specified minimum requirements Will allow performing the proposed measurements In a reliable and reproducible way

  6. Parameters are based on Field Measurements Measurements from customers point of view Full End-to-End perspective, taking into account needs of testing Assumed end customer can handle his equipment and services to use Operability is not evaluated at this time For the purpose of measurement it is assumed that service is not barred for any reason routing is defined correctly without errors target subscriber equipment is ready to process service request speech and video quality values measured Only to be applied to calls ended successfully In order to receive proper statistical analysis

  7. Not yet any ITU Standards in Place ETSI TS 102 250 part 4 Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in GSM and 3G networks; Part 4: Requirements for Quality of Service measurement equipment globally recognized as "the requirement" in the area extremely compehensive detailed instructions

  8. [Content] ITRs: Setting the stage for a connected world • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic

  9. Test Scenarios Test scenarios need to distinguish the following principal user cases User-to-user services (typically telephony) Store-and-forward services (e.g. SMS) Information services (e.g. accessing the internet or FTP download) Push services (sender initiated transfer)

  10. [Content] ITRs: Setting the stage for a connected world • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic

  11. Considerations on trigger points It can be assumed that any feasible test equipment will contain some kind of communication terminal (UE) which may be a special type (e.g. a Trace Phone) or a standard UE Also, it can be assumed that each such device will provide information from different communication layers from Application Layer (close to the user interface) down to lower layers, e.g. operating-system events, TCP/IP layer, or Layer 3 signalling information, which is used as trigger points for QOS PARAMETERS processing Typically AT commands can be used in majority of cases Action is typically triggered by some emulated user action causing some action on the air interface

  12. Considerations on trigger points Process of event propagation is deterministic allowing for kind of mapping between layers associated with communication and processing delay in each stage. Choice of the layer for trigger point information retrieval determines the view expressed in a QOS PARAMETER choosing lower-level events ( Layer 3) gives more network-centric view events on higher levels to produce views more user-related for same QoS PARAMETER source layer for events used as trigger points should be the same In benchmarking, for all all networks under test use same type of UE, and QOS PARAMETERS use trigger points from the same layer. Changing the source layer for a given trigger point changes in QOS PARAMETERS should be expected calibration measurements required to assess influence on QOS PARAMETERS both quantitatively and qualitatively.

  13. [Content] ITRs: Setting the stage for a connected world • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic

  14. Mobile QoS Test-equipment (MQT) Geographical data collection during a mobile measurement Position, speed and heading Taken from GPS whenever possible. If no GPS available use other tools e.g. navigation on a geo-referenced bitmap

  15. [Content] ITRs: Setting the stage for a connected world • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic

  16. Telephony Voice Means to generate necessary calls or to answer automatically incoming calls Received speech sample is measured via the analogue output of the User Equipment hardware setup to include necessary electrical adaptation Hardware setup of such a system is essential for the correctness of the measured QoS Parameters Includes a UE specific part for the electrical adaptation audio output of handset to input of the soundcard

  17. Video Telephony Means to generate necessary calls or to answer automatically incoming calls Capability to provide the following measurement methods. Video Telephony using the User Equipments application; or Video Telephony using a Video Telephony Stack on the PC.

  18. MQT for FTP FTP client to support the following functions: Active / Passive Mode Common Firewall support Downloading from subdirectories. Uploading to subdirectories

  19. Mobile based measurement equipment Functionalities of the MQT can also be realised on a single mobile phone Different types of QoS tests can run Test results can be logged for post processing Mobile based measurement equipment may be controlled by an application, remotely or may be operated by a human

  20. [Content] ITRs: Setting the stage for a connected world • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic

  21. Practical Hints Which Mobile Phone to use ? should be one offered in the shop ? should be one used by new customers ? should be one hipe to young people ? should be one with good QoS ? BUT it MUST be a so-called Trace Mobile ASK YOUR PHONE PROVIDER !!! they are RARE !!!!

  22. [Content] ITRs: Setting the stage for a connected world • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic

  23. Hot Topic:POLQA™ - Rec. P.863

  24. POLQA Introduction - (c) OPTICOM GmbH 2010 30

  25. What we Perceive … In a subjective ACR experimentPOLQA, PESQ and human beings perceive the following distortions: POLQA Introduction - (c) OPTICOM GmbH 2010 31

  26. Performance Validation • The ITU has validated POLQA on: • Languages included in the POLQA validation: • 47000 file pairs across • 64 subjective experiments • German • Swiss German • Italian, • Japanese, • Swedish • American English and British English • Chinese (Mandarin), • Czech, • Dutch, • French, POLQA Introduction - (c) OPTICOM GmbH 2010 32

  27. Any questions ? Contact:Consultant@joachimpomy.de

More Related