230 likes | 389 Views
Equipment for Testing Mobile QoS. Joachim Pomy Consultant@joachimpomy.de OPTICOM, Germany. ITU Workshop on “Monitoring and Benchmarking of QoS and QoE of Multimedia Services in Mobile Networks” (Buenos Aires, Argentina, 24-25 July 2014). [Content].
E N D
Equipment for Testing Mobile QoS Joachim Pomy Consultant@joachimpomy.deOPTICOM, Germany ITU Workshop on “Monitoring and Benchmarkingof QoS and QoE of Multimedia Services in Mobile Networks” (Buenos Aires, Argentina, 24-25 July 2014) Buenos Aires - Argentina - 24 - 25 July 2014
[Content] ITRs: Setting the stage for a connected world Buenos Aires - Argentina - 24 - 25 July 2014 • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic
Measurement of QoS in Mobile • Measured from the perspective of an expert • Assessing the network to see if it delivers the quality that the network planner targeted (cf. Rec. ITU-T G.1000) • Tools and Methods for Operation and Maintenance • Protocol analysers are connected to BTSs, BSCs, and MSCs for a period of time to check for problems in the cellular network • Drive test (also walk tests) are used for monitoring operationally achieved QoS Buenos Aires - Argentina - 24 - 25 July 2014
Measurement of QoS in Mobile • Drive tests allow the mobile network to be tested through the use of a team of people who take the role of users • Rate the QoS of the network • Not applicable to the entire network • Always a statistical sample • In Operation and Maintenance Centres (OMCs), counters are used for various events • Providing the network operator with vendor specific information on the state and quality of the network • Also, customer complaints are a vital source of feedback on the QoS, and must not be ignored Buenos Aires - Argentina - 24 - 25 July 2014
End-to-end QoS Testing in Mobile • Minimum requirement for QoS measurement equipment to ensure that • for all QoS parameters • trigger points are well defined • values are determined following wqell defined procedures • Test-equipment fulfilling the specified minimum requirements • Will allow performing the proposed measurements • In a reliable and reproducible way Buenos Aires - Argentina - 24 - 25 July 2014
Parameters are based on Field Measurements • Measurements from customers point of view • Full End-to-End perspective, taking into account needs of testing • Assumed end customer can handle his equipment and services to use • Operability is not evaluated at this time • For the purpose of measurement it is assumed that • service is not barred for any reason • routing is defined correctly without errors • target subscriber equipment is ready to process service request • speech and video quality values measured • Only to be applied to calls ended successfully • In order to receive proper statistical analysis Buenos Aires - Argentina - 24 - 25 July 2014
Not yet any ITU Standards in Place • ETSI TS 102 250 part 4 • Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in GSM and 3G networks; Part 4: Requirements for Quality of Service measurement equipment • globally recognized as "the requirement" in the area • extremely compehensive • detailed instructions Buenos Aires - Argentina - 24 - 25 July 2014
[Content] ITRs: Setting the stage for a connected world Buenos Aires - Argentina - 24 - 25 July 2014 • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic
Test Scenarios • Test scenarios need to distinguish the following principal user cases • User-to-user services (typically telephony) • Store-and-forward services (e.g. SMS) • Information services (e.g. accessing the internet or FTP download) • Push services (sender initiated transfer) Buenos Aires - Argentina - 24 - 25 July 2014
[Content] ITRs: Setting the stage for a connected world Buenos Aires - Argentina - 24 - 25 July 2014 • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic
Considerations on trigger points • It can be assumed that • any feasible test equipment will contain some kind of communication terminal (UE) which may be a special type (e.g. a Trace Phone) • or a standard UE • Also, it can be assumed that each such device will provide information from different communication layers • from Application Layer (close to the user interface) • down to lower layers, e.g. operating-system events, TCP/IP layer, or Layer 3 signalling information, which is used as trigger points for QOS PARAMETERS processing • Typically AT commands can be used in majority of cases • Action is typically triggered • by some emulated user action • causing some action on the air interface Buenos Aires - Argentina - 24 - 25 July 2014
Considerations on trigger points • Process of event propagation is deterministic • allowing for kind of mapping between layers • associated with communication and processing delay in each stage. • Choice of the layer for trigger point information retrieval • determines the view expressed in a QOS PARAMETER • choosing lower-level events ( Layer 3) gives more network-centric view • events on higher levels to produce views more user-related • for same QoS PARAMETER source layer for events used as trigger points should be the same • In benchmarking, for all all networks under test • use same type of UE, and QOS PARAMETERS • use trigger points from the same layer. • Changing the source layer for a given trigger point • changes in QOS PARAMETERS should be expected • calibration measurements required • to assess influence on QOS PARAMETERS both quantitatively and qualitatively. Buenos Aires - Argentina - 24 - 25 July 2014
[Content] ITRs: Setting the stage for a connected world Buenos Aires - Argentina - 24 - 25 July 2014 • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic
Mobile QoS Test-equipment (MQT) • Geographical data collection during a mobile measurement • Position, speed and heading • Taken from GPS whenever possible. • If no GPS available use other tools • e.g. navigation on a geo-referenced bitmap Buenos Aires - Argentina - 24 - 25 July 2014
[Content] ITRs: Setting the stage for a connected world Buenos Aires - Argentina - 24 - 25 July 2014 • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic
Telephony Voice • Means to generate necessary calls or to answer automatically incoming calls • Received speech sample is measured • via the analogue output of the User Equipment • hardware setup to include necessary electrical adaptation • Hardware setup of such a system is essential for the correctness of the measured QoS Parameters • Includes a UE specific part for the electrical adaptation • audio output of handset to input of the soundcard Buenos Aires - Argentina - 24 - 25 July 2014
Video Telephony • Means to generate necessary calls or to answer automatically incoming calls • Capability to provide the following measurement methods. • Video Telephony using the User Equipments application; or • Video Telephony using a Video Telephony Stack on the PC. Buenos Aires - Argentina - 24 - 25 July 2014
MQT for FTP • FTP client to support the following functions: • Active / Passive Mode • Common Firewall support • Downloading from subdirectories. • Uploading to subdirectories Buenos Aires - Argentina - 24 - 25 July 2014
Mobile based measurement equipment • Functionalities of the MQT can also be realised on a single mobile phone • Different types of QoS tests can run • Test results can be logged for post processing • Mobile based measurement equipment may be controlled • by an application, remotely or • may be operated by a human Buenos Aires - Argentina - 24 - 25 July 2014
[Content] ITRs: Setting the stage for a connected world Buenos Aires - Argentina - 24 - 25 July 2014 • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic
Practical Hints • Which Mobile Phone to use ? • should be one offered in the shop ? • should be one used by new customers ? • should be one hipe to young people ? • should be one with good QoS ? • BUT • it MUST be a so-called Trace Mobile • ASK YOUR PHONE PROVIDER !!! • they are RARE !!!! Buenos Aires - Argentina - 24 - 25 July 2014
[Content] ITRs: Setting the stage for a connected world Buenos Aires - Argentina - 24 - 25 July 2014 • Equipment for Testing Mobile QoS • Measurements • Test Scenarios • Trigger Points • Test Equipment • Testing for various Services • Practical Hints • POLQA - Voice Quality - Hot Topic
Any questions ? Contact:Consultant@joachimpomy.de Buenos Aires - Argentina - 24 - 25 July 2014