200 likes | 357 Views
Quality of experience measurements. T echnologies and who knows what Jörgen Gustafsson Ericsson Research. Are the horizontal lines parallel?. Yes they are!. How much darker is square A than square B?. …. …. …. Not at all!. Subjective test. x 2 50. 5 excellent 4 good 3 fair 2 poor 1 bad.
E N D
Quality of experience measurements Technologies and who knows what Jörgen GustafssonEricsson Research
Subjective test x250 • 5 excellent4 good3 fair2 poor1 bad x 24 Mean Opinion Score
Capturing perception QoE models: MOS = f(x, y, z, …) Combining in a non-linear way Codec: signaling Audiovisual quality (MOS) Non-linear dependency between perceived quality and IP and application layer measurements
Parametric model P.1201 Parameterextraction c1 V-mos c2 video c3 IP headers … a/v-mos Audio-visual Stream info Buffering audio a-mos
QoE model Standardization • ITU-T Study Group 9 and 12 • Recently approved P.1201 and P.1202 recommendations for UDP based video • New work items for progressive download (YouTube) and adaptive streaming (DASH)
Measurement accuracy Accuracy of method Detailed comparison possible Ideal Good QoEestimation Real QoE Useful QoS Medium accuracy Not useful Action? Binary: Good or bad How close to real perception Modeling human perception Asking the manon the bus Transport layermeasurements
Media client reports Serviceprovider IP level measurement data CDN (Content Delivery Network) Ultimate QoE measurement data set IP and access network data ISP (Internet Service Provider) Quality of Experience! End user
Panel discussion • Is the quality of media services (in Sweden, today) good enough? • What QoE measurements are done today and what is missing? • What accuracy of the QoE measurements is desirable? • What are the reasons to share QoE measurement with other actors? • Who does a user call when there are quality problems? • What are the end-users willing to pay for in terms of quality? • What new business models can emerge using novel QoE measurement technologies?
Summary • Human perception is utterly complex… • …but we can handle that with QoE models • A lot of QoE measurement data is available • …but no one has access to all the data • Potential for new business models