ITU-T Study Group 12: Structures and Guide for University Participants

1. ITU-T Study Group 12: Structures andGuide for University Participants Sebastian Möller(with the support from Jean-Yves Monfort, ITU-T SG12 Chairman) Quality and Usability Lab, Deutsche Telekom Laboratories TU Berlin, Germany sebastian.moeller@telekom.de

2. Overview • Structure of ITU-T Study Group 12 • General structure of the ITU-T • Study Group 12 • Documents, etc. • Quality assessment and prediction for voice services

3. Plenipotentiary Conference ITU Council General Secretariat ITU-R World Radiocommunication Conference ITU-D World Telecommunication Development Conference ITU-T World Telecommunication Standardization Assembly Structure of ITU-T Study Group 12General structure of the ITU-T. • General Secretariat: Coordinates the Union's activities and the overall management of the Union • ITU-T: Telecommunication standardization on a world-wide basis on technical, operating and tariff Questions • ITU-R: Radio communications and wireless • ITU-D: Use and deployment of telecom networks and services in the developing nations

4. Structure of ITU-T Study Group 12Structure of ITU-T Study Groups and Working Parties. STUDY GROUP XX

5. Structure of ITU-T Study Group 12Structure of ITU-T Study Groups and Working Parties. • Workshops / Seminars: • Cover the most important topics in modern telecommunication technology and applications. • Speakers are renowned telecommunication experts. • Usually free of charge and open to public . • To come : From Speech to Audio: Bandwidth Extension, Binaural Perception, see http://www.itu.int/ITU-T/studygroups/com12/index.asp. • Focus Groups: • Participation of non-member experts welcome. • Work on a well-defined topic and time-schedule for completion. • e.g. : IPTV Focus Group in which SG12 is involved • Under SG12 : Focus Group From/In/ToCarCommunication, see http://www.itu.int/ITU-T/studygroups/com12/fgfit/index.html • Joint Coordination Groups: • Coordinate a broad study by more than one study group. They do not perform technical studies nor write Recommendations.

6. Structure of ITU-T Study Group 12Study Group 12 mandate. Responsible for Recommendations on the end-to-end transmission performanceof terminals and networks, in relation to the perceived quality and acceptance by users of text, data, speech, and multi-media applications. Although this work includes the related transmission implications of all networks and all telecommunication terminals, a special focus is given to IP QoS, interoperability and implications for NGN, and also includes work on performance and resource management.

7. Telephonometry, terminals and subjective assessment Co-Chairs : C. Quinquis, G. Lecucq Structure of ITU-T Study Group 12Management team and structure. SG 12 – Performance and QoS Chairman Mr Jean-Yves Monfort Bridging the gap for developping countries Mr J.J. Massima-Landji, VC QoS Coordination Mr C. Dvorak, VC WP 1 TSB Support Mrs J. Katona Kiss, Councellor Mrs S. Scott, Secretary WP 2 Performance, planning and tools Mr Klemens Adler, SG 12 Vice Chair WP 3 IP-related QoS and resource management M. Paul Coverdale, SG 12 Vice Chair

8. Structure of ITU-T Study Group 12SG12 structure and questions. SG 12 – Questions 1/12 and 15/12 Workprogram, definitions, handbooks, guides, tutorials, Bridging the Standardization Gaps Mr JY Monfort, Mr J. Pomy, Mr J.J. Massima-Landji Q.1/12 QoS and performance coordination Mr C. Dvorak Q.15/12

9. Hands-free communications in vehicles Mr H.W. Gierlich, Mr M. Rung Structure of ITU-T Study Group 12SG12 structure and questions. WP /12 – Telephonometry, terminals and Subjective assessment Co Acting Chairs C. Quinquis, G. Lecucq Speech transmission characteristics of speech terminals … Mr Shi Denian Q.3/12 Q.4/12 Telephonometrics methodologies for handsets and headset terminals Mr L. Madec Q.5/12 Analysis methods using complex measurement signals…. Mr H.W. Gierlich Q.6/12 Q.7/12 Methods, tools and test plans for the subjective assessment…Mr P. Usai and Mrs C. Quinquis

10. Perceptual-based objective methods for voice, audio and visual quality…Mr J. Berger Structure of ITU-T Study Group 12SG12 structure and questions. WP 2/12 – Performance, Planning and Tools Chairman Mr Klemens Adler Extension of the E-model Mrs U. Jekosch and Mr S. Möller Q.8/12 Q.9/12 Transmission planning and performance considerations… Mr V. Sypli Q.10/12 Performance evaluation of services based on speech technologyMr S.Möller&MrA. Raake Q.12/12 In-service non intrusive assessment of voice transmission performance Mr V. Barriac Q.14/12 Q.20/12 Objective assessment of conversational speech quality in networks Mr J. Pomy

11. IP based multimedia services end to end transm. planning …. M. J. Pomy Speech transmission charact. & meas. methods for IP terminals and gatewaysMr U. Brunner Structure of ITU-T Study Group 12SG12 structure and questions. WP 3/12 – IP-Related QoS andRessource managementChairman Mr Paul Coverdale(also involved in Questions* 13/12 and 19/12) Q.2/12 Q.11/12 Q.13/12 IPTV and multimedia QoE/QoS performance requ. and assessment methods A. Takahashi Q.16/12 Broadband and IP-related resource managementMr D. Mustill Q.17/12 Performance of IP-based networks Mr A. Morton and Mr H. Kim Call processing performance Q.19/12

12. QoS Development Group Mr D. Mustill ElectroacousticsMr L. Madec, Mr H.Gerlich Joint Rapporteur Group "Multimedia quality assessment"Mr P. Juric Structure of ITU-T Study Group 12SG12 structure and questions. SG 12 Liaison Officers JRG MMQA IEC 29 IEEE Electroacoustics Mr A. Woo QSDG Communication Mr C. Dvorak,EWM Mr J. Pomy, Bridging the standardization Gaps Mr J.J. Massima-Landji TSAG Security, OAM, ICG-SAT Mr JY Monfort, FGNGN Mr C.Dvorak, FGNGNMr P. Coverdale ITU-D Mr J.J. Massima Others Flagship Group QoS Mr D. Waturu

13. Structure of ITU-T Study Group 12Questions, Rapporteurs and Editors. Questions: • Set up by the WTSA or by the Study Group. • Define a particular subject to be studied. Rapporteurs: • Appointed by the SG or a WP to each Question. • Ensure progress of the group of experts towards Recommendations. • Lead, moderate debates (e-mails, conf. Calls, etc.) and coordinate progress. • Chair the meetings of the experts (Rapporteurs Group Meetings). Editors: • Appointed by Rapporteurs, prepare and follow-up draft Recommendations.

14. Structure of ITU-T Study Group 12Approval of Recommendations. • Alternative Approval Process (AAP): • For technical Recommendations • Once the text is considered to be mature, it is submitted for AAP at an SG or WP meeting (Rec. A.8) • Traditional Approval Process (TAP): • For Recommendations subject to policy or regulatory implications • Initiated at an SG or WP meeting and completed, for final approval, at the subsequent SG meeting (Res. 1)

15. Structure of ITU-T Study Group 12AAP Sequence. Approved LC 4 weeks (a) 3 weeks Approved 4 (b) Director's SG SG or Edited Director's (c) Meeting text announcement WP announcement (7) and posting and posting ( 6 ) meeting for LC AR for LC Comment ( 1 ) ( 2 ) (5) (a) (b) 3 weeks resolution ( 3 ) Approved 9 11 (b) (a) Edited Director's Director's notification announcement text for AR and publication and posting LC: Last Call for AR (8) (see Rec. A.11) ( 10 ) ( 12 ) AR: Additional Review TG120480-00 See Figure 1 (Rec. A.8)

16. Structure of ITU-T Study Group 12Meeting documentation. • Contributions (C): • To be submitted at least 10 calendar days before the meeting. • Reports (R): • Official records of SG or WP meetings. To be available shortly after the closure of the meetings (Rec. A.1). • Temporary Documents (TDs): • Submitted by an ‘official’ (a member of the SG Management Team, Rapporteur, Editor, etc.) within the meeting participants. Working Documents (WDs): • Issued during meetings by small groups.

17. Structure of ITU-T Study Group 12Further information. Visit www.itu.int/ITU-T/studygroups/com12/index.aspfor more information.

18. Overview • Structure of ITU-T Study Group 12 • Quality assessment and prediction for voice services • Quality assessment and prediction • Taxonomy of prediction models • E-model for NB and WB networks

19. Motivation, Goals Linguist. Backgr. Experi- ence Attitude Emotions User Factors Subjective Quality Judgment Transmission System System Parameters Estimated Quality Index Model Quality Assessment and PredictionVoice services. • Our focus: Methods for assessing narrow-band and wideband speech, but also video quality

20. Quality of Service Speech Communication Factors Service Factors Contextual Factors Voice Transmission Quality Ease of Communication Conversation Effectiveness Communication Efficiency Service Efficiency Economical Benefit User Factors Usability User Satisfaction Utility Acceptability Quality Assessment and PredictionQuality aspects of transmitted speech. Quality: Result of judgment of the perceived composition of an entity with respect to its desired composition. (Jekosch, 2005) • Quality of Service(Rec. E.800) • Quality of Experience Quality of Experience (Möller, 2000)

21. Quality Assessment and Prediction Taxonomy of prediction models. Input information: • Signals • one or two signals • acoustic or electric • Parameters • Protocol information Measurement of input information: • Online • Offline • Estimation Output information: • Listening-only • integral quality • quality features • Conversational • Talking-only Application area: • Planning • Set-up and optimization • Monitoring Network type: • Narrow-band • Wideband

22. Output Information Quality Assessment and Prediction Taxonomy of prediction models: Narrow-band case. • Input Information

23. Output Information Quality Assessment and Prediction Taxonomy of prediction models: Wideband case. • Input Information

24. IP WAN Quality Assessment and Prediction E-model for narrow-band networks. Linear distortion, delay Backgr.noise,acoustic coupling Codec Jitterbuffer, VAD Packetloss Talker echo, listener echo Circuit noise Backgr.noise,acoustic coupling

25. SLR, RLR, Ta IP WAN Ps, Ds, STMR Ie, qdu Bpl Ppl TELR, T, WEPL, Tr Nc, Nfor Pr, Dr, LSTR Quality Assessment and Prediction E-model for narrow-band networks. Impairments SNR simultaneous delayed nonlin./timevar. Overall quality R = Ro - Is - Id - Ie,eff Estimated user judgment MOS = f (R )

26. Quality Assessment and Prediction E-model extension for wideband networks. Ro,max = 129 (Raake, 2006; Appendix II, ITU-T Rec. G.107, 2006)

27. Quality Assessment and Prediction E-model extension for wideband networks. Ro,max = 129 AMR-WB (23.05) AMR-WB (6.6) (Raake, 2006; Möller et al., 2006)

28. Thanks to Jean-Yves Monfort (ITU-T SG12 Chairman) for providing the description of Study Group 12.Thank you for your attention.Visit www.qu.tlabs.tu-berlin.de for more information.