1 / 8

Slovak synthesis speech quality evaluation

Slovak synthesis speech quality evaluation. Red žúr [r E dZ u: r] 2008. Jakub Mareček. Testing methods. Subjective test - respondents listen on web application http://www.ktl.elf.stuba.sk/projects/speech/quality_test to speech synthesis samples and evaluate them in these types of tests:

mac
Download Presentation

Slovak synthesis speech quality evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Slovak synthesis speech quality evaluation Redžúr [r E dZ u: r] 2008 • Jakub Mareček

  2. Testing methods • Subjective test - respondents listen on web application http://www.ktl.elf.stuba.sk/projects/speech/quality_test to speech synthesis samples and evaluate them in these types of tests: • MOS - how listeners perceive tested material on available scale (comprehension, speech tempo, articulation etc.) • MRT - (modified rhyme test) testing comprehension of material based on monosyllabic consonant-vowel-consonant words • Objective test - PESQ – prediction of the perceived quality that would be given to degraded signal by subject in subjective listening test. Primary developed for VOIP (ITU-T P862). • Scale from -0.5 (worst) to 4.5 (best).

  3. Subjective test use-case diagram

  4. MOS web-based test

  5. MRT web-based test

  6. Test result page

  7. Conclusion • Subjective methods are most important for overall evaluation of artificial speech. • New types of subjective tests (MRT, SUS) derived from other languages (German, English etc.) • Web application as best solution for subjective quality evaluation. Feel free to visit http://www.ktl.elf.stuba.sk/projects/speech/quality_test/. • Objective methods like PESQ has still weak correlation with subjective tests.

More Related