1 / 20

Web-based Spoken English Training System with American Accent

Web-based Spoken English Training System with American Accent. Student: Shun-Pei Wang Advisor: Herng-Yow Chen Date: June 23th, 2008. Department of Computer Science and Information Engineering National Chi Nan University. Outline. Motivation Related Work System Architecture

belita
Download Presentation

Web-based Spoken English Training System with American Accent

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Web-based Spoken English Training System with American Accent Student: Shun-Pei Wang Advisor: Herng-Yow Chen Date: June 23th, 2008 Department of Computer Science and Information Engineering National Chi Nan University

  2. Outline • Motivation • Related Work • System Architecture • Demonstration • Conclusion

  3. Motivation • Training spoken English for nonnative. • Learning native’s pronouncing system: focus on American Accent. • Correcting Tool • Word: Correcting on Pronunciation. • Sentence: Annotating on Intonation.

  4. American Accent • Liaison (word connection) • “T” + “Y” = “CH”Don’tyou like it? • “D” + “Y” = “J”Wouldyou tell me? • “S” + “Y” = “SH”Yes, you are. • “Z” + “Y” = “ZH”Who doesyour hair? • Pronunciation (vowels and consonants) • Voiced vowels/consonants • Voiceless vowels/consonants • Intonation (modulation in tone)

  5. Related Work • My English Tutor (MyET) • Analyze and score student’s speech on pronunciation and pitch • Learners should have high motivation • Without teacher’s correction and without criterion of scoring

  6. System Architecture 6

  7. Speech-Text Alignment

  8. Dynamic Programming Algorithm

  9. DP Alignment Module

  10. Speech-Text Alignment

  11. Word-based Timestamp Prediction 0.12 0.22 1.22 1.43 1.64 2.65 0.21 0.21 0.11 0.1 0.4 Start time->0.12 End time->2.65

  12. System Architecture 12

  13. Autocorrelation Function (ACF)

  14. Stressed Word for Semantic Intonation Max = Maximum pitches of word DurS = duration time of student’s word DurT = duration time of teacher’s word Avg = Average pitches of word First Stress Second Stress

  15. Correcting Tool (1)

  16. Correcting Tool (2)

  17. Demonstration • Spoken English Training System http://163.22.21.55/Ben/prototype/listen.php

  18. Conclusion • Speech Analysis for student’s recording • Speech-text alignment • Pitch tracking and Stress word decision • Correcting Tool for teacher’s comment • Pronunciation, Liaison, Intonation • Recording function and annotation.

  19. Future Work • Accuracy of the alignment module • For Intonation information • Enhance correcting mechanism • Improve the correcting tool • Annotate the error on sentence directly • Friendly teaching atmosphere with VoIP

  20. Thank you !!!

More Related