1 / 12

Network Informal Language &  Status Translation on Social network

Network Informal Language &  Status Translation on Social network. Aobo Wang. Introduction. What is NIL? Online Chat , BBS, ICQ, emails, Twittes and SMS Why NIL? Comprehension of customer dialogues. Information filtering Bridge language gaps among different online users. Agenda.

gus
Download Presentation

Network Informal Language &  Status Translation on Social network

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Network Informal Language & Status Translation on Social network Aobo Wang

  2. Introduction • What is NIL? • Online Chat , BBS, ICQ, emails, Twittes and SMS • Why NIL? • Comprehension of customer dialogues. • Information filtering • Bridge language gaps among different online users

  3. Agenda • State-of-the-fields on NIL • NIL Classification • Related Work on SMS • Conclusion • NIL Application • Translation • Crowdsoucing on Social network

  4. State-of-the-fields on NIL • NIL Classification (Both in English and Chinese) • Abbreviation • “ASAP” refers to “as soon as possible” • “PL” refers to “漂亮” means “beautiful” • Emotional Chart • :p :) ==!!! • Homophony • “88” refers to “byebye”

  5. State-of-the-fields on NIL • NIL Classification (English) • Deletion of Characters • “dont” refers to “do not”, “nxt” refers to “next” • Phonetic substitution • “4” refers to “for ” , “U” refers to “you” • Spelling error

  6. State-of-the-fields on NIL • NIL Classification (Chinese) • Similar Pronunciation • “ 稀饭 “refers to “喜欢 ” which means “like” • Transliteration • “粉丝” refers to “fans” • Dialectal substitution • “神马” refers to “ 什么” which means “what” • Homophony • “推” refers to “publish a comment through Twitter” • Illegal word • “囧” means “embarrassed” • Pseudo polyphone • “拽” means “arrogant” • Other cases…

  7. State-of-the-fields on NIL • Related Work on SMS (Latin languages) • Task : NIL terms Normalization

  8. State-of-the-fields on NIL • Related Work on SMS (Chinese) • Tasks • NIL terms recognition • NIL terms normalization

  9. State-of-the-fields on NIL • Conclusion • Statistical method performs better than Rule-based method . • Aligned parallel training data is very hard to obtain. • Chinese NIL terms are mostly created by phonetic transcription. • English NIL terms are mostly created by performing deletion and substitution to sub-string.

  10. NIL Application • Text –to – Speech • Text mining applications(filtering, routing ,IR) • Translation • Is normalization indispensable? • NIL terms have less ambiguity • Alignment between NIL terms and translation is stable • Collect parallel training data directly from source language to target language

  11. Crowdsoucing on Social network • Collect annotation from social network users • Collaborate translation • Status, comments • More than a task, less than a game • Translate • vote • Comment • Earn points , upgrade, rank and other incentive • Motivation • Self-motivated to learn a foreign language • Enjoy a “game” • Toy Demo

  12. Thank you!Any comments are welcome. Aobo Wang

More Related