140 likes | 326 Views
LDMT MURI Data Collection and Linguistic Annotation. November 2, 2012 Jason Baldridge, UT Austin Lori Levin, CMU. Purpose. Collect and build data Monolingual text Bilingual text Linguistic annotations to support work on machine translation for Kinyarwanda-English Malagasy-English.
E N D
LDMT MURIData Collection and Linguistic Annotation November 2, 2012 Jason Baldridge, UT Austin Lori Levin, CMU
Purpose Collect and build data • Monolingual text • Bilingual text • Linguistic annotations to support work on machine translation for • Kinyarwanda-English • Malagasy-English
Kinyarwanda Data Resources word counts ENG treebank ENG text KIN text KIN treebank ENGLISH monolingual (huge) PTB (1m) GWord (8b) KGMC (270k) KGMC (225k) KGMC (2.9k) KGMC (3.8k) KGMC (5.8k) KGMC (4.8k) BILINGUAL (285k) Dict (9k) Dict (8k) Pbook (0.9k) Pbook (0.7k) BBC (0.3k) BBC (0.3k) BBC (0.3k) BBC (0.3k) IGT (0.1k) IGT (0.1k) IGT (0.06k) IGT (0.06k) KINYARWANDA monolingual (7m) 1.0 Release 02/11 2.0 Release 10/11 News (7m)
Kinyarwanda Data Resources word counts ENG treebank ENG text KIN text KIN treebank ENGLISH monolingual (huge) PTB (1m) GWord (8b) KGMC (270k) KGMC (225k) KGMC (2.9k) Part-of-speech (2k) GFL (4.7k) KGMC (3.8k) KGMC (5.8k) KGMC (4.8k) BILINGUAL (285k) Dict (9k) Dict (8k) Reviewed & improved Reviewed & improved Pbook (0.9k) Pbook (0.7k) BBC (0.3k) BBC (0.3k) BBC (0.3k) BBC (0.3k) IGT (0.1k) IGT (0.1k) IGT (0.06k) IGT (0.06k) KINYARWANDA monolingual (7m) 1.0 Release 02/11 2.0 Release 10/11 3.0 Release 11/12 News (7m)
Malagasy Data Resources ENG treebank ENG text MLG text MLG treebank ENGLISH monolingual (huge) PTB (1m) Gword (8b) News (2.3k) Bible (730k) Bible (725k) BILINGUAL (732k) News (2.1k) News (2.1k) News (2.3k) MALAGASY Monolingual 1.0 Release 02/11 2.0 Release 10/11
Malagasy Data Resources ENG treebank ENG text MLG text MLG treebank ENGLISH monolingual (huge) PTB (1m) Gword (8b) News (2.3k) Reviewed & improved. Part-of-speech (2k) Bible (730k) Bible (725k) BILINGUAL (732k) News (2.1k) Reviewed & improved. News (2.1k) News (2.3k) Dictionary (77.5k) Global voices (1.8m) Global voices (1.9m) Global voices GFL (3.7k) MALAGASY Monolingual Leipzig (600k) 1.0 Release 02/11 2.0 Release 10/11 3.0 Release 11/12
Malagasy Data Resources • Year 1: 19th century Malagasy bible • Year 2: • Univ. of Leipzig Web Corpus • Monolingual Malagasy, very clean • CMU Global Voices Archive
Malagasy Resources Malagasy - English Resources
CMU Global Voices Corpus • Domains include Twitter, blogs, news about popular democracy movements • Actively published by volunteer translators • We are gathering ~ 500k words / language / year of high quality parallel data http://www.ark.cs.cmu.edu/global-voices/
Morphological analysis • We decided against creating morphological gold-standard annotations from the output of finite state transducers. • Initially tried to use XFST analyzer created by Dalrymple, Liakata and Mackie 2006. • Quality of the output of Dalrymple transducer was poor (ambiguous, many incorrect). • No existing Kinyarwanda transducer • Any annotations would be subject to changing analyses during transducer development.
Morphological analysis • Developed new transducers for both Kinyarwanda and Malagasy. • Less ambiguity • Cautious guessing for unknown stems => better precision • Improvements driven by measuring ambiguity/coverage on data and effect on performance in other tasks. • We may produce annotations after transducer development deemed sufficient.
Syntactic annotations • During past year, we reviewed and revised phrase structures annotated for kin and mlg texts. • Analyses and labels made more consistent across languages • Head annotations added to enable dependency parsing training/evaluation. • All tokenization standardized. • GFL annotations: 4k each tokens, kin and mlg
Data accomplishments • Fieldwork on Kinyarwanda that informs theoretical linguistic work and transducers. • New morphological transducers for kin and mlg. • V 3.0 of monolingual, bilingual, and tree-banked data for Kinyarwanda and Malagasy to be released this coming week. • Order of magnitude parallel data (mlg) • Better & more syntactic data (kin/mlg)
Data accomplishments • Evaluation • Pilot annotations for linguistically target test suites • Formal linguistic advances • GFL specification and tools for annotation and visualization • Abstract Meaning Representation (AMR): leverage ideas, data and tools from ISI as part of other synergistic projects.