Machine Translation for Microblogs

From HLT@INESC-ID

Revision as of 09:20, 14 January 2016 by Imt (talk | contribs) (→‎Publications)
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

Sponsored by: FCT (CMUP-EPB/TIC/0026/2013)
Start: January 2015
End: December 2015

INESC-ID Team

PI: Isabel Trancoso

UNBABEL TEAM

Carnegie Mellon University Team

Summary

The MT4M project develops machine translation systems for content in microblogs, such as Twitter. This domain is characterized by creative use of language, dialectal lexemes, and informal register, which challenge traditional systems. Our earlier work towards this goal explored the fact that parallel data may be found in microblogs, in order to build a normalization model. In our recent work deals with the lexical sparsity that characterizes this domain by proposing character-based word representation models that explore orthographic properties of the language. The advantages of the model go far beyond the machine translation task, generalizing to several other NLP tasks.

Publications

Wang Ling, Guang Xiang, Chris Dyer, Alan Black, Isabel Trancoso, Microblogs as Parallel Corpora, In The 51th Annual Meeting of the Association for Computational Linguistics (ACL), ACL, Sofia, Bulgaria, August 2013

Wang Ling, Chris Dyer, Alan Black, Isabel Trancoso, Paraphrasing 4 Microblog Normalization, In 2013 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, ACL, Seattle, Washington, USA, October 2013

Wang Ling, Chris Dyer, Alan Black, Isabel Trancoso, Two/Too Simple Adaptations of Word2Vec for Syntax Problems, In 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, ACL, Denver, USA, June 2015

Wang Ling, Tiago Luís, Luís Marujo, Ramon Fernandez Astudillo, Sílvio Moreira, Chris Dyer, Alan Black, Isabel Trancoso, Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation, In 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP 2015), ACL, Lisbon, Portugal, September 2015

Wang Ling, Lin Chu-Cheng, Yulia Tsvetkov, Sílvio Moreira, Ramon Fernandez Astudillo, Chris Dyer, Alan Black, Isabel Trancoso, Not All Contexts Are Created Equal: Better Word Representations with Variable Attention, In 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP 2015), ACL, Lisbon, Portugal, September 2015

Cooperation with DATASTORM Project:

Sílvio Moreira, Ramon Fernandez Astudillo, Wang Ling, Bruno Martins, Mário J. Silva, Isabel Trancoso, INESC-ID: A Regression Model for Twitter Sentiment Lexicon Induction, In International Workshop on Semantic Evaluation (SemEval), June 2015

Ramon Fernandez Astudillo, Sílvio Moreira, Wang Ling, Mário J. Silva, Isabel Trancoso, Learning Word Representations From Scarce and Noisy Data With Embedding Subspaces, In ACL-IJCNLP, Code: https://github.com/ramon-astudillo/NLSE, July 2015