Ricardo Rei
From HLT@INESC-ID
Ricardo ReiINESC-ID
Machine Translation Evaluation, Machine Translation, Natural Language ProcessingMachine Translation Evaluation, Machine Translation, Natural Language Processing
Total Publications: 28
Article (Author)
- xcomet: Transparent Machine Translation Evaluation through Fine-grained Error Detection
Nuno Guerreiro, Ricardo Rei, Dan Daan van Stigt, Luísa Coheur, Pierre Colombo, André F. T. Martins,
Transactions of the Association for Computational Linguistics, vol. 12, pages 979–995, DOI 10.1162/tacl_a_00683, January 2024 - Towards better subtitles: A multilingual approach for punctuation restoration of speech transcripts
Nuno M Guerreiro, Ricardo Rei, Fernando Batista,
Expert Systems with Applications, vol. 186, pages 115740, DOI https://doi.org/10.1016/j.eswa.2021.115740, December 2021
In Proceedings (Author)
- Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning
Duarte M. Alves, Nuno Miguel Guerreiro, Ricardo Rei, José G. C. de Souza, André F. T. Martins,
Findings of the Association for Computational Linguistics: EMNLP 2023, Association for Computational Linguistics, pages 11127–11148, December 2023 - Findings of the WMT 2023 shared task on quality estimation
Frederic Blain, Chrysoula Zerva, Ricardo Rei, Nuno Miguel Guerreiro, Diptesh Kanojia, José G. C. de Souza, André F. T. Martins,
Proceedings of the Eighth Conference on Machine Translation, pages 629–653, December 2023 - Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent
Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Tom Kocmi, Frederic Blain, Craig Stewart, Chrysoula Zerva, Alon Lavie, George Foster,
Proceedings of the Eighth Conference on Machine Translation, Association for Computational Linguistics, pages 578–628, December 2023 - Scaling up CometKiwi: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task
Ricardo Rei, Nuno M Guerreiro, João Pombal, Daan van Stigt, Marcos Treviso, Luísa Coheur, José G. C. de Souza, André Martins,
Proceedings of the Eighth Conference on Machine Translation, Association for Computational Linguistics, pages 841–848, January 2023 - The Inside Story: Towards Better Understanding of Machine Translation Neural Evaluation Metrics
Ricardo Rei, Nuno M Guerreiro, Marcos Treviso, Luísa Coheur, Alon Lavie, André Martins,
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Association for Computational Linguistics, vol. 2, pages 1089–1105, January 2023 - Findings of the WMT 2022 Shared Task on Quality Estimation
Chrysoula Zerva, Frederic Blain, Ricardo Rei, Piyawat Lertvittayakumjorn, José G. C. de Souza, Steffen Eger, Diptesh Kanojia, Duarte M. Alves, Constantin Orăsan, Marina Fomicheva, André Martins, Lucia Specia,
Seventh Conference on Machine Translation (WMT), Association for Computational Linguistics, pages 69–99, Association for Computational Linguistics, Abu Dhabi, United Arab Emirates (Hybrid), December 2022 - CometKiwi: IST-Unbabel 2022 Submission For The Quality Estimation Shared Task
Ricardo Rei, Marcos Treviso, Nuno M. Guerreiro, Chrysoula Zerva, Ana C. Farinha, Christine Maroti, José G. C. de Souza, Taisiya Glushkova, Duarte M. Alves, Alon Lavie, Luísa Coheur, André F. T. Martins,
Seventh Conference on Machine Translation (WMT), Proceedings of the Seventh Conference on Machine Translation (WMT), Association for Computational Linguistics, pages 634-645, Association for Computational Linguistics, Abu Dhabi, United Arab Emirates (Hybrid), December 2022 - Disentangling Uncertainty in Machine Translation Evaluation
Chrysoula Zerva, Taisiya Glushkova, Ricardo Rei, André Martins,
Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, pages 8622–8641, Association for Computational Linguistics, Abu Dhabi, United Arab Emirates, December 2022 - Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More Robust
Markus Feitag, Ricardo Rei, George Foster, Nitika Mathur, Chi-kiu Lo, Craig Stewart, Eleftherios Avramidis, Tom Kocmi, Alon Lavie, André Martins,
Seventh Conference on Machine Translation (WMT), Association for Computational Linguistics, pages 46–68, Association for Computational Linguistics, Abu Dhabi, United Arab Emirates (Hybrid), December 2022 - COMET-22: Unbabel-IST 2022 Submission for the Metrics Shared Task
Ricardo Rei, José G. C. de Souza, Duarte M. Alves, Chrysoula Zerva, Ana C Farinha, Taisiya Glushkova, Alon Lavie, Luísa Coheur, André Martins,
Seventh Conference on Machine Translation (WMT), Association for Computational Linguistics, pages 578–585, Association for Computational Linguistics, Abu Dhabi, United Arab Emirates (Hybrid), December 2022 - Robust MT evaluation with Sentence-level Multilingual Augmentation
Duarte M. Alves, Ricardo Rei, Ana C. Farinha, José G. C. de Souza, André Martins,
Seventh Conference on Machine Translation (WMT), Association for Computational Linguistics, pages 469–478, Association for Computational Linguistics, Abu Dhabi, United Arab Emirates (Hybrid), December 2022 - Towards a Sentiment-Aware Conversational Agent
Isabel de Lima Henriques Dias, Ricardo Rei, Patrícia Pereira, Luísa Coheur,
ACM International Conference on Intelligent Virtual Agents (IVA), September 2022 - Quality-Aware Decoding for Neural Machine Translation
António Farinhas, Patrick Fernandes, Ricardo Rei, José G. C. de Souza, Perez Ogayo, Graham Neubig, André Martins,
Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics, pages 1396–1412, Association for Computational Linguistics, Seattle, United States, July 2022 - QUARTZ: Quality-Aware Machine Translation
José Souza, Ricardo Rei, Catarina Farinha, Helena Moniz, André Martins,
Annual Conference of the European Association for Machine Translation, European Association for Machine Translation, pages 315–316, European Association for Machine Translation, Ghent, Belgium, June 2022 - Searching for COMETINHO: The Little Metric That Could
Ricardo Rei, Ana C Farinha, José G. C. de Souza, Pedro Ramos, André F. T. Martins, Luísa Coheur, Alon Lavie,
Annual Conference of the European Association for Machine Translation, European Association for Machine Translation, pages 61–70, European Association for Machine Translation, Ghent, Belgium, June 2022 - Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain
Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, George Foster, Alon Lavie, Ondřej Bojar,
Proceedings of the Sixth Conference on Machine Translation, Association for Computational Linguistics, Association for Computational Linguistics, Punta Cana, Dominican Republic, November 2021 - IST-Unbabel 2021 submission for the quality estimation shared task
Chrysoula Zerva, Daan van Stigt, Ricardo Rei, Ana C Farinha, Pedro Ramos, José G. C. de Souza, Taisiya Glushkova, Miguel Vera, Fabio Kepler, André F. T. Martins,
Proceedings of the Sixth Conference on Machine Translation, Association for Computational Linguistics, Association for Computational Linguistics, Punta Cana, Dominican Republic, November 2021 - Uncertainty-Aware Machine Translation Evaluation
Taisiya Glushkova, Chrysoula Zerva, Ricardo Rei, André F. T. Martins,
Findings of the Association for Computational Linguistics: EMNLP 2021, Association for Computational Linguistics, pages 3920–3938, Association for Computational Linguistics, Punta Cana, Dominican Republic, November 2021 - Are References Really Needed? Unbabel-IST 2021 Submission for the Metrics Shared Task
Ricardo Rei, Ana C Farinha, Chrysoula Zerva, Daan van Stigt, Craig Stewart, Pedro Ramos, Taisiya Glushkova, André F. T. Martins, Alon Lavie,
Proceedings of the Sixth Conference on Machine Translation, Association for Computational Linguistics, Association for Computational Linguistics, Punta Cana, Dominican Republic, November 2021 - IST-Unbabel 2021 submission for the explainable quality estimation shared task
Marcos Treviso, Nuno M. Guerreiro, Ricardo Rei, André F. T. Martins,
Proceedings of the 2nd Workshop on Evaluation and Comparison of NLP Systems, Association for Computational Linguistics, pages 133–145, Association for Computational Linguistics, Punta Cana, Dominican Republic, November 2021 - Online Learning Meets Machine Translation Evaluation: Finding the Best Systems with the Least Human Effort
Vânia Mendonça, Ricardo Rei, Luísa Coheur, Alberto Sardinha, Ana Lúcia Santos,
The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021), Association for Computational Linguistics, Association for Computational Linguistics, August 2021 - MT-TELESCOPE: An interactive platform for contrastive evaluation of MT systems
Ricardo Rei, Ana C. Farinha, Craig Stewart, Luísa Coheur, Alon Lavie,
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations, ACL, pages 73-80, ACL, https://aclanthology.org/2021.acl-demo.9, August 2021 - Unbabel's Participation in the WMT20 Metrics Shared Task
Ricardo Rei, Craig Stewart, Ana C Farinha, Alon Lavie,
Proceedings of the Fifth Conference on Machine Translation, Association for Computational Linguistics, pages 911–920, Association for Computational Linguistics, Online, November 2020 - COMET: A neural framework for MT evaluation
Ricardo Rei, Craig Stewart, Ana C Farinha, Alon Lavie,
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Association for Computational Linguistics, pages 2685–2702, Association for Computational Linguistics, Online, November 2020 - Automatic truecasing of video subtitles using BERT: a multilingual adaptable approach
Ricardo Rei, Nuno M Guerreiro, Fernando Batista,
International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, Springer, Cham, vol. 1237, pages 708-721, Springer, Cham, Lisbon, June 2020
Thesis (Author)
- Multi-lingual automatic reply for customer support
Ricardo Rei, Instituto Superior Técnico, Universidade de Lisboa, Lisboa, Portugal, Thesis, June 2019
Total Supervisions: 2
Doctoral Theses
- Generative AI for Large Language Models Personalisation: Development of AI Agents with Culturally-Informed AI Personae
Helena Wu
Ricardo Rei (advisor), Vera Cabarrão (advisor), Helena Moniz (advisor),
Doctoral Thesis, Faculdade de Letras, Universidade de Lisboa, 2025-09-01 - Ongoing
Master's Theses
- Telescope 2.0 - Avaliação fina de Modelos de Tradução
Rita Castro Oliveira
Luísa Coheur (advisor), Ricardo Rei (coadvisor)
Master's Thesis, Instituto Superior Técnico, Universidade de Lisboa, 2022-07-01 - 2023-11-22
Total Projects: 1
National Projects
- CRAI - Center for Responsible AI
Unbabel, IAPMEI, Societal Digital Transformation, 2023-01-01 - 2025-12-31