John Mendonça

John MendonçaINESC-ID | SA-HLT 

261E-CB39-416C
0000-0002-4865-6290

+351213100300     230 john.mendonca@inesc-id.pt www.hlt.inesc-id.pt/w/John_Mendonça

John Mendonça is a Junior Researcher of the HLT (Human Language Technologies Laboratory) and a PhD Student of the Doctoral Programme in Electrical and Computer Engineering of IST. He obtained his MSc degree in 2020 with the thesis "Automatic Detection of Profile Features". In it, he applied speech processing techniques, more specifically in speaker recognition and paralinguistics, for the collection of crowdsourced and health related datasets. More recently he joined a CMU Portugal Affiliate PhD Programme under the MAIA project, a joint CMU/INESC-ID/IT/Unbabel collaboration for Intelligent AI Agents in chatbots. His PhD work is closely related to conversational quality estimation, having co-authored several peer-reviewed publications in this field.

Contacts

• John Mendonça

- Email: John.mendonca@inesc-id.pt

- Role: Junior Researcher | PhD Student

- Human Language Technologies Lab, INESC-ID | Instituto Superior Técnico

- Rua Alves Redol, 9, 1000-029 Lisboa, Portugal

- inesc-id.pt | tecnico.ulisboa.pt

Total Publications: 11

In Proceedings (Author)

• Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs
  John Mendonça, Isabel Trancoso, Alon Lavie,
  Findings of the Association for Computational Linguistics: EMNLP 2024, Association for Computational Linguistics, pages 11687–11708, Miami, Florida, USA, November 2024
• ECoh: Turn-level Coherence Evaluation for Multilingual Dialogues
  John Mendonça, Isabel Trancoso, Alon Lavie,
  25th Meeting of the Special Interest Group on Discourse and Dialogue, Association for Computational Linguistics, Kyoto, Japan, September 2024
• Macro-descriptors for Alzheimer’s disease detection using large language models
  Catarina Botelho, John Mendonça, Anna Maria Pompili, Tanja Schultz, Alberto Abad, Isabel Trancoso,
  Interspeech, September 2024
• On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation
  John Mendonça, Alon Lavie, Isabel Trancoso,
  6th Workshop on NLP for ConvAI, Association for Computational Linguistics, August 2024
• Dialogue Quality and Emotion Annotations for Customer Support Conversations
  John Mendonça, Patrícia Pereira, Luís Miguel Menezes, Vera Cabarrão, Catarina Farinha, Helena Moniz, Joao P. Carvalho, Alon Lavie, Isabel Trancoso,
  Generation, Evaluation & Metrics Workshop at EMNLP, Association for Computational Linguistics, Association for Computational Linguistics, December 2023
• Towards Multilingual Automatic Open-Domain Dialogue Evaluation
  John Mendonça, Alon Lavie, Isabel Trancoso,
  24th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Association for Computational Linguistics, Association for Computational Linguistics, Prague, September 2023
• Simple LLM Prompting is State-of-the-Art for Robust and Multilingual Dialogue Evaluation
  John Mendonça, Patrícia Pereira, Helena Moniz, Joao P. Carvalho, Alon Lavie, Isabel Trancoso,
  The Eleventh Dialog System Technology Challenge, Association for Computational Linguistics, Association for Computational Linguistics, Prague, September 2023
• QualityAdapt: an Automatic Dialogue Quality Estimation Framework
  John Mendonça, Alon Lavie, Isabel Trancoso,
  23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue, Association for Computational Linguistics, pages 83-90, Association for Computational Linguistics, Edinburgh, September 2022
• Towards Speaker Verification for Crowdsourced Speech Collections
  John Mendonça, Rui Correia, Mariana Lourenço, João Freitas, Isabel Trancoso,
  Proceedings of the Language Resources and Evaluation Conference, European Language Resources Association, pages 5929--5937, European Language Resources Association, Marseille, France, June 2022
• Analyzing Breath Signals for the Interspeech 2020 ComParE Challenge
  John Mendonça, Francisco Teixeira, Isabel Trancoso, Alberto Abad,
  Interspeech 2020, October 2020

Thesis (Author)

• Automatic Detection of Profile Features
  John Mendonça, Instituto Superior Técnico, Universidade de Lisboa, Lisboa, Portugal, Thesis, December 2020

 

Academic Activities

• PhD Student: PDEEC

• Teaching Assistant: Spoken Language Processing

• Teaching Assistant: Natural Language