João Paulo Neto graduated in Electrotechnical and Computers Engineering by the Instituto Superior Técnico (IST), Lisbon, in 1987, and received his MSc and PhD degrees in Electrotecnic and Computers Engineering, from the same University in 1991 and 1998, respectively. His PhD thesis was on speaker-adaptation in a context of hybrid Artificial Neural Networks and Hidden Markov Models continuous speech recognition systems. In 1991 he started as lecturer and since 1998 he holds a position of Assistant Professor in Instituto Superior Técnico, where he has taught signal theory, discrete signal processing, control systems and neural networks. He joined the Neural Networks and Signal Processing group of INESC in 1987, having participated in the European projects PYGMALION, WERNICKE, SPRACH and ALERT and in several national projects. In 2001 he participated in the foundation of L2F where hold a position in the Executive Board. His activities have been in the areas of neural networks (training algorithms and applications) and speech recognition (HMM/neural network based). He has authored a significant number of scientific papers. He is a member of IEEE and ISCA.
Publications
National Patents
2009
- João Miranda, João Paulo da Silva Neto, Método de compressão da composição de um léxico com um modelo de língua, Patent number: 104252, October 2009
Book Chapters
2000
- Isabel Trancoso, Luís C. Oliveira, João Paulo da Silva Neto, Maria do Céu Guerreiro Viana Ribeiro, A Escrita das Escritas, chapter Da Escrita à Fala - Da Fala à Escrita, Fundação Portuguesa das Comuni, October 2000
International Journals
2017
- Luís Marujo, Ricardo Ribeiro, Anatole Gershman, David Martins de Matos, João Paulo da Silva Neto, Jaime Carbonell, Event-Based Summarization using a Centrality-As-Relevance Model, Knowledge and Information Systems, Springer, vol. 50, n. 3, pages 945-968, doi: 10.1007/s10115-016-0966-4, March 2017
2016
- Luís Marujo, Wang Ling, Ricardo Ribeiro, Anatole Gershman, Jaime Carbonell, David Martins de Matos, João Paulo da Silva Neto, Exploring Events and Distributed Representations of Text in Multi-Document Summarization, Knowledge-Based Systems, Elsevier, vol. 94, pages 33-42, doi: 10.1016/j.knosys.2015.11.005, February 2016
2013
- Ramon Fernandez Astudillo, Dorothea Kolossa, Alberto Abad, Steffen Zeiler, Rahim Saeidi, Pejman Mowlaee, João Paulo da Silva Neto, Rainer Martin, Integration of beamforming and uncertainty-of-observation techniques for robust ASR in multi-source environments, Computer Speech and Language, vol. 27, n. 3, pages 837-850, May 2013
2010
- Ciro Alexandre Domingues Martins, António Teixeira, João Paulo da Silva Neto, Dynamic Language Modeling for European Portuguese, Computer Speech and Language, Elsevier, vol. 24, n. 4, pages 750-773 , doi: http://dx.doi.org/10.1016/j.csl.2010.02.003, October 2010
2007
- Rui Pedro Batoreo Amaral, Hugo Meinedo, Diamantino António Caseiro, Isabel Trancoso, João Paulo da Silva Neto, A Prototype System for Selective Dissemination of Broadcast News in European Portuguese, EURASIP Journal on Advances in Signal Processing, Hindawi Publishing Corporation, vol. 2007, n. 37507, pages , May 2007
International Conferences
2019
- Carlos Miguel Duarte Mendes, Alberto Abad, João Paulo da Silva Neto, Isabel Trancoso, Recognition of Latin American Spanish using Multi-task Learning, In Interspeech 2019, ISCA, pages 2135--2139, Graz, Austria, September 2019
2015
- Luís Marujo, Wang Ling, Isabel Trancoso, Chris Dyer, Alan W. Black, Anatole Gershman, David Martins de Matos, João Paulo da Silva Neto, Jaime G. Carbonell, Automatic Keyword Extraction on Twitter, In 53rd Annual Meeting of the Association for Computational Linguistics, ACL, Beijing, China, July 2015
- Luís Marujo, José Portêlo, Wang Ling, David Martins de Matos, João Paulo da Silva Neto, Anatole Gershman, Jaime Carbonell, Isabel Trancoso, Bhiksha Raj, Privacy-Preserving Multi-Document Summarization, In ACM SIGIR Workshop on Privacy-Preserving Information Retrieval, Santiago, Chile, July 2015
- Luís Marujo, Ricardo Ribeiro, David Martins de Matos, João Paulo da Silva Neto, Anatole Gershman, Jaime G. Carbonell, Extending a Single-Document Summarizer to Multi-Document: a Hierarchical Approach, In *SEM 2015: Fourth Joint Conference on Lexical and Computational Semantics, ACL, pages 176, Denver, Colorado, June 2015
2014
- Luís Marujo, Joao P. Carvalho, Anatole Gershman, Jaime Carbonell, João Paulo da Silva Neto, David Martins de Matos, Textual Event Detection using Fuzzy Fingerprints, In IEEE Intelligent Systems IS’14, IEEE, pages 825-836, Warsaw, Poland, September 2014
- Luís Marujo, José Portêlo, David Martins de Matos, João Paulo da Silva Neto, Anatole Gershman, Jaime Carbonell, Isabel Trancoso, Bhiksha Raj, Privacy-Preserving Important Passage Retrieval, In PIR14: Privacy-Preserving IR: When Information Retrieval Meets Privacy and Security (SIGIR 2014 Workshop), ACM, series SIGIR, Gold Coast, Australia, July 2014
2013
- Ricardo Ribeiro, Luís Marujo, David Martins de Matos, João Paulo da Silva Neto, Anatole Gershman, Jaime Carbonell, Self reinforcement for important passage retrieval, In 36th international ACM SIGIR conference on Research and development in information retrieval, ACM, pages 845-848, Dublin, Ireland, July 2013
2012
- Luís Marujo, Wang Ling, Anatole Gershman, Jaime Carbonell, João Paulo da Silva Neto, David Martins de Matos, Recognition of Named-Event Passages in News Articles, In 25th International Conference on Computational Linguistics (COLING 2012), Mumbai, India, December 2012
- João Miranda, João Paulo da Silva Neto, Alan Black, Recovery of acronyms, out-of-lattice words and pronunciations from parallel multilingual speech, In SLT 2012, IEEE, Miami, Florida, USA, December 2012
- Luís Marujo, Ricardo Ribeiro, David Martins de Matos, João Paulo da Silva Neto, Anatole Gershman, Jaime Carbonell, Key Phrase Extraction of Lightly Filtered Broadcast News, In 15th International Conference on Text, Speech and Dialogue (TSD 2012), Springer, doi: 10.1007/978-3-642-32790-2_35, Brno, Czech Republic, September 2012
- Luís Marujo, Anatole Gershman, Jaime Carbonell, Robert Frederking, João Paulo da Silva Neto, Supervised Topical Key Phrase Extraction of News Stories using Crowdsourcing, Light Filtering and Co-reference Normalization, In 8th International Conference on Language Resources and Evaluation (LREC 2012), ELRA, Istanbul, Turkey, May 2012
2011
- Luís Marujo, Miguel Bugalho, João Paulo da Silva Neto, Anatole Gershman, Jaime Carbonell, Hourly Traffic Prediction of News Stories, In 3rd International Workshop on Context- Aware Recommender Systems held as part of the 5th ACM RecSys Conference, Chicago, USA, October 2011
- Ramon Fernandez Astudillo, João Paulo da Silva Neto, Propagation of Uncertainty through Multilayer Perceptrons for Robust Automatic Speech Recognition, In Interspeech, pages 461-464, October 2011
- Dorothea Kolossa, Ramon Fernandez Astudillo, Alberto Abad, Steffen Zeiler, Rahim Saeidi, Pejman Mowlaee, João Paulo da Silva Neto, Rainer Martin, CHIME Challenge: Approaches to Robustness using Beamforming and Uncertainty-of-Observation Techniques, In CHIME Workshop: International Workshop on Machine Listening in Multisource Environments, September 2011
- Luís Marujo, Márcio Viveiros, João Paulo da Silva Neto, Keyphrase Cloud Generation of Broadcast News, In proceeding of Interspeech 2011: 12th Annual Conference of the International Speech Communication Association, ISCA, Florence, Italy, August 2011
- João N. Neto, Ricardo Silva, João Paulo da Silva Neto, João António Madeiras Pereira, João Fernandes, Solis´Curse - A Cultural Heritage Game Using Voice Interaction with a Virtual Agent, In VS-Games 2011 - Third International Conference on Games and Virtual Worlds for Serious Applications, IEEE Computer Society, pages 164-167, doi: 10.1109/VS-GAMES.2011.31, Athens, Greece, May 2011
2010
2009
- Isabel Trancoso, Thomas Pellegrini, José Portêlo, Hugo Meinedo, Miguel Bugalho, Alberto Abad, João Paulo da Silva Neto, Audio contributions to semantic video search, In 2009 IEEE International Conference on Multimedia and Expo (ICME 2009), IEEE, New York, USA, June 2009
- José Portêlo, Miguel Bugalho, Isabel Trancoso, João Paulo da Silva Neto, Alberto Abad, António Joaquim Serralheiro, Non-speech audio event detection, In ICASSP 2009 - Int. Conf. on Acoustics, Speech, and Signal Processing, IEEE, April 2009
2008
- Gustavo Fernandes Esteves Soares Coelho, António Joaquim Serralheiro, João Paulo da Silva Neto, A Spoken Dialog System Speech Interface based on a Microphone Array, In Propor2008 - International Conference on Computational Processing of Portuguese, Springer, vol. 5190, series Lecture Notes in Artificial Intelligence, Curia, Aveiro, Portugal, September 2008
- Ciro Alexandre Domingues Martins, António Teixeira, João Paulo da Silva Neto, Dynamic language modeling for the European Portuguese, In PROPOR 2008 - 8th International Conference on Computational Processing of the Portuguese Language, Springer, Aveiro, Portugal, September 2008
- Isabel Trancoso, José Portêlo, Miguel Bugalho, João Paulo da Silva Neto, António Joaquim Serralheiro, Training audio events detectors with a sound effects corpus, In Interspeech 2008, ISCA, Brisbane, Australia, September 2008
- Filipe Martins, Ana Cristina Mendes, Joana Paulo Pardal, Nuno J. Mamede, João Paulo da Silva Neto, Using System Expectations to manage user interactions, In The International Conference on Computational Processing of Portuguese (PROPOR 2008), Springer-Verlag, vol. 5190, series Lecture Notes in Computer Science, pages 240-243, doi: 10.1007/978-3-540-85980-2_29, Aveiro, Portugal, September 2008
- Filipe Martins, Ana Cristina Mendes, Márcio Viveiros, Joana Paulo Pardal, Pedro Arez, Nuno J. Mamede, João Paulo da Silva Neto, Reengineering a domain-independent framework for Spoken Dialogue Systems, In Software Engineering, Testing, and Quality Assurance for Natural Language Processing, an ACL 2008 Workshop, Columbus, Ohio, USA, June 2008
- João Paulo da Silva Neto, Hugo Meinedo, Márcio Viveiros, Renato Márcio de França Cassaca, Ciro Alexandre Domingues Martins, Diamantino António Caseiro, Broadcast News Subtitling System in Portuguese, In ICASSP 2008 - Int. Conf. on Acoustics, Speech, and Signal Processing, IEEE, Las Vegas, USA, April 2008
2007
2006
- Ciro Alexandre Domingues Martins, António Teixeira, João Paulo da Silva Neto, Dynamic Vocabulary Adaptation for a daily and real-time Broadcast News Transcription System, In 2006 IEEE/ACL Workshop on Spoken Language Technology, IEEE/ACL, December 2006
- Rui Pedro Batoreo Amaral, Hugo Meinedo, Diamantino António Caseiro, Isabel Trancoso, João Paulo da Silva Neto, Automatic vs. Manual Topic Segmentation and Indexation in Broadcast News, In IV Jornadas en Tecnologia del Habla, pages 123--128, Zaragoza, Spain, November 2006
- João Paulo da Silva Neto, Renato Márcio de França Cassaca, Márcio Viveiros, Márcio Duarte Albasini Mourão, Design of a Multimodal Input Interface for a Dialogue System, In PROPOR 2006 - Computational Processing of the Portuguese Language, SPRINGER, vol. 3960, series Lecture Notes in Artificial Intelligence, pages 170-179, Itatiaia, Brazil, May 2006
2005
2004
- Isabel Trancoso, João Paulo da Silva Neto, Hugo Meinedo, Rui Pedro Batoreo Amaral, Diamantino António Caseiro, An Acoustic Driven Media Watch System, In Acustica'2004 - Acoustics European Symposium, Guimarães, Portugal, September 2004
- A. Vandecatseye, J. Martens, João Paulo da Silva Neto, Hugo Meinedo, C. Mateo, J. Dieguez, F. Mihelic, J. Zibert, J. Nouza, P. David, M. Pleva, A. Cizmar, H. Papageorgiou, C. Alexandris, The COST278 pan-European Broadcast News Database, In LREC 04, Lisboa, Portugal, April 2004
2003
- Hugo Meinedo, Diamantino António Caseiro, João Paulo da Silva Neto, Isabel Trancoso, AUDIMUS.media: a Broadcast News speech recognition system for the European Portuguese language, In PROPOR'2003 - 6th International Workshop on Computational Processing of the Portuguese Language, Springer, series Lecture Notes in Artificial Intelligence, Faro, Portugal, June 2003
2002
- António Joaquim Serralheiro, Diamantino António Caseiro, Hugo Meinedo, Isabel Trancoso, João Paulo da Silva Neto, Spoken Book Alignment Using WFSTS, In HLT 2002, Human Language Technology Conference, San Diego, California, March 2002
2001
- Rui Manuel Marques dos Santos Amaral, Thibault Langlois, Hugo Meinedo, João Paulo da Silva Neto, N. Souto, Isabel Trancoso, The development of a Portuguese version of a media watch system, In 7th European Conference on Speech Communication and Technology (EUROSPEECH) 2001, Aalborg, Denmark, September 2001
2000
National Conferences
2005
- Isabel Trancoso, Diamantino António Caseiro, Nuno J. Mamede, João Paulo da Silva Neto, Luís C. Oliveira, António Joaquim Serralheiro, Maria do Céu Guerreiro Viana Ribeiro, Building Spoken Language Systems, In 5th Conference on Telecommunications, Tomar, Portugal, April 2005
2000
- João Paulo da Silva Neto, Rui Manuel Marques dos Santos Amaral, Isabel Trancoso, Reconhecimento de fala e detecção de tópicos aplicados a sistemas de alerta sobre notícias televisivas, In IV Jornadas de Arquivo e Documentação - Os Arquivos na Era do Digital, Lisboa, Portugal, November 2000
1998
- Ciro Alexandre Domingues Martins, Maria Isabel de Vilhena Mascarenhas, Hugo Meinedo, João Paulo da Silva Neto, Luís C. Oliveira, Carlos Eduardo Meneses Ribeiro, Isabel Trancoso, Maria do Céu Guerreiro Viana Ribeiro, Spoken Language Corpora for Speech Recognition and Synthesis in European Portuguese, In RECPAD'98 - 10th Portuguese Conference on Pattern Recognition, Lisbon, Portugal, March 1998
Technical Reports
2008
Other Publications
2014
- Luís Marujo, José Portêlo, David Martins de Matos, João Paulo da Silva Neto, Anatole Gershman, Jaime G. Carbonell, Isabel Trancoso, Bhiksha Raj, Privacy-Preserving Important Passage Retrieval, http://arxiv.org/abs/1407.5416, July 2014
- Luís Marujo, Anatole Gershman, Jaime Carbonell, João Paulo da Silva Neto, David Martins de Matos, Ensemble Detection of Single & Multiple Events at Sentence-Level, http://arxiv.org/abs/1403.6023, March 2014
2013
- Luís Marujo, Anatole Gershman, Jaime Carbonell, David Martins de Matos, João Paulo da Silva Neto, Co-Multistage of Multiple Classifiers for Imbalanced Multiclass Learning, https://arxiv.org/abs/1312.659, December 2013
- Luís Marujo, Ricardo Ribeiro, David Martins de Matos, João Paulo da Silva Neto, Anatole Gershman, Jaime Carbonell, Key Phrase Extraction of Lightly Filtered Broadcast News, https://arxiv.org/abs/1306.489, June 2013
- Luís Marujo, Wang Ling, Anatole Gershman, Jaime Carbonell, João Paulo da Silva Neto, David Martins de Matos, Recognition of Named-Event Passages in News Articles, arXiv preprint arXiv:1306.4908, June 2013
2003
- João Paulo da Silva Neto, Hugo Meinedo, Isabel Trancoso, Fórum 2003 (Competitividade, Inovação e Qualificação: Estratégias, Políticas e Desafios), AIP, October 2003
PhD theses
Finished
- Combining multiple parallel streams for improved speech processing, João Miranda. Carnegie Mellon University/Instituto Superior T ́ecnico (2011-2016). João Paulo da Silva Neto, advisor. Luísa Coheur, co-advisor.
- Event-based Multi-document Summarization, Luís Marujo. Jaime Carbonell (CMU advisor). Anatole Gershman (CMU co-advisor). IST, Univ. de Lisboa & Carnegie Mellon University (2011-2015). João Paulo da Silva Neto, advisor. David Martins de Matos, co-advisor.
- Dynamic Language Modeling for European Portuguese, Ciro Alexandre Domingues Martins. University of Aveiro (2004-2008). João Paulo da Silva Neto, advisor. António Joaquim da Silva Teixeira, co-advisor.
MSc theses
Finished
- Utilização de Agentes Conversacionais em aplicações multimodais em plataformas móveis, Ricardo Miguel Almeida da Silva. IST/UTL (2012-2013). João Paulo da Silva Neto, advisor. Manuel J. Fonseca, co-advisor.
- Redes de Pontos de Distribuição de Conteúdos comn Base em Quiosques comn Agentes Virtuais Conversacionais, Jorge Miguel Fernandes Jorge. (2012-2013). João Paulo da Silva Neto, advisor. João Coelho Garcia, co-advisor.
- Difusão Selectiva de Informação Multimédia, Bruno Miguel Nunes Almeida. (2009-2010). João Paulo da Silva Neto, advisor. Nuno J. Mamede, co-advisor.
- Fala comigo - Agente virtual conversacional, Saulo Tavares Rego. (2008-2010). João Paulo da Silva Neto, advisor. Luísa Coheur, co-advisor.
- Porque sorri a Mona Lisa?, Paula Alexandra Baptista da Silva Fonseca. (2008-2009). Luísa Coheur, advisor. João Paulo da Silva Neto, co-advisor.
- Speaking with Google Calendar, Pedro Arez. Instituto Superior Técnico, Universidade Técnica de Lisboa (2007-2009). Nuno J. Mamede, advisor. João Paulo da Silva Neto, co-advisor.
- Sistema interactivo para preenchimento de formulários, Carlos Rolo. Instituto Superior Técnico, Universidade Técnica de Lisboa (2008). João Paulo da Silva Neto, advisor.
- Portal para Notícias Televisivas, Bruno Eduardo Serrão Santos. Instituto Superior Técnico, Universidade de Lisboa (2006-2008). David Martins de Matos, advisor. João Paulo da Silva Neto, co-advisor.
- Design of a Speech Interface for Augmenting Desktop Accessibility, David Rodrigues. Instituto Superior Técnico (2007-2008). João Paulo da Silva Neto, advisor. Nuno J. Mamede, co-advisor.
- Utilização de Arrays de Microfones para Sistemas de Reconhecimento de Fala, Gustavo Fernandes Esteves Soares Coelho. Instituto Superior Técnico, Universidade Técnica de Lisboa (2006-2007). João Paulo da Silva Neto, advisor. António Joaquim Serralheiro, co-advisor.
- Tradução Automática de Notícias Televisivas de Espanhol para Português, Raquel Sanchez Martinez. Instituto Superior Técnico, Universidade Técnica de Lisboa (2006-2007). João Paulo da Silva Neto, advisor. Diamantino António Caseiro, co-advisor.
- Utilização de informação prosódica para uma partição apropriada de segmentos acústicos em frases, Pedro Miguel Dias Cardoso. Instituto Superior Técnico, Universidade Técnica de Lisboa (2001-2004). João Paulo da Silva Neto, advisor.
- Utilização de Informação Silábica no Reconhecimento de fala contínua, Hugo Meinedo. Instituto Superior Técnico, Universidade Técnica de Lisboa (1998-2000). João Paulo da Silva Neto, advisor.
- Modelos de Linguagem no Reconhecimento de Fala Contínua, Ciro Alexandre Domingues Martins. Instituto Superior Técnico (1996-1998). João Paulo da Silva Neto, advisor.
Graduation theses
Finished
- Sistemas de Aquisição de Fala para Ambientes Virtuais, Gustavo Fernandes Esteves Soares Coelho. (2005-2006). João Paulo da Silva Neto, advisor.
- Destribuição de Notícias Multimédia para Dispositivos Móveis, Carlos Filipe Bandeirinha Meneses Lopes, José Diogo Reis Ferreira De Areia. (2005-2006). João Paulo da Silva Neto, advisor.
- Desenho de IVRs para operadoras telefónicas, Marco Filipe de Sousa Gírio Miranda de Mouta, Hugo David de Abreu Monteiro. Instituto Superior Técnico, Universidade Técnica de Lisboa (2004-2005). João Paulo da Silva Neto, advisor. Nuno J. Mamede, co-advisor.
- Cara Falante - Uma interface visual para um sistema de diálogo falado, Márcio Viveiros. Instituto Superior Técnico, Universidade Técnica de Lisboa (2003-2004). João Paulo da Silva Neto, advisor. Nuno J. Mamede, co-advisor.
- Casa Virtual - uma interface visual para a casa do futuro, António Quintino, Nuno Pedro. Instituto Superior Técnico (2003-2004). João Paulo da Silva Neto, advisor.
- Ambrósio, o mordomo para a nossa casa, Sandra Conduto, Pedro Rolo. Instituto Superior Técnico (2002-2003). João Paulo da Silva Neto, advisor.
- Sistema de apoio à legendagem de programas de televisão, João Fiuza, Pedro Sousa. Instituto Superior Técnico (2002-2003). João Paulo da Silva Neto, advisor.
- Utilização de fala para preenchimento de formulários num PDA, Armando Marques, Sofia Valente. Instituto Superior Técnico (2002-2003). João Paulo da Silva Neto, advisor. Luís C. Oliveira, co-advisor.
- Broadcast News Summarization, Vitor João Cardoso Pereira, João Miguel Duarte Gaspar. (-2002). João Paulo da Silva Neto, advisor.
- Electronic Assistant, Rui Filipe Pedroso Maia, Renato Márcio de França Cassaca. (-2002). João Paulo da Silva Neto, advisor.
- Sistema de diálogo com uma interface baseada em fala, Luís Flores, Pedro Cardoso. Instituto Superior Técnico (2000-2001). João Paulo da Silva Neto, advisor. Thibault Langlois, co-advisor.
- Sistema de ditado de relatórios de radiologia baseado num reconhecedor de fala contínua, Miguel Barreiros, José Martinez. Instituto Superior Técnico (2000-2001). João Paulo da Silva Neto, advisor.
- Sistema para controlo de uma Aparelhagem Hi-Fi através da Fala, Nuno Jordão, Gustavo Novais. Instituto Superior Técnico (2000-2001). João Paulo da Silva Neto, advisor.