BioVisualSpeech Engine: Difference between revisions

From HLT@INESC-ID

(Create demo page)
 
m (Add link section)
Line 20: Line 20:
and a word recognition module trained on additional children data and calibrated and evaluated
and a word recognition module trained on additional children data and calibrated and evaluated
with the collected corpus.
with the collected corpus.
== Links ==


[https://www.mdpi.com/2078-2489/11/10/470 MDPI link]
[https://www.mdpi.com/2078-2489/11/10/470 MDPI link]

Revision as of 16:07, 27 November 2020

Abstract

In order to develop computer tools for speech therapy that reliably classify speech productions, there is a need for speech production corpora that characterize the target population in terms of age, gender, and native language. Apart from including correct speech productions, in order to characterize the target population, the corpora should also include samples from people with speech sound disorders. In addition, the annotation of the data should include information on the correctness of the speech productions. Following these criteria, we collected a corpus that can be used to develop computer tools for speech and language therapy of Portuguese children with sigmatism. The proposed corpus contains European Portuguese children’s word productions in which the words have sibilant consonants. The corpus has productions from 356 children from 5 to 9 years of age. Some important characteristics of this corpus, that are relevant to speech and language therapy and computer science research, are that (1) the corpus includes data from children with speech sound disorders; and (2) the productions were annotated according to the criteria of speech and language pathologists, and have information about the speech production errors. These are relevant features for the development and assessment of speech processing tools for speech therapy of Portuguese children. In addition, as an illustration on how to use the corpus, we present three speech therapy games that use a convolutional neural network sibilants classifier trained with data from this corpus and a word recognition module trained on additional children data and calibrated and evaluated with the collected corpus.

Links

MDPI link

Contact

Alberto Abad