Affiliation:
1. Faculty of Electronics, Telecommunications and Informatics, Gdańsk University of Technology, Narutowicza 11/12, 80-233 Gdansk, Poland
Abstract
This work deals with automatically detecting stuttering and its subclasses. An effective classification of stuttering along with its subclasses could find wide application in determining the severity of stuttering by speech therapists, preliminary patient diagnosis, and enabling communication with the previously mentioned voice assistants. The first part of this work provides an overview of examples of classical and deep learning methods used in automated stuttering classifications as well as databases and features used. Then, two classical algorithms (k-NN (k-nearest neighbor) and SVM (support vector machine) and several deep models (ConvLSTM; ResNetBiLstm; ResNet18; Wav2Vec2) are examined on the available stuttering dataset. The experiments investigate the influence of individual signal features such as Mel-Frequency Cepstral Coefficients (MFCCs), pitch-determining features in the signal, and various 2D speech representations on the classification results. The most successful algorithm, i.e., ResNet18, can classify speech disorders at the F1 measure of 0.93 for the general class. Additionally, deep learning shows superiority over a classical approach to stuttering disorder detection. However, due to insufficient data and the quality of the annotations, the results differ between stuttering subcategories. Observation of the impact of the number of dense layers, the amount of data in the training set, and the amount of data divided into the training and test sets on the effectiveness of stuttering event detection is provided for further use of this methodology.
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference54 articles.
1. Sequence Labeling to Detect Stuttering Events in Read Speech;Alharbi;Comput. Speech Lang.,2020
2. Arnab, A., Jayasumana, S., Zheng, S., and Torr, P. (2016). Higher Order Conditional Random Fields in Deep Neural Networks. arXiv.
3. Bhatia, G., Saha, B., Khamkar, M., Chandwani, A., and Khot, R. (2020). Stutter Diagnosis and Therapy System, Based on Deep Learning. arXiv.
4. Machine Learning for Stuttering Identification: Review, Challenges and Future Directions;Sheikh;Neurocomputing,2022
5. Computer-assisted pronunciation training—Speech synthesis is almost all you need;Korzekwa;Speech Commun.,2022
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献