Author:
Wang Chunli,Xu Linming,Zhu Hongxin,Cheng Xiaoyang
Abstract
This paper describes a study on speaker recognition using the ECAPA-TDNN architecture, which stands for Extended Context-Aware Parallel Aggregations Time-Delay Neural Network. It utilizes X-vectors, a method for extracting speaker features by converting speech into fixed-length vectors, and introduces a squeeze-and-excitation block to model dependencies between channels. In order to better explore temporal relationships in the context of speaker recognition and improve the algorithm’s generalization performance in complex acoustic scenarios, this study adds input gates and forget gates to the ECAPA-TDNN architecture, combining them with CIFG (Convolutional LSTM with Input and Forget Gates) modules. These are embedded into a residual structure of multi-layer aggregated features. A sub-center Arcface, an improved loss function based on Arcface, is used for selecting sub-centers for subclass discrimination, retaining advantageous sub-centers to enhance intra-class compactness and strengthen the robustness of the network. Experimental results demonstrate that the improved ECAPA-TDNN-CIFG in this study outperforms the baseline model, yielding more accurate and efficient recognition results.
Reference15 articles.
1. Speaker recognition based on deep learning: An overview;Bai;Neural Networks.,2021
2. Sharma R, Govind D, Mishra J, Dubey AK, Deepak KT, Prasanna SRM. Milestones in speaker recognition. Artificial Intelligence Review. 2024; 57(3).
3. A speaker verification method based on TDNN-LSTMP;Liu;Circuits Systems and Signal Processing.,2019
4. Multi-level self-attentive TDNN: A general and efficient approach to summarize speech into discriminative utterance-level representations;Monteiro;Speech Communication.,2022
5. A survey of speaker recognition: Fundamental theories, recognition methods and opportunities;Kabir;Ieee Access.,2021