Author:
Upadhyaya Prashant,Farooq Omar,Abidi M.R.,Varshney Priyanka
Abstract
Abstract
In building speech recognition based applications, robustness to different noisy background condition is an important challenge. In this paper bimodal approach is proposed to improve the robustness of Hindi speech recognition system. Also an importance of different types of visual features is studied for audio visual automatic speech recognition (AVASR) system under diverse noisy audio conditions. Four sets of visual feature based on Two-Dimensional Discrete Cosine Transform feature (2D-DCT), Principal Component Analysis (PCA), Two-Dimensional Discrete Wavelet Transform followed by DCT (2D-DWT- DCT) and Two-Dimensional Discrete Wavelet Transform followed by PCA (2D-DWT-PCA) are reported. The audio features are extracted using Mel Frequency Cepstral coefficients (MFCC) followed by static and dynamic feature. Overall, 48 features, i.e. 39 audio features and 9 visual features are used for measuring the performance of the AVASR system. Also, the performance of the AVASR using noisy speech signal generated by using NOISEX database is evaluated for different Signal to Noise ratio (SNR: 30 dB to −10 dB) using Aligarh Muslim University Audio Visual (AMUAV) Hindi corpus. AMUAV corpus is Hindi continuous speech high quality audio visual databases of Hindi sentences spoken by different subjects.
Subject
Acoustics and Ultrasonics
Reference18 articles.
1. The robustness of speech representations obtained from simulated auditory nerve fibers under different noise conditions JASA Express Letters of the Acoustical Society of America;Jürgens;Journal,2013
2. Audio - visual speech recognition using an infrared headset;Huang;Speech Communication,2004
3. Speaker verification in sensor and acoustic environment mismatch conditions of Speech Technology;Pradhan;International Journal,2012
4. Robust Speech Feature Prediction Using Mel - LPC to Improve Recognition Accuracy Information Technology;Lokesh;Journal,2012
5. Analysis of CFA - BF : Novel combined fixed / adaptive beamforming for robust speech recognition in real car environments;Hansen;Speech Communication,2009
Cited by
10 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献