Visualization of a Person's Emotional Tension by a Speech Signal

Abstract

The article presents the results of research on the assessment of human emotional tension by a speech signal using the developed technology of multilevel wavelet analysis. The disadvantages of polygraph systems during psychophysiological inspections of personnel are given. The data obtained by domestic and foreign experts allow us to make a confident conclusion that the characteristics of a person's oral speech correlate with changes in their condition. The characteristics of the hardware and software complex «Icar Lab» (Russia) in assessing the emotional state of the speaker, as well as the computer voice stress analyzer CVSA (USA) are considered. A new contactless technology is proposed for assessing the level of emotional tension of a person using stress biomarkers obtained on the tonal parts of speech. The WaveView-VSA program for obtaining high-precision time-frequency characteristics of a speech signal has been developed. The possibilities of the developed program for visualizing the level of emotional tension are presented. A database of audio recordings of 6th-year students who are in conditions with increased emotional stress during the exam and the defense of the graduation project has been formed and processed. The research conducted by the Scientific and Educational Medical and Technological Center of the Bauman Moscow State Technical University showed the fundamental possibility of obtaining real-time acoustocardiography data and the level of emotional tension in the examined students during express cardiodiagnostics. The developed technology provides biomarkers of stress based on a speech signal lasting several seconds.