Comparison of the Ability of Neural Network Model and Humans to Detect a Cloned Voice-Reference-Cited by-同舟云学术

Comparison of the Ability of Neural Network Model and Humans to Detect a Cloned Voice

Published:2023-10-30 Issue:21 Volume:12 Page:4458
ISSN:2079-9292
Container-title:Electronics
language:en
Short-container-title:Electronics

Author:

Milewski Krzysztof¹,Zaporowski Szymon¹²,Czyżewski Andrzej¹^ORCID

Affiliation:

1. Multimedia Systems Department, Gdansk University of Technology, Narutowicza 11/12, 80-233 Gdańsk, Poland

2. Audio Acoustics Laboratory, Gdansk University of Technology, Narutowicza 11/12, 80-233 Gdańsk, Poland

Abstract

The vulnerability of the speaker identity verification system to attacks using voice cloning was examined. The research project assumed creating a model for verifying the speaker’s identity based on voice biometrics and then testing its resistance to potential attacks using voice cloning. The Deep Speaker Neural Speaker Embedding System was trained, and the Real-Time Voice Cloning system was employed based on the SV2TTS, Tacotron, WaveRNN, and GE2E neural networks. The results of attacks using voice cloning were analyzed and discussed in the context of a subjective assessment of cloned voice fidelity. Subjective test results and attempts to authenticate speakers proved that the tested biometric identity verification system might resist voice cloning attacks even if humans cannot distinguish cloned samples from original ones.

Funder

Polish National Centre for Research and Development (NCBR) from the European Regional Development Fund

Electronics, Telecommunications, and Informatics Faculty, Gdańsk University of Technology

Publisher

MDPI AG

Subject

Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering

Link

https://www.mdpi.com/2079-9292/12/21/4458/pdf

Reference48 articles.

1. (2019, October 11). Available online: https://commonvoice.mozilla.org/en.

2. CorentinJ (2023, January 17). Real Time Voice Cloning. Available online: https://github.com/CorentinJ/Real-Time-Voice-Cloning.

3. Li, C., Ma, X., Jiang, B., Li, X., Zhang, X., Liu, X., Cao, Y., Kannan, A., and Zhu, Z. (2023, January 17). Deep Speaker: An End-to-End Neural Speaker Embedding System. Available online: https://arxiv.org/abs/1705.02304.

4. Liu, X., Sahidullah, M., and Kinnunen, T.A. (2020, January 25–29). Comparative Re-Assessment of Feature Extractors for Deep Speaker Embeddings. Proceedings of the Interspeech, Shanghai, China.

5. Perceptual linear predictive (PLP) analysis of speech;Hermansky;J. Acoust. Soc. Am.,1990

Cited by 3 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Forensic Perspective on Voice Biometrics and AI : A Review;International Journal of Scientific Research in Science and Technology;2024-09-04

2. A computer-aid speech rehabilitation system with mirrored video generating;Technology and Health Care;2024-05-31

3. Using Virtual Reality Technologies to Cope with Grief and Emotional Resilience of Absent Loved Ones;Proceedings of the 2024 8th International Conference on Medical and Health Informatics;2024-05-17