Affiliation:
1. Department of Computer Science and Technology, College of Computer Science, Donghua University, Shanghai 200022, China
2. School of Computer Science and Engineering, Southeast University, Nanjing 211189, China
3. Software College, Shenyang Normal University, Shenyang 110136, China
Abstract
Deepfake technology uses artificial intelligence to create realistic but false audio, images, and videos. Deepfake technology poses a significant threat to the authenticity of visual content, particularly in live-stream scenarios where the immediacy of detection is crucial. Existing Deepfake detection approaches have limitations and challenges, prompting the need for more robust and accurate solutions. This research proposes an innovative approach: combining eye movement analysis with a hybrid deep learning model to address the need for real-time Deepfake detection. The proposed hybrid deep learning model integrates two deep neural network architectures, MesoNet4 and ResNet101, to leverage their respective architectures’ strengths for effective Deepfake classification. MesoNet4 is a lightweight CNN model designed explicitly to detect subtle manipulations in facial images. At the same time, ResNet101 handles complex visual data and robust feature extraction. Combining the localized feature learning of MesoNet4 with the deeper, more comprehensive feature representations of ResNet101, our robust hybrid model achieves enhanced performance in distinguishing between manipulated and authentic videos, which cannot be conducted with the naked eye or traditional methods. The model is evaluated on diverse datasets, including FaceForensics++, CelebV1, and CelebV2, demonstrating compelling accuracy results, with the hybrid model attaining an accuracy of 0.9873 on FaceForensics++, 0.9689 on CelebV1, and 0.9790 on CelebV2, showcasing its robustness and potential for real-world deployment in content integrity verification and video forensics applications.
Reference60 articles.
1. Deepfake Detection: A Systematic Literature Review;Rana;IEEE Access,2022
2. Pantserev, K.A. (2020). The malicious use of AI-based deepfake technology as the new threat to psychological security and political stability. Adv. Sci. Technol. Secur. Appl., 37–55.
3. Deepfakes generation and detection: State-of-the-art, open challenges, countermeasures, and way forward;Masood;Appl. Intell.,2023
4. The state of deepfakes: Landscape, threats, and impact;Ajder;Amst. Deep.,2019
5. Choose your stars and studs: The rise of deepfake designer porn;Kikerpill;Porn Stud.,2020
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献