An Investigation of the Effectiveness of Deepfake Models and Tools

Author:

Mukta Md. Saddam Hossain1ORCID,Ahmad Jubaer1,Raiaan Mohaimenul Azam Khan1ORCID,Islam Salekul1ORCID,Azam Sami2ORCID,Ali Mohammed Eunus3ORCID,Jonkman Mirjam2

Affiliation:

1. Department of Computer Science and Engineering, United International University, Madani Avenue, Dhaka 1212, Bangladesh

2. Faculty of Science and Technology, Charles Darwin University, Casuarina, NT 0909, Australia

3. Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology (BUET), West Palasi, Dhaka 1000, Bangladesh

Abstract

With the development of computer vision and deep learning technologies, rapidly expanding approaches have been introduced that allow anyone to create videos and pictures that are both phony and incredibly lifelike. The term deepfake methodology is used to describe such technologies. Face alteration can be performed both in videos and pictures with extreme realism using deepfake innovation. Deepfake recordings, the majority of them targeting politicians or celebrity personalities, have been widely disseminated online. On the other hand, different strategies have been outlined in the research to combat the issues brought up by deepfake. In this paper, we carry out a review by analyzing and comparing (1) the notable research contributions in the field of deepfake models and (2) widely used deepfake tools. We have also built two separate taxonomies for deepfake models and tools. These models and tools are also compared in terms of underlying algorithms, datasets they have used and their accuracy. A number of challenges and open issues have also been identified.

Funder

Institute for Advanced Research Publication Grant of the United International University

Publisher

MDPI AG

Subject

Control and Optimization,Computer Networks and Communications,Instrumentation

Reference178 articles.

1. The emergence of deepfake technology: A review;Westerlund;Technol. Innov. Manag. Rev.,2019

2. Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., and Nießner, M. (2016, January 27–30). Face2face: Real-time face capture and reenactment of rgb videos. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.

3. Kowalski, M. (2022, November 06). FaceSwap. Available online: https://github.com/MarekKowalski/FaceSwap.

4. Singh, R., Shrivastava, S., Jatain, A., and Bajaj, S.B. (2022). Machine Intelligence and Smart Systems: Proceedings of MISS 2021, Springer.

5. Deepfakes and disinformation: Exploring the impact of synthetic political video on deception, uncertainty, and trust in news;Vaccari;Soc. Media Soc.,2020

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3