The spread of synthetic media on X-Reference-Cited by-同舟云学术

The spread of synthetic media on X

Published:2024-06-03 Issue: Volume: Page:
ISSN:
Container-title:Harvard Kennedy School Misinformation Review
language:
Short-container-title:HKS Misinfo Review

Author:

Corsi Giulio¹,Marino Bill²,Wong Willow³

Affiliation:

1. Institute for Technology and Humanity, University of Cambridge, UK

2. Department of Computer Science and Technology, University of Cambridge, UK

3. Lee Kuan Yew School of Public Policy, National University of Singapore, Singapore

Abstract

Generative artificial intelligence (AI) models have introduced new complexities and risks to information environments, as synthetic media may facilitate the spread of misinformation and erode public trust. This study examines the prevalence and characteristics of synthetic media on social media platform X from December 2022 to September 2023. Leveraging crowdsourced annotations identifying synthetic content, our analysis reveals an increase in AI-generated media over time, with an initial spike in March 2023, following the release of Midjourney V5. While most synthetic media identified is non-political and non-malicious, concerning deepfakes targeting political figures persist, raising questions on the potential for misuse of AI technologies.

Publisher

Shorenstein Center for Media, Politics, and Public Policy

Reference43 articles.

1. Allen, J., Martel, C., & Rand, D. G. (2022). Birds of a feather don’t fact-check each other: Partisanship and the evaluation of news in Twitter’s Birdwatch crowdsourced fact-checking program. In CHI ’22: Proceedings of the 2022 conference on human factors in computing systems (pp. 1–19). Association for Computing Machinery. https://doi.org/10.1145/3491102.3502040

2. Baraheem, S. S., & Nguyên, T. (2023). AI vs. AI: Can AI detect AI-generated images? Journal of Imaging, 9(10), 199. https://doi.org/10.3390/jimaging9100199

3. Borji, A. (2022). Generated faces in the wild: Quantitative comparison of Stable Diffusion, Midjourney and DALL-E 2. arXiv. https://doi.org/10.48550/arXiv.2210.00586

4. Bristow, T. (2024, October 9). Keir Starmer suffers UK politics’ first deepfake moment. It won’t be the last. Politico. https://www.politico.eu/article/uk-keir-starmer-labour-party-deepfake-ai-politics-elections/

5. Brundage, M., Avin, S., Clark, J., Toner, H., Eckersley, P., Garfinkel, B., Dafoe, A., Scharre, P., Zeitzoff, T., Filar, B., Anderson, H., Roff, H., Allen, G. C., Steinhardt, J., Flynn, C., Ó hÉigeartaigh, S., Beard, S., Belfield, H., Farquhar, S., & Lyle, C. (2018). The malicious use of artificial intelligence: Forecasting, prevention, and mitigation. arXiv. https://doi.org/10.48550/arXiv.1802.07228