Affiliation:
1. FIRAT ÜNİVERSİTESİ, TEKNOLOJİ FAKÜLTESİ
2. FIRAT ÜNİVERSİTESİ
Abstract
Image-to-text generation contributes significantly across various domains such as entertainment, communication, commerce, security, and education by establishing a connection between visual and textual content through the creation of explanations. This process aims to transform image data into meaningful text, enhancing content accessibility, comprehensibility, and processability. Hence, advancements and studies in this field hold paramount importance. This study focuses on how the fusion of the Sequence-to-Sequence (Seq2seq) model and attention mechanism enhances the generation of more meaningful captions from images. Experiments conducted on the Flickr8k dataset highlight the Seq2seq model's capacity to produce captions in alignment with reference sentences. Leveraging the dynamic focus of the attention mechanism, the model effectively captures detailed aspects of images.
Publisher
Sakarya University Journal of Computer and Information Sciences
Reference35 articles.
1. [1] T. Alqahtani et al., The emergent role of artificial intelligence, natural learning processing, and large language models in higher education and research," Research in Social and Administrative Pharmacy, vol. 19, no. 8, pp. 1236–1242, Aug. 2023, doi: 10.1016/j.sapharm.2023.05.016.
2. [2] J. J. Cavallo, I. de Oliveira Santo, J. L. Mezrich, and H. P. Forman, Clinical Implementation of a Combined Artificial Intelligence and Natural Language Processing Quality Assurance Program for Pulmonary Nodule Detection in the Emergency Department Setting,Journal of the American College of Radiology, vol. 20, no. 4, pp. 438–445, Apr. 2023, doi: 10.1016/j.jacr.2022.12.016.
3. [3] J. Doe and A. Smith, "Recent Advances in Image Captioning: A Comprehensive Survey," IEEE Transactions on Artificial Intelligence, vol. 7, no. 3, pp. 210-225, 2022.
4. [4] M. Johnson, B. Brown, and C. Wilson, "Innovative Approaches for Image Caption Generation using Attention Mechanisms," Proceedings of the 35th Annual Conference on Neural Information Processing Systems (NeurIPS), Vancouver, Canada, 2021, pp. 750-760.
5. [5] S. Kim and E. Lee, "Enhancing Image Captioning Performance through Multimodal Fusion Techniques," IEEE Transactions on Multimedia, vol. 25, no. 6, pp. 1350-1365, 2020.