Affiliation:
1. Department of Computer Science and Engineering, Sri Sivasubramaniya Nadar College of Engineering, Kalavakkam, India
Abstract
Recent technological developments and improvement in the medical domain demands advancement, to address the issue of early disease detection. Also, the current pandemic has resulted in considerable progress of improvement in the medical domain, through online consultation by physicians for different diseases using clinical reports and medical images. A similar process is adopted in developing a Visual Question Answering (VQA) system in the medical field. In this paper, existing medical VQA datasets, appropriate techniques, suitable quantitative metrics, real time challenges and, the implementation of one VQA approach with algorithms and performance evaluation are discussed. The medical VQA datasets collected from multiple sources are represented in different perspectives (organwise, planewise, modality-type and abnormality-type) for a better understanding and visualization. Then the techniques used in VQA are subsequently grouped and explained, based on evolution, complexity in the dataset and the need for semantics in understanding the questions. In addition, the implementation of a VQA approach using VGGNet and LSTM is carried out for existing and improved datasets, and analyzed with accuracy and BLEU score metrics. The improved datasets, created through dataset reduction and augmentation approaches, resulted in better performance than the existing datasets. Finally, the challenges of the medical VQA domain are examined in terms of datasets, combining techniques, and modifying the parameters of existing performance metrics for future research.
Subject
Artificial Intelligence,General Engineering,Statistics and Probability
Reference7 articles.
1. Optimal deep neural network-based model for answering visual medical question;Gasmi;Cybernetics and Systems,2022
2. A Dataset of Clinically Generated Visual Questions and Answers about Radiology Images;Lau;Scientific Data,2018
3. BPI-MVQA: a bi-branch model for medical visual question answering;Liu;BMC Medical Imaging,2022
4. Medical visual question answering based on question-type reasoning and semantic space constraint;Wang;Artificial Intelligence in Medicine,2022
5. Consistency-Preserving Visual Question Answering in Medical Imaging;Tascon-Morales;International Conference on Medical Image Computing and Computer-Assisted Intervention,2022
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献