Author:
Lo Chung-Ming,Wang Chi-Cheng,Hung Peng-Hsiang
Abstract
Abstract
Objective. Recognizing the most relevant seven organs in an abdominal computed tomography (CT) slice requires sophisticated knowledge. This study proposed automatically extracting relevant features and applying them in a content-based image retrieval (CBIR) system to provide similar evidence for clinical use. Approach. A total of 2827 abdominal CT slices, including 638 liver, 450 stomach, 229 pancreas, 442 spleen, 362 right kidney, 424 left kidney and 282 gallbladder tissues, were collected to evaluate the proposed CBIR in the present study. Upon fine-tuning, high-level features used to automatically interpret the differences among the seven organs were extracted via deep learning architectures, including DenseNet, Vision Transformer (ViT), and Swin Transformer v2 (SwinViT). Three images with different annotations were employed in the classification and query. Main results. The resulting performances included the classification accuracy (94%–99%) and retrieval result (0.98–0.99). Considering global features and multiple resolutions, SwinViT performed better than ViT. ViT also benefited from a better receptive field to outperform DenseNet. Additionally, the use of hole images can obtain almost perfect results regardless of which deep learning architectures are used. Significance. The experiment showed that using pretrained deep learning architectures and fine-tuning with enough data can achieve successful recognition of seven abdominal organs. The CBIR system can provide more convincing evidence for recognizing abdominal organs via similarity measurements, which could lead to additional possibilities in clinical practice.
Funder
National Science and Technology Council in Taiwan
Reference38 articles.
1. Content-based medical image retrieval system for lung diseases using deep CNNs;Agrawal;International Journal of Information Technology,2022
2. Fully convolutional neural networks improve abdominal organ segmentation;Bobo,2018
3. Deep learning for instance retrieval: A survey;Chen;IEEE Trans. Pattern Anal. Mach. Intell.,2022
4. Local features integration for content-based image retrieval based on color, texture, and shape;Ghahremani;Multimedia Tools Appl.,2021