Content-Based Medical Image Retrieval using Deep Learning and Handcrafted features in Dimensionality Reduction framework

Author:

Singh Mona1,Singh Manoj Kumar1

Affiliation:

1. Banaras Hindu University

Abstract

Abstract

Content-based medical image retrieval (CBMIR) is an approach utilized for extracting pertinent medical images from extensive databases by focusing on their visual attributes instead of relying on textual information. This method entails examining the visual qualities of medical images, including texture, shape, intensity, and spatial relationships, in order to detect resemblances and patterns. In this study, the analysis focuses on six prominent low-level handcrafted feature techniques and eight transfer learning with pre-trained deep learning models for extracting features for CBMIR systems. Image indexing is crucial in CBMIR systems, particularly with high-dimensional data and the extremely sparse distribution of original data called the 'curse of dimensionality' problem. To address such problem, we use Principal Component Analysis (PCA) and t-Distributed Stochastic Neighbor Embedding (t-SNE) for dimensionality reduction. This experiments are performed on two benchmark datasets: Medical MNIST and KVASIR. For Medical MNIST datasets, handcrafted features are effective for distinct texture characteristics that are easily discernible to the human eye, however deep learning approaches are necessary for datasets with smaller shapes, sizes, and textures, like KVASIR dataset to minimize the semantic gap. The performance of the feature based techniques is evaluated using metrics: Precision, Recall, and F1-score. The handcrafted technique with t-SNE maintains constant performance with maximum 99.89% fewer dimensions compared to the full-featured technique. And with KVASIR dataset, using DCNN architecture with t-SNE, we achieve a maximum dimensionality reduction of 75% while maintaining consistent results.

Publisher

Springer Science and Business Media LLC

Reference48 articles.

1. Müller H (2020), June Medical image retrieval: Applications and resources. In Proceedings of the 2020 International Conference on Multimedia Retrieval (pp. 2–3)

2. RetrieveNet: a novel deep network for medical image retrieval;Hussain CA;Evol Intel,2021

3. Ponciano-Silva M, Souza JP, Bugatti PH, Bedo MV, Kaster DS, Braga RT, Traina AJ (2013), June Does a CBIR system really impact decisions of physicians in a clinical environment? In Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems (pp. 41–46). IEEE

4. A hybrid approach towards content-based image retrieval for colored images using enhanced first type of pessimistic covering based lower approximation multi-granular rough sets;Raghavan R;Evol Intell,2021

5. Content-based image retrieval at the end of the early years;Smeulders AWM;IEEE Trans Pattern Anal Mach Intell,2000

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3