Deep Multi-Modal Fusion Model for Identification of Eight Different Particles in Urinary Sediment

Author:

Tuncer Seda Arslan1ORCID,Çınar Ahmet1ORCID,Erkuş Merve1ORCID,Tuncer Taner1ORCID

Affiliation:

1. Firat University , Elâzığ , Turkey

Abstract

Abstract Urine sediment examination (USE) is an essential aspect in detecting urinary system diseases, and it is a prerequisite for diagnostic procedures. Urine images are complex, containing numerous particles, which makes a detailed analysis and interpretation challenging. It is crucial for both patients and medical professionals to conduct urine analysis automatically, quickly and inexpensively, without compromising reliability. In this paper, we present a deep multi-modal fusion system, commonly employed in artificial intelligence, capable of automatically distinguishing particles in urine sediment. To achieve this objective, we first created a new dataset comprising erythrocytes, leukocytes, yeast, epithelium, bacteria, crystals, cylinders, and other particles (such as sperm). The data were gathered from urinalysis requests made between July 2022 and September 2022 at the biochemistry laboratory of Fethi Sekin Medical Center Hospital. A dataset containing 8509 images was compiled using the Optika B293PLi microscope with trinocular brightfield. We propose a 5-step process for detecting particles in the dataset using a multi-modal fusion deep learning model: i) The obtained images were augmented by applying affine transformation. ii) To distinguish images, we opted for ResNet18 and ResNet50 models, which yielded high performance in medical data. iii) Feature vectors from both models were fused to generate more consistent, accurate, and useful particle features. iv) We employed ReliefF, Neighborhood Component Analysis (NCA), and Minimum-Redundancy Maximum-Relevancy (mRMR) feature selection methods, widely used to determine features that maximise particle discrimination success. v) In the final step, Support Vector Machine (SVM) was utilised to distinguish the particles. The results demonstrate that the highest accuracy value achieved is 98.54 % when employing the ReliefF algorithm. Contributions of the study include eliminating standardisation differences in manual microscopy, achieving high accuracy in particle discrimination, offering an artificial intelligence-based system applicable in laboratory environments, and providing the dataset as educational and practical material for biochemistry professionals.

Publisher

Walter de Gruyter GmbH

Reference33 articles.

1. X. Zhang, G. Chen, K. Saruta, and Y. Terata, “Detection and classification of RBCs and WBCs in urine analysis with deep network,” in ACHI 2018: The Eleventh International Conference on Advances in Computer-Human Interactions, 2018, pp. 194–198. [Online]. Available: https://personales.upv.es/thinkmind/dl/conferences/achi/achi_2018/achi_ 2018_10_30_20157.pdf

2. R. Kang, Y. Liang, C. Lian, and Y. Mao, “CNN-based automatic urinary particles recognition”, arXiv:1803.02699v1, 2018. [Online]. Available: https://www.academia.edu/83267226/CNN_Based_Automatic_Urinary_Particles_Recognition

3. T. Batur, E. Çokluk, S. Akyüz, B. Uçar, H.H. Alp, and Z. Huyut, “Diagnostic performance evaluation of complete urinalysis in the diagnosis of urinary tract infection: Complete urinalysis in the diagnosis of urinary tract infection,” Chronicles of Precision Medical Researchers, vol. 3, no. 2, pp. 52–56, 2022. https://doi.org/10.5281/zenodo.6965805

4. F. D. İnce, H. Y. Ellidağ, M. Koseoğlu, N. Şimşek, H. Yalçın, and M. O. Zengin, “The comparison of automated urine analyzers with manual microscopic examination for urinalysis automated urine analyzers and manual urinalysis,” Pract. Lab. Med., vol. 1, no. 5, pp. 14–20, Aug. 2016. https://doi.org/10.1016/j.plabm.2016.03.002

5. N. Sharda, O. Bakhtar, B. Thajudeen, E. Meister, and H. Szerlip, “Manual urine microscopy versus automated urine analyzer microscopy in patients with acute kidney injury,” Laboratory Medicine, vol. 45, no. 4, pp. e152– e155, Nov. 2014. https://doi.org/10.1309/LMVJK6W4KQL1ZHKS

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3