Abstract
We present a deep learning method used in conjunction with dual-modal microwave-ultrasound imaging to produce tomographic reconstructions of the complex-valued permittivity of numerical breast phantoms. We also assess tumor segmentation performance using the reconstructed permittivity as a feature. The contrast source inversion (CSI) technique is used to create the complex-permittivity images of the breast with ultrasound-derived tissue regions utilized as prior information. However, imaging artifacts make the detection of tumors difficult. To overcome this issue we train a convolutional neural network (CNN) that takes in, as input, the dual-modal CSI reconstruction and attempts to produce the true image of the complex tissue permittivity. The neural network consists of successive convolutional and downsampling layers, followed by successive deconvolutional and upsampling layers based on the U-Net architecture. To train the neural network, the input-output pairs consist of CSI’s dual-modal reconstructions, along with the true numerical phantom images from which the microwave scattered field was synthetically generated. The reconstructed permittivity images produced by the CNN show that the network is not only able to remove the artifacts that are typical of CSI reconstructions, but can also improve the detectability of tumors. The performance of the CNN is assessed using a four-fold cross-validation on our dataset that shows improvement over CSI both in terms of reconstruction error and tumor segmentation performance.
Funder
Canadian Cancer Society
Natural Sciences and Engineering Research Council of Canada
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Cited by
34 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. DiffusionEMIS: Diffusion Model for 3-D Electromagnetic Inverse Scattering;IEEE Transactions on Geoscience and Remote Sensing;2024
2. Training Universal Deep-Learning Networks for Electromagnetic Medical Imaging Using a Large Database of Randomized Objects;Sensors;2023-12-19
3. Segmentation Approach for Enhanced Biomedical Microwave Imaging;2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE);2023-10-25
4. Automated Workflow for Evaluating Microwave and Multi-Modality Breast Images;IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology;2023-09
5. A Multi-branch Deep Learning Architecture for Microwave-Ultrasound Breast Imaging;2023 XXXVth General Assembly and Scientific Symposium of the International Union of Radio Science (URSI GASS);2023-08-19