Fusion Siamese network with drift correction for target tracking in ultrasound sequences
-
Published:2022-02-18
Issue:4
Volume:67
Page:045018
-
ISSN:0031-9155
-
Container-title:Physics in Medicine & Biology
-
language:
-
Short-container-title:Phys. Med. Biol.
Author:
Wu Chan,Fu Tianyu,Wang Yifan,Lin Yucong,Wang Yan,Ai Danni,Fan Jingfan,Song Hong,Yang Jian
Abstract
Abstract
Motion tracking techniques can revise the bias arising from respiration-caused motion in radiation therapy. Tracking key structures accurately and at a real-time speed is necessary for effective motion tracking. In this work, we propose a fusion Siamese network with drift correction for target tracking in ultrasound sequences. Specifically, the network fuses four response maps generated by the cross-correlation between convolution layers at different resolutions to reduce up-sampling error. A correction strategy combining local structural similarity and target trajectory is proposed to revise the target drift predicted by the network. Moreover, a coarse-to-fine strategy is proposed to train the network with a limited number of annotated images, in which an augmented dataset is generated by corner points to learn network features with high generalizability. The proposed method is evaluated on the basis of the public dataset of the MICCAI 2015 Challenge on Liver UltraSound Tracking (CLUST) and our ultrasound image dataset, which is provided by the Chinese People’s Liberation Army General Hospital (CPLAGH). A tracking error of 0.80 ± 1.16 mm is observed for 85 targets across 39 ultrasound sequences in the CLUST dataset. A tracking error of 0.61 ± 0.36 mm is observed for 20 targets across 10 ultrasound sequences in the CPLAGH dataset. The effectiveness of the proposed fusion and correction strategies is verified via two ablation experiments. Overall, the experimental results demonstrate the effectiveness of the proposed fusion Siamese network with drift correction and reveal its potential in clinical practice.
Funder
National Natural Science Foundation of China
Beijing Institute of Technology Research Fund Program for Young Scholars
Subject
Radiology, Nuclear Medicine and imaging,Radiological and Ultrasound Technology
Reference31 articles.
1. Robust liver ultrasound tracking using dense distinctive image features;Andre,2015
2. Fully-Convolutional Siamese Networks for Object Tracking
3. An upgraded siamese neural network for motion tracking in ultrasound image sequences;Bharadwaj;IEEE Trans. Ultrason., Ferroelectr., Freq. Control,2021
4. Semi-Supervised Breast Lesion Detection in Ultrasound Video Based on Temporal Coherence;Chen;arXiv e-prints,2019
5. Liver ultrasound tracking using a learned distance metric;Daniel,2015
Cited by
6 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献