Semi‐supervised graph convolutional networks for the domain adaptive recognition of thyroid nodules in cross‐device ultrasound images

Abstract

AbstractBackgroundUltrasound plays a critical role in the early screening and diagnosis of cancers. Although deep neural networks have been widely investigated in the computer‐aided diagnosis (CAD) of different medical images, diverse ultrasound devices, and image modalities pose challenges for clinical applications, especially in the recognition of thyroid nodules having various shapes and sizes. More generalized and extensible methods need to be developed for the cross‐devices recognition of thyroid nodules.PurposeIn this work, a semi‐supervised graph convolutional deep learning framework is proposed for the domain adaptative recognition of thyroid nodules across several ultrasound devices. A deep classification network, trained on a source domain with a specific device, can be transferred to recognize thyroid nodules on the target domain with other devices, using only few manual annotated ultrasound images.MethodsThis study presents a semi‐supervised graph‐convolutional‐network‐based domain adaptation framework, namely Semi‐GCNs‐DA. Based on the ResNet backbone, it is extended in three aspects for domain adaptation, that is, graph convolutional networks (GCNs) for the connection construction between source and target domains, semi‐supervised GCNs for accurate target domain recognition, and pseudo labels for unlabeled target domains. Data were collected from 1498 patients comprising 12 108 images with or without thyroid nodules under three different ultrasound devices. Accuracy, Sensitivity and Specificity were used for the performance evaluation.ResultsThe proposed method was validated on six groups of data for a single source domain adaptation task, the mean Accuracy was 0.9719 ± 0.0023, 0.9928 ± 0.0022, 0.9353 ± 0.0105, 0.8727 ± 0.0021, 0.7596 ± 0.0045, 0.8482 ± 0.0092, which achieved better performance in comparison with the state‐of‐the‐art. The proposed method was also validated on three groups of multiple source domain adaptation tasks. In particular, when using X60 and HS50 as the source domain data, and H60 as the target domain, it can achieve the Accuracy of 0.8829 ± 0.0079, Sensitivity of 0.9757 ± 0.0001, and Specificity of 0.7894 ± 0.0164. Ablation experiments also demonstrated the effectiveness of the proposed modules.ConclusionThe developed Semi‐GCNs‐DA framework can effectively recognize thyroid nodules on different ultrasound devices. The developed semi‐supervised GCNs can be further extended to the domain adaptation problems for other modalities of medical images.