Multiscale feature fusion network for 3D head MRI image registration

Abstract

AbstractBackgroundImage registration technology has become an important medical image preprocessing step with the wide application of computer‐aided diagnosis technology in various medical image analysis tasks.PurposeWe propose a multiscale feature fusion registration based on deep learning to achieve the accurate registration and fusion of head magnetic resonance imaging (MRI) and solve the problem that general registration methods cannot handle the complex spatial information and position information of head MRI.MethodsOur proposed multiscale feature fusion registration network consists of three sequentially trained modules. The first is an affine registration module that implements affine transformation; the second is to realize non‐rigid transformation, a deformable registration module composed of top‐down and bottom‐up feature fusion subnetworks in parallel; and the third is a deformable registration module that also realizes non‐rigid transformation and is composed of two feature fusion subnetworks in series. The network decomposes the deformation field of large displacement into multiple deformation fields of small displacement by multiscale registration and registration, which reduces the difficulty of registration. Moreover, multiscale information in head MRI is learned in a targeted manner, which improves the registration accuracy, by connecting the two feature fusion subnetworks.ResultsWe used 29 3D head MRIs for training and seven volumes for testing and calculated the values of the registration evaluation metrics for the new algorithm to register anterior and posterior lateral pterygoid muscles. The Dice similarity coefficient was 0.745 ± 0.021, the Hausdorff distance was 3.441 ± 0.935 mm, the Average surface distance was 0.738 ± 0.098 mm, and the Standard deviation of the Jacobian matrix was 0.425 ± 0.043. Our new algorithm achieved a higher registration accuracy compared with state‐of‐the‐art registration methods.ConclusionsOur proposed multiscale feature fusion registration network can realize end‐to‐end deformable registration of 3D head MRI, which can effectively cope with the characteristics of large deformation displacement and the rich details of head images and provide reliable technical support for the diagnosis and analysis of head diseases.