Automated evaluation of rheumatoid arthritis from hand radiographs using Machine Learning and deep learning techniques

Abstract

The aim and objectives of the study are as follows: (i) to implement automated patch-based classification of hand X-ray images using modified pre-trained convolutional neural network (CNN) models; (ii) to develop a customized CNN model for automated feature extraction and classification of hand X-ray images and to compare the performance of customized CNN models with non-linear and linear kernels; (iii) to construct the hand crafted feature fusion (SIFT+ Customized CNN features) and categorize the normal and RA using Machine Learning classifiers. The model was trained on 75 images (10,000 patches) of hand radiographs and tested using 25 images (500 patches) that were not included in the training set. The accuracy of the modified pre-trained model GoogLeNet was 89% and the proposed custom model three achieved an accuracy of 95%. The sensitivity and specificity of GoogLeNet were 84% and 90% respectively. The custom model three attained the sensitivity and specificity as 95% and 94% respectively. Furthermore, when compared to the features extracted (SIFT + CNN) from the customized models, the custom3 model outperformed well for the classification of RA compared to ML classifiers. Thus a custom CNN-based computer-aided diagnostic tool can be used as an effective method for the detection of RA.