Hyperspectral imaging-based cutaneous wound classification using neighbourhood extraction 3D convolutional neural network

Abstract

Abstract Objectives Hyperspectral imaging is an emerging imaging modality that beginning to gain attention for medical research and has an important potential in clinical applications. Nowadays, spectral imaging modalities such as multispectral and hyperspectral have proven their ability to provide important information that can help to better characterize the wound. Oxygenation changes in the wounded tissue differ from normal tissue. This causes the spectral characteristics to be different. In this study, it is classified cutaneous wounds with neighbourhood extraction 3-dimensional convolutional neural network method. Methods The methodology of hyperspectral imaging performed to obtain the most useful information about the wounded and normal tissue is explained in detail. When the hyperspectral signatures of wounded and normal tissues are compared on the hyperspectral image, it is revealed that there is a relative difference between them. By taking advantage of these differences, cuboids that also consider neighbouring pixels are generated, and a uniquely designed 3-dimensional convolutional neural network model is trained with the cuboids to extract both spatial and spectral information. Results The effectiveness of the proposed method was evaluated for different cuboid spatial dimensions and training/testing rates. The best result with 99.69% was achieved when the training/testing rate was 0.9/0.1 and the cuboid spatial dimension was 17. It is observed that the proposed method outperforms the 2-dimensional convolutional neural network method and achieves high accuracy even with much less training data. The obtained results using the neighbourhood extraction 3-dimensional convolutional neural network method show that the proposed method highly classifies the wounded area. In addition, the classification performance and the2computation time of the neighbourhood extraction 3-dimensional convolutional neural network methodology were analyzed and compared with existing 2-dimensional convolutional neural network. Conclusions As a clinical diagnostic tool, hyperspectral imaging, with neighbourhood extraction 3-dimensional convolutional neural network, has yielded remarkable results for the classification of wounded and normal tissues. Skin color does not play any role in the success of the proposed method. Since only the reflectance values of the spectral signatures are different for various skin colors. For different ethnic groups, The spectral signatures of wounded tissue and the spectral signatures of normal tissue show similar spectral characteristics among themselves.