Affiliation:
1. Department of Computer Science, School of Science, Loughborough University, Loughborough LE11 3TT, UK
2. Department of Physics, School of Science, Loughborough University, Loughborough LE11 3TT, UK
3. Railston & Co., Ltd., Nottingham NG7 2TU, UK
Abstract
Image retrieval is the process of searching and retrieving images from a datastore based on their visual content and features. Recently, much attention has been directed towards the retrieval of irregular patterns within industrial or healthcare images by extracting features from the images, such as deep features, colour-based features, shape-based features, and local features. This has applications across a spectrum of industries, including fault inspection, disease diagnosis, and maintenance prediction. This paper proposes an image retrieval framework to search for images containing similar irregular patterns by extracting a set of morphological features (DefChars) from images. The datasets employed in this paper contain wind turbine blade images with defects, chest computerised tomography scans with COVID-19 infections, heatsink images with defects, and lake ice images. The proposed framework was evaluated with different feature extraction methods (DefChars, resized raw image, local binary pattern, and scale-invariant feature transforms) and distance metrics to determine the most efficient parameters in terms of retrieval performance across datasets. The retrieval results show that the proposed framework using the DefChars and the Manhattan distance metric achieves a mean average precision of 80% and a low standard deviation of ±0.09 across classes of irregular patterns, outperforming alternative feature–metric combinations across all datasets. Our proposed ImR framework performed better (by 8.71%) than Super Global, a state-of-the-art deep-learning-based image retrieval approach across all datasets.
Funder
School of Science at Loughborough University
Subject
Electrical and Electronic Engineering,Computer Graphics and Computer-Aided Design,Computer Vision and Pattern Recognition,Radiology, Nuclear Medicine and imaging
Reference87 articles.
1. Fundamentals and Applications of Image Retrieval: An Overview;Halawani;Datenbank-Spektrum,2006
2. Wafer Map Defect Pattern Classification and Image Retrieval Using Convolutional Neural Network;Nakazawa;IEEE Trans. Semicond. Manuf.,2018
3. Unsupervised defect detection algorithm for printed fabrics using content-based image retrieval techniques;Hu;Text. Res. J.,2021
4. Liu, P., and El-Gohary, N. (2020, January 8–10). Semantic Image Retrieval and Clustering for Supporting Domain-Specific Bridge Component and Defect Classification. Proceedings of the Construction Research Congress 2020, Tempe, AZ, USA.
5. Content-based medical image retrieval system for lung diseases using deep CNNs;Agrawal;Int. J. Inf. Technol.,2022