Author:
Khor WeeLiam,Chen Yichen Kelly,Roberts Michael,Ciampa Francesco
Abstract
AbstractThis paper presents a study on the effectiveness of a convolutional neural network (CNN) in classifying infrared images for security scanning. Infrared thermography was explored as a non-invasive security scanner for stand-off and walk-through concealed object detection. Heat generated by human subjects radiates off the clothing surface, allowing detection by an infrared camera. However, infrared lacks in penetration capability compared to longer electromagnetic waves, leading to less obvious visuals on the clothing surface. ResNet-50 was used as the CNN model to automate the classification process of thermal images. The ImageNet database was used to pre-train the model, which was further fine-tuned using infrared images obtained from experiments. Four image pre-processing approaches were explored, i.e., raw infrared image, subject cropped region-of-interest (ROI) image, K-means, and Fuzzy-c clustered images. All these approaches were evaluated using the receiver operating characteristic curve on an internal holdout set, with an area-under-the-curve of 0.8923, 0.9256, 0.9485, and 0.9669 for the raw image, ROI cropped, K-means, and Fuzzy-c models, respectively. The CNN models trained using various image pre-processing approaches suggest that the prediction performance can be improved by the removal of non-decision relevant information and the visual highlighting of features.
Funder
Defence and Security Accelerator
Publisher
Springer Science and Business Media LLC
Reference60 articles.
1. National Research Council. Existing and Potential Standoff Explosives Detection Techniques (National Research Council, 2004). https://doi.org/10.17226/10998.
2. Cheng, Y., Wang, Y., Niu, Y. & Zhao, Z. Concealed object enhancement using multi-polarization information for passive millimeter and terahertz wave security screening. Opt. Express 28, 6350–6366. https://doi.org/10.1364/OE.384029 (2020).
3. Kastek, M., Kowalski, M., Polakowski, H., Lagueux, P. & Gagnon, M.-A. Passive signatures concealed objects recorded by multispectral and hyperspectral systems in visible, infrared and terahertz range. Vol. 9082 SID (SPIE, 2014).
4. Kukutsu, N. & Kado, Y. Overview of millimeter and terahertz wave application research. NTT Tech. Rev. 7, 6 (2009).
5. Akçay, S., Kundegorski, M. E., Devereux, M. & Breckon, T. P. in 2016 IEEE International Conference on Image Processing (ICIP). 1057–1061.