Fake Colorized Image Detection Based on Special Image Representation and Transfer Learning

Abstract

Nowadays, images have become one of the most popular forms of communication as image editing tools have evolved. Image manipulation, particularly image colorization, has become easier, making it harder to differentiate between fake colorized images and actual images. Furthermore, the RGB space is no longer considered to be the best option for color-based detection techniques due to the high correlation between channels and its blending of luminance and chrominance information. This paper proposes a new approach for fake colorized image detection based on a novel image representation created by combining color information from three separate color spaces (HSV, Lab, and Ycbcr) and selecting the most different channels from each color space to reconstruct the image. Features from the proposed image representation are extracted based on transfer learning using the pre-trained CNNs ResNet50 model. The Support Vector Machine (SVM) approach has been used for classification purposes due to its high ability for generalization. Our experiments indicate that our proposed models outperform other state-of-the-art fake colorized image detection methods in several aspects.