Copy-Move Forgery Detection and Localization Using Deep Learning

Abstract

Forgery detection is one of the challenging subjects in computer vision. Forgery is performed using image manipulation with editor tools. Image manipulation tries to change the concept of the image but preserves the integrity of the texture and structure of the image as much as possible. Images are used as evidence in some applications, so if the images are manipulated, they will not be reliable. The copy-move forgery is one of the simplest image manipulation methods. This method removes or inserts information into the image with the least clue by copying a part of the image and pasting it into other places of the same image. Recently, traditional (block-based and keypoint-based) and deep learning methods have been proposed to detect forgery images. Traditional methods include two main steps, feature extraction, and feature matching. Unlike the traditional methods, the deep learning method performs the forgery detection automatically by extracting hierarchical features directly from the data. This paper presents a deep learning method for forgery detection at both image and pixel levels. In this method, we used a pre-trained deep model with a global average pooling (GAP) layer instead of default fully connected layers to detect forgery. The GAP layer creates a good dependency between the feature maps and the classes. In pixel forgery detection, a visualization technique called heatmap activation is used in forgery images. This technique identifies parts of the image that are candidates for forgery. Then, the best candidate is selected and the location of the forgery is determined. The proposed method is performed on the CoMoFod and MICC datasets. The extensive experiments showed the satisfactory performance of the proposed method.