High Frequency Component Enhancement Network for Image Manipulation Detection
-
Published:2024-01-21
Issue:2
Volume:13
Page:447
-
ISSN:2079-9292
-
Container-title:Electronics
-
language:en
-
Short-container-title:Electronics
Author:
Pan Wenyan1, Ma Wentao2ORCID, Wu Xiaoqian2, Liu Wei3ORCID
Affiliation:
1. School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing 210044, China 2. Anhui Provincial Engineering Research Center for Agricultural Information Perception and Intelligent Computing, School of Information and Artificial Intelligence, Anhui Agricultural University, Hefei 230036, China 3. School of Management Science and Engineering, Anhui University of Finance & Economics, Bengbu 233030, China
Abstract
With the support of deep neural networks, the existing image manipulation detection (IMD) methods can detect manipulated regions within a suspicious image effectively. In general, manipulation operations (e.g., splicing, copy-move, and removal) tend to leave manipulation artifacts in the high-frequency domain of the image, which provides rich clues for locating manipulated regions. Inspired by this phenomenon, in this paper, we propose a High-Frequency Component Enhancement Network, short for HFCE-Net, for image manipulation detection, which aims to fully explore the manipulation artifacts left in the high-frequency domain to improve the localization performance in IMD tasks. Specifically, the HFCE-Net consists of two parallel branches, i.e., the main stream and high-frequency auxiliary branch (HFAB). The HFAB is introduced to fully explore high-frequency artifacts within manipulated images. To achieve this goal, the input image of the HFAB is filtered out of the low-frequency component by the Sobel filter. Furthermore, the HFEB is supervised with the edge information of the manipulated regions. The main stream branch takes the RGB image as input, and aggregates the features learned from the HFAB by the proposed multi-layer fusion (MLF) in a hierarchical manner. We conduct extensive experiments on widely used benchmarks, and the results demonstrate that our HFCE-Net exhibits a strong ability to capture high-frequency information within the manipulated image. Moreover, the proposed HFCE-Net achieves comparable performance (57.3%, 90.9%, and 73.8% F1 on CASIA, NIST, and Coverage datasets) and achieves 1.9%, 9.0%, and 1.5% improvement over the existing method.
Funder
National Natural Science Foundation of China
Reference34 articles.
1. Zhou, P., Han, X., Morariu, V.I., and Davis, L.S. (2018, January 18–23). Learning rich features for image manipulation detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA. 2. Constrained convolutional neural networks: A new approach towards general purpose image manipulation detection;Bayar;IEEE Trans. Inf. Forensics Secur.,2018 3. Wu, Y., AbdAlmageed, W., and Natarajan, P. (2019, January 15–20). Mantra-net: Manipulation tracing network for detection and localization of image forgeries with anomalous features. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA. 4. Zhou, P., Chen, B.C., Han, X., Najibi, M., Shrivastava, A., Lim, S.N., and Davis, L. (2020, January 7–12). Generate, segment, and refine: Towards generic manipulation segmentation. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA. 5. Chen, X., Dong, C., Ji, J., Cao, J., and Li, X. (2021, January 11–17). Image manipulation detection by multi-view multi-scale supervision. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.
|
|