Remote Sensing Image Fusion Based on Morphological Convolutional Neural Networks with Information Entropy for Optimal Scale
Author:
Jia Bairu,
Xu JindongORCID,
Xing Haihua,
Wu Peng
Abstract
Remote sensing image fusion is a fundamental issue in the field of remote sensing. In this paper, we propose a remote sensing image fusion method based on optimal scale morphological convolutional neural networks (CNN) using the principle of entropy from information theory. We use an attentional CNN to fuse the optimal cartoon and texture components of the original images to obtain a high-resolution multispectral image. We obtain the cartoon and texture components using sparse decomposition-morphological component analysis (MCA) with an optimal threshold value determined by calculating the information entropy of the fused image. In the sparse decomposition process, the local discrete cosine transform dictionary and the curvelet transform dictionary compose the MCA dictionary. We sparsely decompose the original remote sensing images into a texture component and a cartoon component at an optimal scale using the information entropy to control the dictionary parameter. Experimental results show that the remote sensing image fusion method proposed in this paper can effectively retain the information of the original image, improve the spatial resolution and spectral fidelity, and provide a new idea for image fusion from the perspective of multi-morphological deep learning.
Funder
National Natural Science Foundation of China
Natural Science Foundation of Shandong
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference35 articles.
1. PGMAN: An unsupervised generative multiadversarial network for pansharpening;Zhou;IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens.,2021
2. A new adaptive component-substitution-based satellite image fusion by using partial replacement;Choi;IEEE Trans. Geosci. Remote Sens.,2011
3. An efficient pan-sharpening method via a combined adaptive PCA approach and contourlets;Shah;IEEE Trans. Geosci. Remote Sens.,2008
4. Pansharpening based on semiblind deconvolution;Vivone;IEEE Trans. Geosci. Remote Sens.,2015
5. Self-supervised pansharpening based on a cycle-consistent generative adversarial network;Li;IEEE Trans. Image Process.,2022