Abstract
The process of fusing the rich spectral information of a low spatial resolution hyperspectral image (LR-HSI) with the spatial information of a high spatial resolution multispectral image (HR-MSI) to obtain an HSI with the spatial resolution of an MSI image is called hyperspectral image fusion (HIF). To reconstruct hyperspectral images at video frame rate, we propose a lightweight multi-level information network (MINet) for multispectral and hyperspectral image fusion. Specifically, we develop a novel lightweight feature fusion model, namely residual constraint block based on global variance fine-tuning (GVF-RCB), to complete the feature extraction and fusion of hyperspectral images. Further, we define a residual activity factor to judge the learning ability of the residual module, thereby verifying the effectiveness of GVF-RCB. In addition, we use cascade cross-level fusion to embed the different spectral bands of the upsampled LR-HSI in a progressive manner to compensate for lost spectral information at different levels and to maintain spatial high frequency information at all times. Experiments on different datasets show that our MINet outperforms the state-of-the-art methods in terms of objective metrics, in particular by requiring only 30% of the running time and 20% of the number of parameters.
Funder
Natural National Science Foundation of China
National Defense Basic Scientific Research Program of China
Science and Technology Plan of Xi’an
Fundamental Research Funds for the Central Universities of China
National Key Research and Development Project of China
Subject
General Earth and Planetary Sciences
Reference68 articles.
1. Hyperspectral Remote Sensing Data Analysis and Future Challenges;Bioucas-Dias;IEEE Geosci. Remote Sens. Mag.,2013
2. Modern Trends in Hyperspectral Image Analysis: A Review;Khan;IEEE Access,2018
3. Taskesen, B., Koz, A., Alatan, A., and Weatherbee, O. Change Detection for Hyperspectral Images Using Extended Mutual Information and Oversegmentation. Proceedings of the 2018 9th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).
4. Low rank and collaborative representation for hyperspectral anomaly detection via robust dictionary construction;Hs;ISPRS J. Photogramm. Remote Sens.,2020
5. Unsupervised Spatial–Spectral Feature Learning by 3D Convolutional Autoencoder for Hyperspectral Classification;Mei;IEEE Trans. Geosci. Remote Sens.,2019