Affiliation:
1. Department of Electrical Engineering, Zhejiang University, Hangzhou 310027, China
Abstract
Deep-Learning-based (DL-based) approaches have achieved remarkable performance in hyperspectral image (HSI) change detection (CD). Convolutional Neural Networks (CNNs) are often employed to capture fine spatial features, but they do not effectively exploit the spectral sequence information. Furthermore, existing Siamese-based networks ignore the interaction of change information during feature extraction. To address this issue, we propose a novel architecture, the Spectral–Temporal Transformer (STT), which processes the HSI CD task from a completely sequential perspective. The STT concatenates feature embeddings in spectral order, establishing a global spectrum–time-receptive field that can learn different representative features between two bands regardless of spectral or temporal distance, thereby strengthening the learning of temporal change information. Via the multi-head self-attention mechanism, the STT is capable of capturing spectral–temporal features that are weighted and enriched with discriminative sequence information, such as inter-spectral correlations, variations, and time dependency. We conducted experiments on three HSI datasets, demonstrating the competitive performance of our proposed method. Specifically, the overall accuracy of the STT outperforms the second-best method by 0.08%, 0.68%, and 0.99% on the Farmland, Hermiston, and River datasets, respectively.
Funder
the National Nature Science Foundation of China under Grant
Subject
General Earth and Planetary Sciences
Reference55 articles.
1. Borana, S., Yadav, S., and Parihar, S. (2019, January 18–19). Hyperspectral Data Analysis for Arid Vegetation Species: Smart & Sustainable Growth. Proceedings of the 2019 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS), Greater Noida, India.
2. Multiview Subspace Learning for Hyperspectral Anomalous Change Detection;Chang;IEEE Trans. Geosci. Remote Sens.,2022
3. Feature Extraction and Change Detection Using Multitemporal Landsat Imagery;Rokni;Remote Sens.,2014
4. Hyperspectral Anomaly Change Detection Based on Autoencoder;Hu;IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens.,2021
5. Automatic Analysis of the Difference Image for Unsupervised Change Detection;Bruzzone;IEEE Trans. Geosci. Remote Sens.,2000
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献