Affiliation:
1. Knight Foundation School of Computing and Information Sciences (KFSCIS), Florida International University, 11200 SW 8th St CASE 352, Miami, FL 33199, USA
Abstract
Generative models have recently gained popularity in remote sensing, offering substantial benefits for interpreting and utilizing satellite imagery across diverse applications such as climate monitoring, urban planning, and wildfire detection. These models are particularly adept at addressing the challenges posed by satellite images, which often exhibit domain variability due to seasonal changes, sensor characteristics, and, especially, variations in spectral bands. Such variability can significantly impact model performance across various tasks. In response to these challenges, our work introduces an adaptive approach that harnesses the capabilities of generative adversarial networks (GANs), augmented with contrastive learning, to generate target domain images that account for multispectral band variations effectively. By maximizing mutual information between corresponding patches and leveraging the power of GANs, our model aims to generate realistic-looking images across different multispectral domains. We present a comparative analysis of our model against other well-established generative models, demonstrating its efficacy in generating high-quality satellite images while effectively managing domain variations inherent to multispectral diversity.
Funder
National Science Foundation
Reference39 articles.
1. Multisensor image fusion and enhancement in spectral total variation domain;Zhao;IEEE Trans. Multimed.,2017
2. Laborte, A.G., Maunahan, A.A., and Hijmans, R.J. (2010). Spectral signature generalization and expansion can improve the accuracy of satellite image classification. PLoS ONE, 5.
3. Toldo, M., Maracani, A., Michieli, U., and Zanuttigh, P. (2020). Unsupervised domain adaptation in semantic segmentation: A review. Technologies, 8.
4. Domain-adapted convolutional networks for satellite image classification: A large-scale interactive learning workflow;Lunga;IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.,2018
5. Farahani, A., Voghoei, S., Rasheed, K., and Arabnia, H.R. (2021). Advances in Data Science and Information Engineering, Springer.