Affiliation:
1. Department of Computer Science, University of Calgary, Calgary, AB T2N 1N4, Canada
Abstract
Cloud cover and shadows often hinder the accurate analysis of satellite images, impacting various applications, such as digital farming, land monitoring, environmental assessment, and urban planning. This paper presents a new approach to enhancing cloud-contaminated satellite images using a novel variational model for approximating the combination of the temporal and spatial components of satellite imagery. Leveraging this model, we derive two spatial-temporal methods containing an algorithm that computes the missing or contaminated data in cloudy images using the seamless Poisson blending method. In the first method, we extend the Poisson blending method to compute the spatial-temporal approximation. The pixel-wise temporal approximation is used as a guiding vector field for Poisson blending. In the second method, we use the rate of change in the temporal domain to divide the missing region into low-variation and high-variation sub-regions to better guide Poisson blending. In our second method, we provide a more general case by introducing a variation-based method that considers the temporal variation in specific regions to further refine the spatial–temporal approximation. The proposed methods have the same complexity as conventional methods, which is linear in the number of pixels in the region of interest. Our comprehensive evaluation demonstrates the effectiveness of the proposed methods through quantitative metrics, including the Root Mean Square Error (RMSE), Peak Signal-to-Noise Ratio (PSNR), and Structural Similarity Index Metric (SSIM), revealing significant improvements over existing approaches. Additionally, the evaluations offer insights into how to choose between our first and second methods for specific scenarios. This consideration takes into account the temporal and spatial resolutions, as well as the scale and extent of the missing data.
Funder
Mathematics of Information Technology and Complex Systems
Natural Sciences and Engineering Research Council of Canada
Reference69 articles.
1. Time series of remote sensing data for land change science;Lambin;IEEE Trans. Geosci. Remote Sens.,2006
2. Simoes, R., Camara, G., Queiroz, G., Souza, F., Andrade, P.R., Santos, L., Carvalho, A., and Ferreira, K. (2021). Satellite Image Time Series Analysis for Big Earth Observation Data. Remote Sens., 13.
3. Poisson image editing;Gangnet;Acm Trans. Graph.,2003
4. Poisson Image Editing;Facciolo;Image Process. Line,2016
5. Pérez, P., Gangnet, M., and Blake, A. (2023). Poisson Image Editing. Seminal Graphics Papers: Pushing the Boundaries, Volume 2, Association for Computing Machinery. [1st ed.].