Building Detection from SkySat Images with Transfer Learning: a Case Study over Ankara

Abstract

AbstractThe detection and continuous updating of buildings in geodatabases has long been a major research area in geographic information science and is an important theme for national mapping agencies. Advancements in machine learning techniques, particularly state-of-the-art deep learning (DL) models, offer promising solutions for extracting and modeling building rooftops from images. However, tasks such as automatic labelling of learning data and the generalizability of models remain challenging. In this study, we assessed the sensor and geographic area adaptation capabilities of a pretrained DL model implemented in the ArcGIS environment using very-high-resolution (50 cm) SkySat imagery. The model was trained for digitizing building footprints via Mask R‑CNN with a ResNet50 backbone using aerial and satellite images from parts of the USA. Here, we utilized images from three different SkySat satellites with various acquisition dates and off-nadir angles and refined the pretrained model using small numbers of buildings as training data (5–53 buildings) over Ankara. We evaluated the buildings in areas with different characteristics, such as urban transformation, slums, regular, and obtained high accuracies with F‑1 scores of 0.92, 0.94, and 0.96 from SkySat 4, 7, and 17, respectively. The study findings showed that the DL model has high transfer learning capability for Ankara using only a few buildings and that the recent SkySat satellites demonstrate superior image quality.