Best Scanline Determination of Pushbroom Images for a Direct Object to Image Space Transformation Using Multilayer Perceptron

Abstract

Working with pushbroom imagery in photogrammetry and remote sensing presents a fundamental challenge in object-to-image space transformation. For this transformation, accurate estimation of Exterior Orientation Parameters (EOPs) for each scanline is required. To tackle this challenge, Best Scanline Search or Determination (BSS/BSD) methods have been developed. However, the current BSS/BSD methods are not efficient for real-time applications due to their complex procedures and interpolations. This paper introduces a new non-iterative BSD method specifically designed for line-type pushbroom images. The method involves simulating a pair of sets of points, Simulated Control Points (SCOPs), and Simulated Check Points (SCPs), to train and test a Multilayer Perceptron (MLP) model. The model establishes a strong relationship between object and image spaces, enabling a direct transformation and determination of best scanlines. This proposed method does not rely on the Collinearity Equation (CE) or iterative search. After training, the MLP model is applied to the SCPs for accuracy assessment. The proposed method is tested on ten images with diverse landscapes captured by eight sensors, exploiting five million SCPs per image for statistical assessments. The Root Mean Square Error (RMSE) values range between 0.001 and 0.015 pixels across ten images, demonstrating the capability of achieving the desired sub-pixel accuracy within a few seconds. The proposed method is compared with conventional and state-of-the-art BSS/BSD methods, indicating its higher applicability regarding accuracy and computational efficiency. These results position the proposed BSD method as a practical solution for transforming object-to-image space, especially for real-time applications.