Robust structured light 3D imaging with two fringe patterns using recurrent classification neural network

Abstract

Abstract Robust and accurate 3D reconstruction using a limited number of fringe patterns has posed a challenge in the field of structured light 3D imaging. Unlike traditional approaches that rely on multiple fringe patterns, using only one or two patterns makes phase recovery and unwrapping difficult. To address this issue, a recurrent classification neural network (RCNN) has been developed, transforming the phase recovery and unwrapping tasks into a unified phase classification task. First, a training dataset consisting of 1200 groups of data was collected to generate a total of 38 400 training samples, enabling the RCNN to learn the mapping between the input fringe patterns and the corresponding label maps. Then, based on the well-trained network, a label map is generated based on the input two fringe patterns using the output classification results. Finally, 3D reconstruction data could be obtained by combining the inferred label map with the vision system’s parameters. A series of comprehensive experiments have been conducted to validate the performance of the proposed method.