3D far-field Lidar sensing and computational modeling for human identification

Abstract

3D sensors offer depth sensing that may be used for task-specific data processing and computational modeling. Many existing methods for human identification using 3D depth sensors primarily focus on Kinect data, where the range is very limited. This work considers a 3D long-range Lidar sensor for far-field imaging of human subjects in 3D Lidar full motion video (FMV) of “walking” action. 3D Lidar FMV data for human subjects are used to develop computational modeling for automated human silhouette and skeleton extraction followed by subject identification. We propose a matrix completion algorithm to handle missing data in 3D FMV due to self-occlusion and occlusion from other subjects for 3D skeleton extraction. We further study the effect of noise in the 3D low resolution far-field Lidar data in human silhouette extraction performance of the model. Moreover, this work addresses challenges associated with far-field 3D Lidar including learning with a limited amount of data and low resolution. Moreover, we evaluate the proposed computational algorithm using a gallery of 10 subjects for human identification and show that our method is competitive with the state-of-the-art OpenPose and V2VPose skeleton extraction models using the same dataset for human identification.