Abstract
Currently, the use of 3D point clouds is rapidly increasing in many engineering fields, such as geoscience and manufacturing. Various studies have developed intelligent segmentation models providing accurate results, while only a few of them provide additional insights into the efficiency and robustness of their proposed models. The process of segmentation in the image domain has been studied to a great extent and the research findings are tremendous. However, the segmentation analysis with point clouds is considered particularly challenging due to their unordered and irregular nature. Additionally, solving downstream tasks with 3D point clouds is computationally inefficient, as point clouds normally consist of thousands or millions of points sparsely distributed in 3D space. Thus, there is a significant need for rigorous evaluation of the design characteristics of segmentation models, to be effective and practical. Consequently, in this paper, an in-depth analysis of five fundamental and representative deep learning models for 3D point cloud segmentation is presented. Specifically, we investigate multiple experimental dimensions, such as accuracy, efficiency, and robustness in part segmentation (ShapeNet) and scene segmentation (S3DIS), to assess the effective utilization of the models. Moreover, we create a correspondence between their design properties and experimental properties. For example, we show that convolution-based models that incorporate adaptive weight or position pooling local aggregation operations achieve superior accuracy and robustness to point-wise MLPs, while the latter ones show higher efficiency in time and memory allocation. Our findings pave the way for an effective 3D point cloud segmentation model selection and enlighten the research on point clouds and deep learning.
Funder
European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement
Subject
General Earth and Planetary Sciences
Reference55 articles.
1. Automated Evaluation of Semantic Segmentation Robustness for Autonomous Driving;Zhou;IEEE Trans. Intell. Transp. Syst.,2020
2. Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review;Cui;IEEE Trans. Intell. Transp. Syst.,2022
3. Bello, S.A., Yu, S., Wang, C., Adam, J.M., and Li, J. (2020). Review: Deep Learning on 3D Point Clouds. Remote Sens., 12.
4. Semantic Segmentation of Terrestrial Laser Scanning Point Clouds Using Locally Enhanced Image-Based Geometric Representations;Cai;IEEE Trans. Geosci. Remote. Sens.,2022
5. Automatic region-growing system for the segmentation of large point clouds;Poux;Autom. Constr.,2022