Author:
Jung Sukwoo,Lee Youn-Sung,Lee Yunju,Lee KyungTaek
Abstract
Depth sensing is an important issue in many applications, such as Augmented Reality (AR), eXtended Reality (XR), and Metaverse. For 3D reconstruction, a depth map can be acquired by a stereo camera and a Time-of-Flight (ToF) sensor. We used both sensors complementarily to improve the accuracy of 3D information of the data. First, we applied a generalized multi-camera calibration method that uses both color and depth information. Next, depth maps of two sensors were fused by 3D registration and reprojection approach. Then, hole-filling was applied to refine the new depth map from the ToF-stereo fused data. Finally, the surface reconstruction technique was used to generate mesh data from the ToF-stereo fused pointcloud data. The proposed procedure was implemented and tested with real-world data and compared with various algorithms to validate its efficiency.
Funder
Ministry of Science and Information & Communication Technology
Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea Government
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference22 articles.
1. A probabilistic approach to ToF and stereo data fusion;Mutto;3D Data Process. Vis. Transm.,2010
2. Jung, S., Cho, Y., Kim, D., and Chang, M. Moving Object Detection from Moving Camera Image Sequences Using an Inertial Measurement Unit Sensor. Appl. Sci., 2020. 10.
3. Moving object detection with single moving camera and IMU sensor using Mask R-CNN instance image segmentation;Jung;Int. J. Precis. Eng. Manuf.,2021
4. Marin, G., Zanuttigh, P., and Mattoccia, S. Reliable fusion of ToF and stereo depth driven by confidence measure. European Conference on Computer Vision, 2016.
5. Agresti, G., Minto, L., Marin, G., and Zanuttigh, P. Deep learning for confidence information in stereo and ToF data fusion. Proceedings of the International Conference on Computer Vision Workshops (ICCVW).
Cited by
8 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献