Underwater Unsupervised Stereo Matching Method Based on Semantic Attention
-
Published:2024-07-04
Issue:7
Volume:12
Page:1123
-
ISSN:2077-1312
-
Container-title:Journal of Marine Science and Engineering
-
language:en
-
Short-container-title:JMSE
Author:
Li Qing12ORCID, Wang Hongjian1ORCID, Xiao Yao1ORCID, Yang Hualong1, Chi Zhikang1ORCID, Dai Dongchen1
Affiliation:
1. College of Intelligent Systems Science and Engineering, Harbin Engineering University, Harbin 150001, China 2. College of Intelligent Science and Engineering, Yantai Nanshan University, Yantai 264000, China
Abstract
A stereo vision system provides important support for underwater robots to achieve autonomous navigation, obstacle avoidance, and precise operation in complex underwater environments. This article proposes an unsupervised underwater stereo matching method based on semantic attention. By combining deep learning and semantic information, it fills the challenge of insufficient training data, enhances the intelligence level of underwater robots, and promotes the progress of underwater scientific research and marine resource development. This article proposes an underwater unsupervised stereo matching method based on semantic attention, targeting the missing training supervised dataset for underwater stereo matching. An adaptive double quadtree semantic attention model for the initial estimation of semantic disparity is designed, and an unsupervised AWLED semantic loss function is proposed, which is more robust to noise and textureless regions. Through quantitative and qualitative evaluations in the underwater stereo matching dataset, it was found that D1 all decreased by 0.222, EPE decreased by 2.57, 3px error decreased by 1.53, and the runtime decreased by 7 ms. This article obtained advanced results.
Funder
National Science and Technology Innovation Special Zone Project National Key Laboratory of Underwater Robot Technology Fund a special program to guide high-level scientific research
Reference50 articles.
1. Kuppuswamy, R. (July, January 22). Method to Profile the Maintenance Needs of a Fleet of Rotating Machine Assets using Partial Discharge Data. Proceedings of the 2020 Electrical Insulation Conference (EIC), Knoxville, TN, USA. 2. Corti, N., Bonali, F.L., Pasquaré Mariotto, F., Tibaldi, A., Russo, E., Hjartardóttir, Á.R., Einarsson, P., Rigoni, V., and Bressan, S. (2021). Fracture Kinematics and Holocene Stress Field at the Krafla Rift, Northern Iceland. Geosciences, 11. 3. Hożyń, S., and Żak, B. (2021). Stereo Vision System for Vision-Based Control of Inspection-Class ROVs. Remote Sens., 13. 4. Gerlo, J., Kooijman, D.G., Wieling, I.W., Heirmans, R., and Vanlanduit, S. (2023). Seaweed Growth Monitoring with a Low-Cost Vision-Based System. Sensors, 23. 5. Zuo, Y., Guan, H., Duan, F., and Wu, T. (2023). A Light Field Full-Focus Image Feature Point Matching Method with an Improved ORB Algorithm. Sensors, 23.
|
|