Abstract
Unmanned underwater operations using remotely operated vehicles or unmanned surface vehicles are increasing in recent times, and this guarantees human safety and work efficiency. Optical cameras and multi-beam sonars are generally used as imaging sensors in underwater environments. However, the obtained underwater images are difficult to understand intuitively, owing to noise and distortion. In this study, we developed an optical and sonar image fusion system that integrates the color and distance information from two different images. The enhanced optical and sonar images were fused using calibrated transformation matrices, and the underwater image quality measure (UIQM) and underwater color image quality evaluation (UCIQE) were used as metrics to evaluate the performance of the proposed system. Compared with the original underwater image, image fusion increased the mean UIQM and UCIQE by 94% and 27%, respectively. The contrast-to-noise ratio was increased six times after applying the median filter and gamma correction. The fused image in sonar image coordinates showed qualitatively good spatial agreement and the average IoU was 75% between the optical and sonar pixels in the fused images. The optical-sonar fusion system will help to visualize and understand well underwater situations with color and distance information for unmanned works.
Funder
National Research Foundation of Korea
Ministry of Oceans and Fisheries
Korea Institute of Ocean Science and Technology
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference29 articles.
1. Mobley, C.D., and Mobley, C.D. Light and Water: Radiative Transfer in Natural Waters, 1994.
2. Blondel, P. The Handbook of Sidescan Sonar, 2010.
3. Visual enhancement of underwater images using empirical mode decomposition;Çelebi;Expert Syst. Appl.,2012
4. Hitam, M.S., Awalludin, E.A., Yussof, W.N.J.H.W., and Bachok, Z. Mixture contrast limited adaptive histogram equalization for underwater image enhancement. Proceedings of the 2013 International conference on computer applications technology (ICCAT).
5. Color balance and fusion for underwater image enhancement;Ancuti;IEEE Trans. Image Process.,2017
Cited by
6 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献