Affiliation:
1. School of Automation, Chengdu University of Information Technology, Chengdu 610225, China
Abstract
An artificial compound eye consists of multiple apertures that allow for a large field of view (FOV) while maintaining a small size. Each aperture captures a sub-image, and multiple sub-images are needed to reconstruct the full FOV. The reconstruction process is depth-related due to the parallax between adjacent apertures. This paper presents an all-in-focus 3D reconstruction method for a specific type of artificial compound eye called the electronic cluster eye (eCley). The proposed method uses edge matching to address the edge blur and large textureless areas existing in the sub-images. First, edges are extracted from each sub-image, and then a matching operator is applied to match the edges based on their shape context and intensity. This produces a sparse matching result that is then propagated to the whole image. Next, a depth consistency check and refinement method is performed to refine the depth of all sub-images. Finally, the sub-images and depth maps are merged to produce the final all-in-focus image and depth map. The experimental results and comparative analysis demonstrate the effectiveness of the proposed method.
Funder
National Natural Science Foundation of China
Sichuan Science and Technology Program
Reference53 articles.
1. Thin wafer-level camera lenses inspired by insect compound eyes;Leitel;Opt. Express,2010
2. Development of ultra thin three-dimensional image capturing system;Yamada;Proceedings of the Three-Dimensional Image Capture and Applications VII,2006
3. Artificial compound eye: A survey of the state-of-the-art;Wu;Artif. Intell. Rev.,2017
4. Correcting distortion and braiding of micro-images from multi-aperture imaging systems;Wippermann;Proceedings of the Sensors, Cameras, and Systems for Industrial, Scientific, and Consumer Applications XII,2011
5. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms;Scharstein;Int. J. Comput. Vis.,2002