Affiliation:
1. The Faculty of Engineering, Department of Physical Electronics, Tel Aviv University, Tel Aviv 69978, Israel
Abstract
This work demonstrates a novel, state-of-the-art method to reconstruct colored images via the dynamic vision sensor (DVS). The DVS is an image sensor that indicates only a binary change in brightness, with no information about the captured wavelength (color) or intensity level. However, the reconstruction of the scene’s color could be essential for many tasks in computer vision and DVS. We present a novel method for reconstructing a full spatial resolution, colored image utilizing the DVS and an active colored light source. We analyze the DVS response and present two reconstruction algorithms: linear-based and convolutional-neural-network-based. Our two presented methods reconstruct the colored image with high quality, and they do not suffer from any spatial resolution degradation as other methods. In addition, we demonstrate the robustness of our algorithm to changes in environmental conditions, such as illumination and distance. Finally, compared with previous works, we show how we reach the state-of-the-art results. We share our code on GitHub.
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference38 articles.
1. Advances on CMOS image sensors;Gouveia;Sens. Rev.,2016
2. A 128 × 128 120 dB 15 μs Latency Asynchronous Temporal Contrast Vision Sensor;Lichtsteiner;IEEE J. Solid-State Circuits,2008
3. Wang, Y., Du, B., Shen, Y., Wu, K., Zhao, G., Sun, J., and Wen, H. (2019, January 15–20). EV-Gait: Event-Based Robust Gait Recognition Using Dynamic Vision Sensors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.
4. Implementing neural architectures using analog VLSI circuits;Maher;IEEE Trans. Circuits Syst.,1989
5. Neuromorphic electronic systems;Mead;Proc. IEEE,1990