The Design and Control of a Biomimetic Binocular Cooperative Perception System Inspired by the Eye Gaze Mechanism
-
Published:2024-01-24
Issue:2
Volume:9
Page:69
-
ISSN:2313-7673
-
Container-title:Biomimetics
-
language:en
-
Short-container-title:Biomimetics
Author:
Qin Xufang1, Xia Xiaohua1ORCID, Ge Zhaokai1, Liu Yanhao2, Yue Pengju1
Affiliation:
1. Key Laboratory of Road Construction Technology and Equipment of MOE, Chang’an University, Xi’an 710064, China 2. TianQin Research Center for Gravitational Physics and School of Physics and Astronomy, Sun Yat-sen University (Zhuhai Campus), Zhuhai 519082, China
Abstract
Research on systems that imitate the gaze function of human eyes is valuable for the development of humanoid eye intelligent perception. However, the existing systems have some limitations, including the redundancy of servo motors, a lack of camera position adjustment components, and the absence of interest-point-driven binocular cooperative motion-control strategies. In response to these challenges, a novel biomimetic binocular cooperative perception system (BBCPS) was designed and its control was realized. Inspired by the gaze mechanism of human eyes, we designed a simple and flexible biomimetic binocular cooperative perception device (BBCPD). Based on a dynamic analysis, the BBCPD was assembled according to the principle of symmetrical distribution around the center. This enhances braking performance and reduces operating energy consumption, as evidenced by the simulation results. Moreover, we crafted an initial position calibration technique that allows for the calibration and adjustment of the camera pose and servo motor zero-position, to ensure that the state of the BBCPD matches the subsequent control method. Following this, a control method for the BBCPS was developed, combining interest point detection with a motion-control strategy. Specifically, we propose a binocular interest-point extraction method based on frequency-tuned and template-matching algorithms for perceiving interest points. To move an interest point to a principal point, we present a binocular cooperative motion-control strategy. The rotation angles of servo motors were calculated based on the pixel difference between the principal point and the interest point, and PID-controlled servo motors were driven in parallel. Finally, real experiments validated the control performance of the BBCPS, demonstrating that the gaze error was less than three pixels.
Funder
National Natural Science Foundation of China Shaanxi Province Qin Chuangyuan Program—Innovative and Entrepreneurial Talents Project Scientific Research Project of the Department of Transport of Shaanxi Province
Reference56 articles.
1. Gaze Estimation by Exploring Two-Eye Asymmetry;Cheng;IEEE Trans. Image Process.,2020 2. Grotz, M., Habra, T., Ronsse, R., and Asfour, T. (2017, January 24–28). Autonomous View Selection and Gaze Stabilization for Humanoid Robots. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada. 3. Pateromichelakis, N., Mazel, A., Hache, M.A., Koumpogiannis, T., Gelin, R., Maisonnier, B., and Berthoz, A. (2014, January 14–18). Head-eyes system and gaze analysis of the humanoid robot Romeo. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Chicago, IL, USA. 4. Mutual gaze with a robot affects human neural activity and delays decision-making processes;Belkaid;Sci. Robot.,2021 5. Saran, A., Majumdar, S., Short, E.S., Thomaz, A., and Niekum, S. (2018, January 1–5). Human Gaze Following for Human-Robot Interaction. Proceedings of the 25th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.
|
|