Study on Servo Control Method of Eye Movement Intention Based on Reinforcement Learning

Abstract

Abstract Eye movement servo control has the advantage of non-contact and the eye movement is not affected by other limbs. By applying eye-tracking technology to rehabilitation research of people with movement disorders, the interaction between eye-tracking technology and computers will be gradually put into practice, which is equivalent to giving patients a pair of “invisible hands” that can give instructions freely. In this paper, a servo control method based on eye-movement coding technology is proposed to solve the problems of low accuracy, poor reliability, and insufficient human intention initiative in the field of eye-movement servo control of human-computer visual interaction. The human eye movement instruction is processed by coding and integrated with human eye movement intention to realize intelligent servo control of human eye intention. In order to improve the accuracy of eye movement servo control, this paper proposes an eye movement instruction coding processing method, which uses the trained AdaBoost fusion strong classifier algorithm and the landmark detector to detect the real-time algorithm in the video sequence to complete the eye location and blink determination. In this paper, an improved pupil location method based on multi-angle joint detection is proposed. The pupil location is completed by using the information of eye image points, and the digital coding model of eye command action is constructed, which provides an instruction base for eye movement servo control. In order to improve the reliability and initiative of eye-movement servo control, a reinforcement learning method combining eye-movement coded instruction and intention was proposed. By integrating the improved DDPG continuous control strategy reinforcement learning algorithm with eye movement intention instruction, the environmental status can be sensed in the human-computer interaction process and the optimal strategy of eye movement instruction selection can be learned.