Development of a Remote-Controlled Drone System by Using Only Eye Movements: Design of a Control Screen Considering Operability and Microsaccades

Author:

Kogawa Atsunori, ,Onda Moeko,Kai Yoshihiro

Abstract

In recent years, the number of bedridden patients, including amyotrophic lateral sclerosis (ALS) patients, has been increasing with the aging of the population, owing to advances in medical and long-term care technology. Eye movements are physical functions that are relatively difficult to be affected, even if the symptoms of ALS progress. Focusing on this point, in this paper, in order to improve the quality of life (QOL) of bedridden patients, including ALS patients, we propose a drone system connected to the Internet that can be remotely controlled using only their eyes. In order to control the drone by using only their eyes, a control screen and an eye-tracking device were used in this system. By using this system, for example, the patients in New York can operate the drone in Kyoto using only their eyes, enjoy the scenery, and talk with people in Kyoto. In this drone system, since a time delay could occur depending on the Internet usage environment, agile operation is required for remotely controlling the drone. Therefore, we introduce the design of the control screen focused on remote control operability and human eye movements (microsaccades). Furthermore, considering the widespread future use of this system, it is desirable to use a commercial drone. Accordingly, we describe the design of a joystick control device to physically control the joysticks of various drone controllers. Finally, we present experimental results to verify the effectiveness of this system, including the control screen and the joystick control device.

Funder

Pfizer Health Research Foundation

Publisher

Fuji Technology Press Ltd.

Subject

Electrical and Electronic Engineering,General Computer Science

Reference28 articles.

1. K. Mizoguchi, K. Chida, Y. Sonoda, T. Mori, I. Funakawa, K. Yorimoto, K. Uekawa, and T. Yuasa, “A New Framework and Social Support for Patients with Amyotrophic Lateral Sclerosis Expected Role for the National Hospital Organization,” Japanese J. of National Medical Services, Vol.61, No.7, pp. 490-500, doi: 10.11261/iryo1946.61.490, 2007 (in Japanese).

2. Cabinet Office, “Reiwa 1st Edition White Paper on Ageing Society,” Nikkei Printing Inc., 2019 (in Japanese).

3. H. Kato, R. Hashimoto, T. Ogawa, and A. Tagawa, “Activity report on the occasion of the 10th anniversary of the center for intractable neurological diseases,” Int. University of Health and Welfare, Vol.19, No.1, pp. 16-23, 2014 (in Japanese).

4. T. Matsumaru, K. Hagiwara, and T. Ito, “Examination on the combination control of manual operation and autonomous motion for teleoperation of mobile robot using a software simulation,” Trans. of the Society of Instrument and Control Engineers, Vol.41, No.2, pp. 157-166, doi: 10.9746/sicetr1965.41.157, 2005 (in Japanese).

5. Y. Matsuo, O. Yukumoto, M. Suzuki, K. Aburata, and M. Sugimoto, “Development of Remote Control System for Farm Vehicle,” J. of the Japanese Society of Agricultural Machinery, Vol.58, No.Supplement, pp. 459-462, doi: 10.11357/jsam1937.58.Supplement_459, 1996 (in Japanese).

Cited by 7 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3