Affiliation:
1. State Key Laboratory of Millimeter Waves School of Information Science and Engineering Southeast University Nanjing 210096 China
2. Institute of Electromagnetic Space Southeast University Nanjing 210096 China
Abstract
AbstractHand gesture plays an important role in many circumstances, which is one of the most common interactive methods in daily life, especially for disabled people. Human–machine interaction is another popular research topic to realize direct and efficient control, making machines intelligent and maneuverable. Here, a special human–machine interaction system is proposed and namedas computer‐vision (CV) based gesture‐metasurface interaction (GMI) system, which can be used for both direct beam manipulations and real‐time wireless communications. The GMI system first needs to select its working mode according to the gesture command to determine whether to perform beam manipulations or wireless communications, and then validate the permission for further operation by recognizing unlocking gesture to ensure security. Both beam manipulation and wireless communication functions are validated experimentally, which show that the GMI system can not only realize real‐time switching and remote control of different beams through gesture command, but also communicate with a remote computer in real time by translating the gesture language to text message. The proposed non‐contact GMI system has the advantages of good interactivity, high flexibility, and multiple functions, which can find potential applications in community security, gesture‐command smart home, barrier‐free communications, and so on.
Funder
National Natural Science Foundation of China
National Key Research and Development Program of China
Natural Science Foundation of Jiangsu Province
Fundamental Research Funds for the Central Universities
Subject
General Physics and Astronomy,General Engineering,Biochemistry, Genetics and Molecular Biology (miscellaneous),General Materials Science,General Chemical Engineering,Medicine (miscellaneous)