Incorporation of Human Facial Expression Into Robot Control

Abstract

An amusement robot that can recognize and respond to human facial expressions is proposed. The integration of human facial recognition into the control systems of robots is necessary to improve their entertainment value. We are proposing a new technology that uses a camera to read and respond to human facial expressions. As the preliminary research, a portable bubble ejection robot, which produces soap bubbles like a fountain, has been fabricated. The ejected soap bubbles are illuminated by LEDs and the direction of the ejection nozzle and the amount of the ejected bubbles are controlled by using an Android tablet. Subsequently, human facial expressions are read by a facial expression detection system. This paper will explain the design of the bubble ejection robot, its control system, which reads human facial expressions, and the experimental results of human reaction to the bubble ejection. Consequently, the relationship between the soap bubble ejection and the human emotions is revealed.