Recently, automata have become a research hott spot in various countries for a wide range of applications in areas such as security, entertainment, and industry. We designed a mobile robot which is based on gesture control with the focus on gesture interaction control which includes: gesture definition, hand gesture acquisition, hand gesture decoration, hand gesture pre-processing and hand pointer recognition in this paper.This paper uses a combination of qualitative analysis and quantitative research to study the mapping characteristics of gesture interactive decoration and its internal connection with user interaction behaviors by using a combination of theoretical analysis and situational experiments, which not only helps to understand the human-computer interaction decoration Complexity, it has important positive significance in theoretical discussion, research methods and experimental methods. The experiments show that the average recognition rate of the five gestures obtained in this paper reaches 92.5%. The robot can accurately recognize gestures and make corresponding actions