A Smart System using Hand Gestures and Voice

Abstract

Human-Computer Interaction (HCI) grew enormously over the years. Hand gesture recognition technology brought a brand-new era to the artificial intelligence branch of human-computer interaction. Hand Gesture-based communication is one of the most effortless and natural methods. Identifying and interpreting hand gestures from a continuous sequential stream of input data is called gesture recognition. Amateur or aged people find it hard to identify and press the exact alphabet that they need. Overcoming this difficulty stands as the ultimate goal for our proposed system. Typing has taken many forms, first using a keyboard, gradually changing to touch screens, and now too much easier finger motion tracking systems. The gesture is made by the user is detected by the machine via the image processing techniques and the operation unique to the machine is carried out, thereby minimizing the requirement of any hardware input device. This paper proposes a virtually controlled system that uses hand gestures and voice to perform operations. The system will allow the user to manage cursor, keyboard, and writing functions using hand gestures, and also provides the user with an additional feature to convert the user’s voice to text. The proposed system utilizes a webcam as an input device. This application will add a brand-new era of HCI implementation for educational purposes.