Virtual Assistant With Sign Language

Abstract

This topic is all about developing a successful Sign language recognition and translation system which is helpful for people with certain disabilities who can’t use present voice enabled Virtual Assistants. Communication is important with people as it helps us understand them and gain knowledge. In case of Deaf & mute people, this becomes a problem. It is solved by creating a virtual assistant built to recognize hand gestures and translate them in normal language to perform tasks ordered by the user. This certainly helps other normal people to successfully communicate with deaf & mute people Without worrying about any misunderstanding at the listener’s end. There are more than 300 sign languages used by various cultural groups worldwide. In this article, we provide a technique for generating a sign language dataset using a camera, followed by the training of a TensorFlow model using transfer learning to produce a real-time sign language recognition system. Despite the small amount of the dataset, the system still performs well.