Effective Communication Between Differently Abled And Normal People Using Speech To Sign Translation System

Abstract

There are very less way of communicating between a differently abled person i.e. deaf and dumb also called as hearing impaired and normal people. Communications from deaf and dumb to normal people are done in many ways but from normal people to hearing impaired people have not been much. What we say cannot be understood by the deaf and dumb people so a system should be made so that a deaf and dumb person can understand the voice of normal people. The voice will be converted to sign language so that deaf and dumb people can easily understand. Machine learning techniques will be used to implement this with the help of Google API for voice recognition and then the Natural Language Processing is used. The voice will be broken into sentences or words and then the context of natural language processing will come into picture. The text will be compared with the gifs generated, if found the gifs will be shown as output or else letter by letter mapping will be done so the hearing impaired people can understand the voice through sign language. This is very important for the hearing impaired people. This helps hearing impaired people a lot because they can easily understand what the normal people are telling and for their daily life it will be very helpful. The system is tested with the number of data samples. As data samples increases, the accuracy of the model is said to have gone up as well.