Towards an intelligent personal assistant for hearing impaired people

Abstract

This work has been focused on the part of the population with hearing impairment who owns a dog and that worries about not listening the dog barks, specially when a risky situation is taking place at home. A survey was carried out on people with deafness problems to find out hazard situations which they are exposed at home. A system prototype was developed to be integrated as a component of ambient intelligence (AmI) for ambient assisted living (AAL) that serves to Hearing Impaired People (HIP). The prototype detects dog barks and notifies users through both a smart mobile app and a visual feedback. It consists of a connection between a Raspberry Pi 3 card and a ReSpeaker Mic Array v2.0 microphone array; a communication module with a smartphone was implemented, which displays written messages or vibrations when receiving notifications. The cylinder-shaped device was designed by the authors and sent it to 3D print with a resin material. The prototype recognized the barking efficiently by using a machine learning model based on Support Vector Machine technique. The prototype was tested with deaf people which were satisfied with precision, signal intensity, and activation of lights.