Speech and touch enhanced interface for visually impaired users

Abstract

Purpose – This paper presents a novel interface system to aid people with visual impairment to become proficient with operating unfamiliar devices. The system works by adding touch sensors that trigger audio tags to tactile controls. The touch sensors trigger the audio tags before the control is activated. Design/methodology/approach – The paper describes how several devices were enhanced with the new technology, tested and evaluated. Initial informational interviewing with visually impaired people was followed by user studies with blindfolded but visually able people. A final evaluation of the system was conducted by a visually impaired group. Findings – This paper shows that the technology is of benefit to a visually impaired user when using a complex unfamiliar device. Originality/value – This novel application of touch sensors coupled with audio tags has the potential to benefit visually impaired people. This technology can easily be incorporated into commercial devices. The idea can also be implemented using off the shelf development boards coupled with smart phones.