A wearable assistive system for the visually impaired using object detection, distance measurement and tactile presentation

Abstract

With the current development of society, ensuring traffic and walking safety for the visually impaired is becoming increasingly important. We propose a wearable system based on a system previously developed by us that uses object recognition, a distance measurement function, and the corresponding vibration pattern presentation to support the mobility of the visually impaired. The system recognizes obstacles in front of a user in real time, measures their distances, processes the information, and then presents safety actions through vibration patterns from a tactile glove woven with shape memory alloy (SMA) actuators. The deep learning model is compressed to achieve real-time recognition using a microcomputer while maintaining recognition accuracy. Measurements of the distances to multiple objects are realized using a stereo camera, and vibration patterns are presented through a tactile glove in response to these distances. Experiments are conducted to verify the system performance to provide safe navigation depending on the positions and the distances of multiple obstacles in front of the user.