A Lightweight Approach to Localization for Blind and Visually Impaired Travelers
Author:
Crabb Ryan1ORCID, Cheraghi Seyed Ali1ORCID, Coughlan James M.1ORCID
Affiliation:
1. Rehabilitation Engineering Research Center (RERC) on Blindness and Low Vision, Smith-Kettlewell Eye Research Institute, San Francisco, CA 94115-1813, USA
Abstract
Independent wayfinding is a major challenge for blind and visually impaired (BVI) travelers. Although GPS-based localization approaches enable the use of navigation smartphone apps that provide accessible turn-by-turn directions in outdoor settings, such approaches are ineffective in indoor and other GPS-deprived settings. We build on our previous work on a localization algorithm based on computer vision and inertial sensing; the algorithm is lightweight in that it requires only a 2D floor plan of the environment, annotated with the locations of visual landmarks and points of interest, instead of a detailed 3D model (used in many computer vision localization algorithms), and requires no new physical infrastructure (such as Bluetooth beacons). The algorithm can serve as the foundation for a wayfinding app that runs on a smartphone; crucially, the approach is fully accessible because it does not require the user to aim the camera at specific visual targets, which would be problematic for BVI users who may not be able to see these targets. In this work, we improve upon the existing algorithm so as to incorporate recognition of multiple classes of visual landmarks to facilitate effective localization, and demonstrate empirically how localization performance improves as the number of these classes increases, showing the time to correct localization can be decreased by 51–59%. The source code for our algorithm and associated data used for our analyses have been made available in a free repository.
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference32 articles.
1. A state-of-the-art survey of indoor positioning and navigation systems and technologies;Sakpere;S. Afr. Comput. J.,2017 2. Wayfinding Tools for People With Visual Impairments in Real-World Settings: A Literature Review of Recent Studies;Parker;Front. Educ.,2021 3. Presti, G., Ahmetovic, D., Ducci, M., Bernareggi, C., Ludovico, L., Baratè, A., Avanzini, F., and Mascetti, S. (2019, January 28–30). WatchOut: Obstacle sonification for people with visual impairment or blindness. Proceedings of the The 21st International ACM SIGACCESS Conference on Computers and Accessibility, Pittsburgh, PA, USA. 4. Fusco, G., and Coughlan, J.M. (2020, January 20–21). Indoor Localization for Visually Impaired Travelers Using Computer Vision on a Smartphone. Proceedings of the 17th International Web for All Conference, Taipei, Taiwan. 5. Ahmetovic, D., Gleason, C., Ruan, C., Kitani, K., Takagi, H., and Asakawa, C. (2016, January 6–9). NavCog: A navigational cognitive assistant for the blind. Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, Florence, Italy.
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|