Affiliation:
1. Engineering Product Development Pillar, Singapore University of Technology and Design (SUTD), Singapore 487372, Singapore
Abstract
An automated Condition Monitoring (CM) and real-time controlling framework is essential for outdoor mobile robots to ensure the robot’s health and operational safety. This work presents a novel Artificial Intelligence (AI)-enabled CM and vibrotactile haptic-feedback-based real-time control framework suitable for deploying mobile robots in dynamic outdoor environments. It encompasses two sections: developing a 1D Convolutional Neural Network (1D CNN) model for predicting system degradation and terrain flaws threshold classes and a vibrotactile haptic feedback system design enabling a remote operator to control the robot as per predicted class feedback in real-time. As vibration is an indicator of failure, we identified and separated system- and terrain-induced vibration threshold levels suitable for CM of outdoor robots into nine classes, namely Safe, moderately safe system-generated, and moderately safe terrain-induced affected by left, right, and both wheels, as well as severe classes such as unsafe system-generated and unsafe terrain-induced affected by left, right, and both wheels. The vibration-indicated data for each class are modelled based on two sensor data: an Inertial Measurement Unit (IMU) sensor for the change in linear and angular motion and a current sensor for the change in current consumption at each wheel motor. A wearable novel vibrotactile haptic feedback device architecture is presented with left and right vibration modules configured with unique haptic feedback patterns corresponding to each abnormal vibration threshold class. The proposed haptic-feedback-based CM framework and real-time remote controlling are validated with three field case studies using an in-house-developed outdoor robot, resulting in a threshold class prediction accuracy of 91.1% and an effectiveness that, by minimising the traversal through undesired terrain features, is four times better than the usual practice.
Funder
National Robotics Programme under its National Robotics Programme (NRP) BAU, Ermine III: Deployable Reconfigurable Robots
A*STAR
Subject
General Mathematics,Engineering (miscellaneous),Computer Science (miscellaneous)
Reference45 articles.
1. ABI Research (2023, January 10). Labor Shortages and Workplace Safety Concerns Propel Shipments of Outdoor Mobile Robots to 350,000 by 2030. Available online: https://www.abiresearch.com/press/labor-shortages-and-workplace-safety-concerns-propel-shipments-of-outdoor-mobile-robots-to-350000-by-2030/.
2. Outdoor scene understanding of mobile robot via multi-sensor information fusion;Zhang;J. Ind. Inf. Integr.,2022
3. Liang, Z., Fang, T., Dong, Z., and Li, J. (2021, January 15–17). An Accurate Visual Navigation Method for Wheeled Robot in Unstructured Outdoor Environment Based on Virtual Navigation Line. Proceedings of the International Conference on Image, Vision and Intelligent Systems (ICIVIS 2021), Changsha, China.
4. Dong, Y., Liu, S., Zhang, C., and Zhou, Q. (2022, January 27–31). Path Planning Research for Outdoor Mobile Robot. Proceedings of the 2022 12th International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), Jilin City, China.
5. A semantic SLAM-based dense mapping approach for large-scale dynamic outdoor environment;Yang;Measurement,2022