High speed neuromorphic vision-based inspection of countersinks in automated manufacturing processes
-
Published:2023-08-18
Issue:
Volume:
Page:
-
ISSN:0956-5515
-
Container-title:Journal of Intelligent Manufacturing
-
language:en
-
Short-container-title:J Intell Manuf
Author:
Salah MohammedORCID, Ayyad Abdulla, Ramadan Mohammed, Abdulrahman Yusra, Swart Dewald, Abusafieh Abdelqader, Seneviratne Lakmal, Zweiri Yahya
Abstract
AbstractCountersink inspection is crucial in various automated assembly lines, especially in the aerospace and automotive sectors. Advancements in machine vision introduced automated robotic inspection of countersinks using laser scanners and monocular cameras. Nevertheless, the aforementioned sensing pipelines require the robot to pause on each hole for inspection due to high latency and measurement uncertainties with motion, leading to prolonged execution times of the inspection task. The neuromorphic vision sensor, on the other hand, has the potential to expedite the countersink inspection process, but the unorthodox output of the neuromorphic technology prohibits utilizing traditional image processing techniques. Therefore, novel event-based perception algorithms need to be introduced. We propose a countersink detection approach on the basis of event-based motion compensation and the mean-shift clustering principle. In addition, our framework presents a robust event-based circle detection algorithm to precisely estimate the depth of the countersink specimens. The proposed approach expedites the inspection process by a factor of 10$$\times $$
×
compared to conventional countersink inspection methods. The work in this paper was validated for over 50 trials on three countersink workpiece variants. The experimental results show that our method provides a standard deviation of 0.025 mm and an accuracy of 0.026 mm for countersink depth inspection despite the low resolution of commercially available neuromorphic cameras. Video Link: https://www.dropbox.com/s/pateqqwh4d605t3/final_video_new.mp4?dl=0.
Funder
STRATA Manufacturing PJSC Khalifa University of Science, Technology and Research Sandooq Al Watan
Publisher
Springer Science and Business Media LLC
Subject
Artificial Intelligence,Industrial and Manufacturing Engineering,Software
Reference41 articles.
1. Abdul Hay, O., Chehadeh, M., Ayyad, A., Wahbah, M., Humais, M., & Zweiri, Y. (2021). Unified identification and tuning approach using deep neural networks for visual servoing applications. arXiv:2107.01581. 2. Akinlar, C., & Tonal, C. (2012). Edcircles: Real-time circle detection by edge drawing. In 2012 IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp. 1309–1312). 3. Ayyad, A., Halwani, M., Swart, D., Muthusamy, R., Almaskari, F., & Zweiri, Y. (2023). Neuromorphic vision based control for the precise positioning of robotic drilling systems. Robotics and Computer-Integrated Manufacturing, 79, 102419. 4. Bertrand, J., Yiǧit, A., & Durand, S. (2020). Embedded event-based visual odometry. In 2020 6th international conference on event-based control, communication, and signal processing (EBCCSP) (pp. 1–8). 5. Burghardt, A., Kurc, K., Szybicki, D., Muszyńska, M., & Szczęch, T. (2017). Robot-operated inspection of aircraft engine turbine rotor guide vane segment geometry. Technical Gazette, 24(2), 345–348.
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|