Author:
Saleem Muhammad Rakeh,Mayne Robert,Napolitano Rebecca
Abstract
AbstractThis work seeks to capture how an expert interacts with a structure during a facade inspection so that more detailed and situationally-aware inspections can be done with autonomous robots in the future. Eye tracking maps where an inspector is looking during a structural inspection, and it recognizes implicit human attention. Experiments were performed on a facade during a damage assessment to analyze key, visually-based features that are important for understanding human-infrastructure interaction during the process. For data collection and analysis, experiments were conducted to assess an inspector’s behavioral changes while assessing a real structure. These eye tracking features provided the basis for the inspector’s intent prediction and were used to understand how humans interact with the structure during the inspection processes. This method will facilitate information-sharing and decision-making during the inspection processes for collaborative human-robot teams; thus, it will enable unmanned aerial vehicle (UAV) for future building inspection through artificial intelligence support.
Funder
National Science Foundation
Publisher
Springer Science and Business Media LLC
Reference33 articles.
1. Weseman, W. A. The Recording and Coding Guide for the Structure Inventory and Appraisal of the Nations Bridges (U.S. Dep. Transp. Fed. Highw, Adm, 1995).
2. Council, N. R. et al. National earthquake resilience-research implementation and outreach. National Earthquake Resilience (2011).
3. Federal Emergency Management Agency (FEMA). Post-disaster Building Safety Evaluation Guidance. Tech. Rep., Applied Technology Council (ATC), Washington, D.C. (2019).
4. Hallermann, N. & Morgenthal, G. Visual inspection strategies for large bridges using unmanned aerial vehicles (uav). In Proceedings of the 7th International Conference of Bridge Maintenance, Safety and Management, IABMAS 661–667, https://doi.org/10.1201/B17063-96 (2014).
5. Mascareñas, D. D. et al. Augmented reality for next generation infrastructure inspections. Struct. Heal. Monit. 20, 1957–1979. https://doi.org/10.1177/1475921720953846 (2020).