A Review of Natural-Language-Instructed Robot Execution Systems
Author:
Liu Rui1ORCID, Guo Yibei1, Jin Runxiang1, Zhang Xiaoli2
Affiliation:
1. Cognitive Robotics and AI Lab (CRAI), College of Aeronautics and Engineering, Kent State University, Kent, OH 44240, USA 2. Intelligent Robotics and Systems Lab, Department of Mechanical Engineering, Colorado School of Mines, Golden, CO 80401, USA
Abstract
It is natural and efficient to use human natural language (NL) directly to instruct robot task executions without prior user knowledge of instruction patterns. Currently, NL-instructed robot execution (NLexe) is employed in various robotic scenarios, including manufacturing, daily assistance, and health caregiving. It is imperative to summarize the current NLexe systems and discuss future development trends to provide valuable insights for upcoming NLexe research. This review categorizes NLexe systems into four types based on the robot’s cognition level during task execution: NL-based execution control systems, NL-based execution training systems, NL-based interactive execution systems, and NL-based social execution systems. For each type of NLexe system, typical application scenarios with advantages, disadvantages, and open problems are introduced. Then, typical implementation methods and future research trends of NLexe systems are discussed to guide the future NLexe research.
Reference276 articles.
1. Baraglia, J., Cakmak, M., Nagai, Y., Rao, R., and Asada, M. (2016, January 7–10). Initiative in robot assistance during collaborative task execution. Proceedings of the 11th IEEE International Conference on Human Robot Interaction, Christchurch, New Zealand. 2. Gemignani, G., Bastianelli, E., and Nardi, D. (2015, January 4–8). Teaching robots parametrized executable plans through spoken interaction. Proceedings of the 2015 International Conference on Autonomous Agents and Multi-Agent Systems, Istanbul, Turkey. 3. Brooks, D.J., Lignos, C., Finucane, C., Medvedev, M.S., Perera, I., Raman, V., Kress-Gazit, H., Marcus, M., and Yanco, H.A. (2012, January 22–26). Make it so: Continuous, flexible natural language interaction with an autonomous robot. Proceedings of the AAAI Conference on Artificial Intelligence, Toronto, ON, Canada. 4. Fong, T., Thorpe, C., and Baur, C. (2003). Collaboration, Dialogue, Human-Robot Interaction. Robotics Research, Springer. 5. Robust control of force-coupled human–robot-interaction in assembly processes;Surdilovic;CIRP Ann.-Manuf. Technol.,2008
|
|