Coordinating Shared Tasks in Human-Robot Collaboration by Commands

Author:

Angleraud Alexandre,Mehman Sefat Amir,Netzev Metodi,Pieters Roel

Abstract

Human-robot collaboration is gaining more and more interest in industrial settings, as collaborative robots are considered safe and robot actions can be programmed easily by, for example, physical interaction. Despite this, robot programming mostly focuses on automated robot motions and interactive tasks or coordination between human and robot still requires additional developments. For example, the selection of which tasks or actions a robot should do next might not be known beforehand or might change at the last moment. Within a human-robot collaborative setting, the coordination of complex shared tasks, is therefore more suited to a human, where a robot would act upon requested commands.In this work we explore the utilization of commands to coordinate a shared task between a human and a robot, in a shared work space. Based on a known set of higher-level actions (e.g., pick-and-placement, hand-over, kitting) and the commands that trigger them, both a speech-based and graphical command-based interface are developed to investigate its use. While speech-based interaction might be more intuitive for coordination, in industrial settings background sounds and noise might hinder its capabilities. The graphical command-based interface circumvents this, while still demonstrating the capabilities of coordination. The developed architecture follows a knowledge-based approach, where the actions available to the robot are checked at runtime whether they suit the task and the current state of the world. Experimental results on industrially relevant assembly, kitting and hand-over tasks in a laboratory setting demonstrate that graphical command-based and speech-based coordination with high-level commands is effective for collaboration between a human and a robot.

Funder

Framework Programme

Publisher

Frontiers Media SA

Subject

Artificial Intelligence,Computer Science Applications

Reference42 articles.

1. Human-robot Interactive Learning Architecture Using Ontologies and Symbol Manipulation;Angleraud,2018

2. Language Models Are Few-Shot Learners;Brown,2020

3. Human-Agent Teaming for Multirobot Control: A Review of Human Factors Issues;Chen;IEEE Trans. Human-mach. Syst.,2014

4. A Joint Network for Grasp Detection Conditioned on Natural Language Commands;Chen,2021

5. User Experience Goals for Designing Industrial Human-Cobot Collaboration: A Case Study of Franka Panda Robot;Chowdhury,2020

Cited by 14 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Robust dynamic robot scheduling for collaborating with humans in manufacturing operations;Robotics and Computer-Integrated Manufacturing;2024-08

2. Sensor-based human–robot collaboration for industrial tasks;Robotics and Computer-Integrated Manufacturing;2024-04

3. Synergizing Natural Language Towards Enhanced Shared Autonomy;Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction;2024-03-11

4. Instructing Hierarchical Tasks to Robots by Verbal Commands;2024 IEEE/SICE International Symposium on System Integration (SII);2024-01-08

5. Framework design using the robotic augmented reality for the cyberphysical system;FME Transactions;2024

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3