Pick-place of dynamic objects by robot manipulator based on deep learning and easy user interface teaching systems

Author:

Hossain Delowar,Capi Genci,Jindai Mitsuru,Kaneko Shin-ichiro

Abstract

Purpose Development of autonomous robot manipulator for human-robot assembly tasks is a key component to reach high effectiveness. In such tasks, the robot real-time object recognition is crucial. In addition, the need for simple and safe teaching techniques need to be considered, because: small size robot manipulators’ presence in everyday life environments is increasing requiring non-expert operators to teach the robot; and in small size applications, the operator has to teach several different motions in a short time. Design/methodology/approach For object recognition, the authors propose a deep belief neural network (DBNN)-based approach. The captured camera image is used as the input of the DBNN. The DBNN extracts the object features in the intermediate layers. In addition, the authors developed three teaching systems which utilize iPhone; haptic; and Kinect devices. Findings The object recognition by DBNN is robust for real-time applications. The robot picks up the object required by the user and places it in the target location. Three developed teaching systems are easy to use by non-experienced subjects, and they show different performance in terms of time to complete the task and accuracy. Practical implications The proposed method can ease the use of robot manipulators helping non-experienced users completing different assembly tasks. Originality/value This work applies DBNN for object recognition and three intuitive systems for teaching robot manipulators.

Publisher

Emerald

Subject

Industrial and Manufacturing Engineering,Computer Science Applications,Control and Systems Engineering

Reference35 articles.

1. Teachingless spray-painting of sculptured surface by an industrial robot,1997

2. Erratum to ‘the three-dimensional bin packing problem’: robot-packable and orthogonal variants of packing problems;Operations Research,2005

3. 3DPO: a three-dimensional part orientation system;International Journal of Robotics Research,1986

4. Present and future robot control development: an industrial perspective;Annual Reviews in Control,2007

5. Quantitative evaluation of an intuitive teaching method for industrial robot using a force/moment direction sensor;International Journal of Control, Automation, and Systems,2003

Cited by 22 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3