Application of Deep Reinforcement Learning in Control of Drawing Robots

Author:

Liu Cheng,Zhu Liucun,Ji Xinyu,Zheng Xiaodong

Abstract

Abstract In this paper, the drawing robot studied is after the system extracts the edge of the image, convert its pixels to actual physical coordinates, then control the robot to track these coordinate values and realize image drawing. In many cases, the edges extracted by the edge detection algorithm have a lot of unnecessary details and edge lines of many branch points. Here, some techniques are used to remove these redundant and branch points. When the robot is tracking the trajectory, the quality of its control algorithm directly determines its performance. In this paper, the control system is designed using the deep deterministic strategy gradient (DDPG) algorithm in reinforcement learning, focusing on the setting of its reward function. Here we propose a reward function. After simulation testing, the reward function setting meets the system requirements, the controller can achieve high-precision and high-speed trajectory tracking effect, and it can also suppress chattering caused by external interference and model errors.

Publisher

IOP Publishing

Subject

General Physics and Astronomy

Reference24 articles.

1. An interactive educational drawing system using a humanoid robot and light polarization;El-Barkouky,2013

2. The artist robot: a robot drawing like a human artist;Gazeau

3. Two-degree-of-freedom control of a two-link manipulator in the rotating coordinate system;Oh;IEEE Transactions on Industrial Electronics,2015

4. Robust fuzzy tracking control for robotic manipulators;Ho;Simulation Modelling Practice and Theory,2007

Cited by 2 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Reinforcement learning from expert demonstrations with application to redundant robot control;Engineering Applications of Artificial Intelligence;2023-03

2. Redundant robot control with learning from expert demonstrations;2022 IEEE Symposium Series on Computational Intelligence (SSCI);2022-12-04

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3