Author:
Yang Haoqiang,Li Xinliang,Meng Deshan,Wang Xueqian,Liang Bin
Abstract
Purpose
The purpose of this paper is using a model-free reinforcement learning (RL) algorithm to optimize manipulability which can overcome difficulties of dilemmas of matrix inversion, complicated formula transformation and expensive calculation time.
Design/methodology/approach
Manipulability optimization is an effective way to solve the singularity problem arising in manipulator control. Some control schemes are proposed to optimize the manipulability during trajectory tracking, but they involve the dilemmas of matrix inversion, complicated formula transformation and expensive calculation time.
Findings
The redundant manipulator trained by RL can adjust its configuration in real-time to optimize the manipulability in an inverse-free manner while tracking the desired trajectory. Computer simulations and physics experiments demonstrate that compared with the existing methods, the average manipulability is increased by 58.9%, and the calculation time is reduced to 17.9%. Therefore, the proposed method effectively optimizes the manipulability, and the calculation time is significantly shortened.
Originality/value
To the best of the authors’ knowledge, this is the first method to optimize manipulability using RL during trajectory tracking. The authors compare their approach to existing singularity avoidance and manipulability maximization techniques, and prove that their method has better optimization effects and less computing time.
Subject
Industrial and Manufacturing Engineering,Computer Science Applications,Control and Systems Engineering
Reference25 articles.
1. Dexterous manipulators for nuclear inspection and maintenance – case study,2010
2. Continuum robots for medical applications: a survey;IEEE Transactions on Robotics,2015
3. Grasp mode and compliance control of an underactuated origami gripper using adjustable stiffness joints;IEEE/ASME Transactions on Mechatronics,2017
4. Addressing function approximation error in actor-critic methods,2018
5. Manipulability, force, and compliance analysis for planar continuum manipulators;IEEE Transactions on Robotics and Automation,2002