Author:
Halimu Yeerjiang,Zhou Chao,You Qi,Sun Jun
Abstract
The Riemannian manifold optimization algorithms have been widely used in machine learning, computer vision, data mining, and other technical fields. Most of these algorithms are based on the geodesic or the retracement operator and use the classical methods (i.e., the steepest descent method, the conjugate gradient method, the Newton method, etc.) to solve engineering optimization problems. However, they lack the ability to solve non-differentiable mathematical models and ensure global convergence for non-convex manifolds. Considering this issue, this paper proposes a quantum-behaved particle swarm optimization (QPSO) algorithm on Riemannian manifolds named RQPSO. In this algorithm, the quantum-behaved particles are randomly distributed on the manifold surface and iteratively updated during the whole search process. Then, the vector transfer operator is used to translate the guiding vectors, which are not in the same Euclidean space, to the tangent space of the particles. Through the searching of these guiding vectors, we can achieve the retracement and update of points and finally obtain the optimized result. The proposed RQPSO algorithm does not depend on the expression form of a problem and could deal with various engineering technical problems, including both differentiable and non-differentiable ones. To verify the performance of RQPSO experimentally, we compare it with some traditional algorithms on three common matrix manifold optimization problems. The experimental results show that RQPSO has better performance than its competitors in terms of calculation speed and optimization efficiency.
Funder
National Key Research and Development Program of China
National Science Foundation of China
Subject
General Mathematics,Engineering (miscellaneous),Computer Science (miscellaneous)
Reference46 articles.
1. Nocedal, J., and Warght, S.J. (2006). Numerical Optimization, Springer. [2nd ed.].
2. Sun, W., and Yuan, Y.X. (2006). Optimization Theory and Methods: Nonlinear Programming: Volume 1, Springer Science & Business Media.
3. Subspace acceleration for large-scale parameter-dependent Hermitian eigenproblems;SIAM J. Matrix Anal. Appl.,2016
4. Agarwal, N., Boumal, N., Bullins, B., and Cartis, C. (2018). Adaptive regularization with cubics on manifolds with a first-order analysis. arXiv.
5. Camera-pose estimation via projective Newton optimization on the manifold;IEEE Trans. Image Process.,2012
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献