Affiliation:
1. Lomonosov Moscow State University
2. Derzhavin Tambov State University
Abstract
We consider versions of the Newton method for piecewise smooth nonlinear equations, as well as of the Gauss–Newton method for the case when additional constraints are imposed, supplied with linesearch procedures for the residual of the equation, aiming at globalization of convergence. (Constrained) piecewise smooth nonlinear equations arise naturally as reformulations of systems of equations and inequalities involving complementarity conditions. In cases when the direction of the Newton method cannot be computed, or appears too long, the algorithm switches to a safeguarding step of the gradient descent method for the squared residual of of the equation with smooth selection mapping active at the current iterate. For the Gauss–Newton method, safeguarding steps of the gradient projection method are employed. We obtain results characterizing properties of possible accumulation points of sequences generated by these methods, namely, stationarity of any such point for at least one smooth selection mapping active at it, and conditions assuring asymptotic superlinear convergence rate of such sequences. Special attention is paid to the majorization condition for the norm of the mapping by the norms of smooth selection mappings, playing a crucial role in the analysis for the piecewise smooth case. Examples are provided demonstrating that in cases of violation of this condition, the algorithms in question may produce sequences converging to points that are not stationary for any active smooth selection mapping.
Publisher
Tambov State University - G.R. Derzhavin
Reference13 articles.
1. [1] W.W. Hager, "Lipschitz continuity for constrained processes", SIAM J. on Control and Optimization, 17 (1979), 321-338.
2. [2] A.F. Izmailov, E.I. Uskov, Yan Zhibai, "The piecewise Levenberg-Marquardt method", Advances in System Sciences and Applications, 2024 (to appear).
3. [3] A. Fischer, M. Herrich, A.F. Izmailov, M.V. Solodov, "A globally convergent LP-Newton method", SIAM J. on Optimization, 26 (2016), 2012-2033.
4. [4] A. Fischer, A.F. Izmailov, M. Jelitte, "Newton-type methods near critical solutions of piecewise smooth nonlinear equations", Computational Optimization and Applications, 80 (2021), 587-615.
5. [5] A.F. Izmailov, M.V. Solodov, Newton-Type Methods for Optimization and Variational Problems, Springer Series in Operations Research and Financial Engineering, Springer, Cham, 2014.