Abstract
AbstractWe consider monotone inclusions defined on a Hilbert space where the operator is given by the sum of a maximal monotone operatorTand a single-valued monotone, Lipschitz continuous, and expectation-valued operatorV. We draw motivation from the seminal work by Attouch and Cabot (Attouch in AMO 80:547–598, 2019, Attouch in MP 184: 243–287) on relaxed inertial methods for monotone inclusions and present a stochastic extension of the relaxed inertial forward–backward-forward method. Facilitated by an online variance reduction strategy via a mini-batch approach, we show that our method produces a sequence that weakly converges to the solution set. Moreover, it is possible to estimate the rate at which the discrete velocity of the stochastic process vanishes. Under strong monotonicity, we demonstrate strong convergence, and give a detailed assessment of the iteration and oracle complexity of the scheme. When the mini-batch is raised at a geometric (polynomial) rate, the rate statement can be strengthened to a linear (suitable polynomial) rate while the oracle complexity of computing an$$\epsilon $$ϵ-solution improves to$${\mathcal {O}}(1/\epsilon )$$O(1/ϵ). Importantly, the latter claim allows for possibly biased oracles, a key theoretical advancement allowing for far broader applicability. By defining a restricted gap function based on the Fitzpatrick function, we prove that the expected gap of an averaged sequence diminishes at a sublinear rate of$${\mathcal {O}}(1/k)$$O(1/k)while the oracle complexity of computing a suitably defined$$\epsilon $$ϵ-solution is$${\mathcal {O}}(1/\epsilon ^{1+a})$$O(1/ϵ1+a)where$$a > 1$$a>1. Numerical results on two-stage games and an overlapping group Lasso problem illustrate the advantages of our method compared to competitors.
Funder
European Cooperation in Science and Technology
Publisher
Springer Science and Business Media LLC
Subject
Applied Mathematics,Computational Mathematics,Control and Optimization
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献