1. Distributed delayed stochastic optimization;Agarwal,2012
2. Katyusha: the first direct acceleration of stochastic gradient methods;Allen-Zhu;Journal of Machine Learning Research,2017
3. Universal stagewise learning for non-convex problems with convergence on averaged solutions;Chen,2018
4. Faster non-convex federated learning via global and local momentum;Das,2022
5. Large scale distributed deep networks;Dean;Advances in Neural Information Processing Systems,2012