The Convergence of Stochastic Gradient Descent in Asynchronous Shared Memory-Reference-Cited by-同舟云学术

The Convergence of Stochastic Gradient Descent in Asynchronous Shared Memory

Published:2018-07-23 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 2018 ACM Symposium on Principles of Distributed Computing
language:
Short-container-title:

Author:

Alistarh Dan¹,De Sa Christopher²,Konstantinov Nikola¹

Affiliation:

1. IST Austria, Klosterneuburg, Austria

2. Cornell University, Ithaca, NY, USA

Funder

EU Marie SkBodowska-Curie Grant Agreement

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3212734.3212763

Reference36 articles.

1. Alekh Agarwal and John C Duchi . 2011. Distributed delayed stochastic optimization. In Advances in Neural Information Processing Systems. 873--881. Alekh Agarwal and John C Duchi . 2011. Distributed delayed stochastic optimization. In Advances in Neural Information Processing Systems. 873--881.

2. Hagit Attiya and Jennifer Welch . 2004. Distributed computing: fundamentals simulations and advanced topics. Vol. Vol. 19. John Wiley & Sons. Hagit Attiya and Jennifer Welch . 2004. Distributed computing: fundamentals simulations and advanced topics. Vol. Vol. 19. John Wiley & Sons.

3. Dimitri P Bertsekas and John N Tsitsiklis . 1989. Parallel and distributed computation: numerical methods. Vol. Vol. 23. Prentice hall Englewood Cliffs NJ. Dimitri P Bertsekas and John N Tsitsiklis . 1989. Parallel and distributed computation: numerical methods. Vol. Vol. 23. Prentice hall Englewood Cliffs NJ.

4. Convex Optimization: Algorithms and Complexity

Cited by 16 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Asynchronous Fully-Decentralized SGD in the Cluster-Based Model;Lecture Notes in Computer Science;2023

2. Deep Neural Network Training With Distributed K-FAC;IEEE Transactions on Parallel and Distributed Systems;2022-12-01

3. Elastic Consistency;ACM SIGACT News;2022-06-10

4. The Impact of Synchronization in Parallel Stochastic Gradient Descent;Lecture Notes in Computer Science;2022

5. Asynchronous Parallel Computing;Wiley StatsRef: Statistics Reference Online;2021-11-23