A Hitchhiker’s Guide On Distributed Training Of Deep Neural Networks-Reference-Cited by-同舟云学术

A Hitchhiker’s Guide On Distributed Training Of Deep Neural Networks

Published:2020-03 Issue: Volume:137 Page:65-76
ISSN:0743-7315
Container-title:Journal of Parallel and Distributed Computing
language:en
Short-container-title:Journal of Parallel and Distributed Computing

Author:

Chahal Karanbir Singh^ORCID,Grover Manraj Singh^ORCID,Dey Kuntal,Shah Rajiv Ratn

Publisher

Elsevier BV

Subject

Artificial Intelligence,Computer Networks and Communications,Hardware and Architecture,Theoretical Computer Science,Software

Reference62 articles.

1. M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean, M. Devin, S. Ghemawat, G. Irving, M. Isard, et al. Tensorflow: A system for large-scale machine learning, in: 12th {USENIX} Symposium on Operating Systems Design and Implementation, {OSDI} 16, 2016, pp. 265–283.

2. Sparse communication for distributed gradient descent;Aji,2017

3. QSGD: Communication-efficient SGD via gradient quantization and encoding;Alistarh,2017

4. What does fault tolerant deep learning need from MPI?;Amatya,2017

5. Large-scale machine learning with stochastic gradient descent;Bottou,2010

Cited by 35 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Proactive, Accuracy-aware Straggler Mitigation in Machine Learning Clusters;2024 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW);2024-05-27

2. Containerized deep learning in agriculture: Orchestrating GoogleNet with Kubernetes on high performance computing;Concurrency and Computation: Practice and Experience;2024-04-11

3. Toward Green AI: A Methodological Survey of the Scientific Literature;IEEE Access;2024

4. Near-Linear Scaling Data Parallel Training with Overlapping-Aware Gradient Compression;2023 IEEE 29th International Conference on Parallel and Distributed Systems (ICPADS);2023-12-17

5. A Comprehensive Survey on Distributed Training of Graph Neural Networks;Proceedings of the IEEE;2023-12