Channel and filter parallelism for large-scale CNN training-Reference-Cited by-同舟云学术

Channel and filter parallelism for large-scale CNN training

Published:2019-11-17 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
language:
Short-container-title:

Author:

Dryden Nikoli¹,Maruyama Naoya²,Moon Tim²,Benson Tom²,Snir Marc³,Van Essen Brian²

Affiliation:

1. University of Illinois at Urbana-Champaign and Lawrence Livermore National Laboratory

2. Lawrence Livermore National Laboratory

3. University of Illinois at Urbana-Champaign

Funder

LDRD

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3295500.3356207

Reference63 articles.

1. Martín Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia RafalJozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dandelion Mané Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Viégas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https://www.tensorflow.org/ Martín Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia RafalJozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dandelion Mané Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Viégas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https://www.tensorflow.org/

2. Corinne Ancourt Fabien Coelho François Irigoin and Ronan Keryell. 1997. A linear algebra framework for static High Performance Fortran code distribution. Scientific Programming 6 1 (1997). Corinne Ancourt Fabien Coelho François Irigoin and Ronan Keryell. 1997. A linear algebra framework for static High Performance Fortran code distribution. Scientific Programming 6 1 (1997).

3. Machine Learning Systems are Stuck in a Rut

4. A Modular Benchmarking Infrastructure for High-Performance and Reproducible Deep Learning

Cited by 28 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. AutoDDL: Automatic Distributed Deep Learning With Near-Optimal Bandwidth Cost;IEEE Transactions on Parallel and Distributed Systems;2024-08

2. PrimePar: Efficient Spatial-temporal Tensor Partitioning for Large Transformer Model Training;Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3;2024-04-27

3. CSIMD: Cross-Search Algorithm with Improved Multi-dimensional Dichotomy for Micro-Batch-Based Pipeline Parallel Training in DNN;Lecture Notes in Computer Science;2024

4. Layer-wise partitioning and merging for efficient and scalable deep learning;Future Generation Computer Systems;2023-12

5. Convolutional Neural Networks: A Survey;Computers;2023-07-28