Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters-Reference-Cited by-同舟云学术

Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters

Published:2018-09-23 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 25th European MPI Users' Group Meeting
language:
Short-container-title:

Author:

Awan Ammar Ahmad¹,Chu Ching-Hsiang¹,Subramoni Hari¹,Panda Dhabaleswar K.¹

Affiliation:

1. Department of Computer Science and Engineering, The Ohio State University, Columbus, Ohio

Publisher

ACM

Reference37 articles.

1. {n. d.}. KESCH: Cray CS-Storm System. http://www.cscs.ch/computers/kesch_escha/index.html. ({n. d.}). {n. d.}. KESCH: Cray CS-Storm System. http://www.cscs.ch/computers/kesch_escha/index.html. ({n. d.}).

2. 2015. CNTK. http://www.cntk.ai/. (2015). {Online; accessed April-2016}. 2015. CNTK. http://www.cntk.ai/. (2015). {Online; accessed April-2016}.

3. Martin Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S Corrado Andy Davis Jeffrey Dean Matthieu Devin etal {n. d.}. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems 2015. Software available from tensorflow. org ({n. d.}). Martin Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S Corrado Andy Davis Jeffrey Dean Matthieu Devin et al. {n. d.}. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems 2015. Software available from tensorflow. org ({n. d.}).

4. S-Caffe

5. Efficient Large Message Broadcast using NCCL and CUDA-Aware MPI for Deep Learning

Cited by 21 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Collective Communication Performance Evaluation for Distributed Deep Learning Training;Applied Sciences;2024-06-12

2. DistMind: Efficient Resource Disaggregation for Deep Learning Workloads;IEEE/ACM Transactions on Networking;2024-06

3. Real-time High-resolution X-Ray Computed Tomography;Proceedings of the 38th ACM International Conference on Supercomputing;2024-05-30

4. Towards Accelerating k-NN with MPI and Near-Memory Processing;2024 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW);2024-05-27

5. Memory Transfer Decomposition: Exploring Smart Data Movement Through Architecture-Aware Strategies;Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis;2023-11-12