On scheduling ring-all-reduce learning jobs in multi-tenant GPU clusters with communication contention-Reference-Cited by-同舟云学术

On scheduling ring-all-reduce learning jobs in multi-tenant GPU clusters with communication contention

Published:2022-10-03 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the Twenty-Third International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing
language:
Short-container-title:

Author:

Yu Menglu¹,Ji Bo²,Rajan Hridesh¹,Liu Jia³

Affiliation:

1. Iowa State University

2. Virginia Tech

3. The Ohio State University and Iowa State University

Funder

NSF

Cisco Systems Research Grant

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3492866.3549716

Reference24 articles.

1. Abadi , M. , Barham , P. , TensorFlow : A system for large-scale machine learning . In Proc. of USENIX OSDI ( 2016 ). Abadi, M., Barham, P., et al. TensorFlow: A system for large-scale machine learning. In Proc. of USENIX OSDI (2016).

2. Bao , Y. , Peng , Y. , and Wu , C . Deep learning-based job placement in distributed machine learning clusters. In in IEEE INFOCOM ( 2019 ). Bao, Y., Peng, Y., and Wu, C. Deep learning-based job placement in distributed machine learning clusters. In in IEEE INFOCOM (2019).

3. Energy Efficient Job Scheduling with DVFS for CPU-GPU Heterogeneous Systems

4. Foley , D. , and Danskin , J . Ultra-performance pascal gpu and nvlink interconnect . In IEEE Micr ( 2017 ), vol. 37 , pp. 7 -- 17 . Foley, D., and Danskin, J. Ultra-performance pascal gpu and nvlink interconnect. In IEEE Micr (2017), vol. 37, pp. 7--17.

5. Grandl , R. , Chowdhury , M. , Akella , A. , and Ananthanarayanan , G . Altruistic scheduling in multi-resource clusters . In OSDI ( 2016 ). Grandl, R., Chowdhury, M., Akella, A., and Ananthanarayanan, G. Altruistic scheduling in multi-resource clusters. In OSDI (2016).

Cited by 2 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Reliable and efficient RAR-based distributed model training in computing power network;Journal of Optical Communications and Networking;2024-04-22

2. GPU-Efficient Deployment of Ring All-Reduce-Based Distributed Model Training in Tidal Computing Power Network;2023 Asia Communications and Photonics Conference/2023 International Photonics and Optoelectronics Meetings (ACP/POEM);2023-11-04