Elastic parameter server load distribution in deep learning clusters-Reference-Cited by-同舟云学术

Elastic parameter server load distribution in deep learning clusters

Published:2020-10-12 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 11th ACM Symposium on Cloud Computing
language:
Short-container-title:

Author:

Chen Yangrui¹,Peng Yanghua¹,Bao Yixin¹,Wu Chuan¹,Zhu Yibo²,Guo Chuanxiong²

Affiliation:

1. The University of Hong Kong

2. ByteDance Inc.

Funder

Hong Kong RGC

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3419111.3421307

Reference48 articles.

1. 2012. ImageNet Dataset. http://www.image-net.org/. 2012. ImageNet Dataset. http://www.image-net.org/.

2. 2014. ps-lite: A Lightweight Parameter Server Interface. https://github.com/dmlc/ps-lite. 2014. ps-lite: A Lightweight Parameter Server Interface. https://github.com/dmlc/ps-lite.

3. 2019. Alibaba PS-Plus. https://github.com/alibaba/x-deeplearning/tree/master/xdl/ps-plus. 2019. Alibaba PS-Plus. https://github.com/alibaba/x-deeplearning/tree/master/xdl/ps-plus.

4. 2019. AWS EC2 Instance. https://aws.amazon.com/ec2/instance-types/. 2019. AWS EC2 Instance. https://aws.amazon.com/ec2/instance-types/.

5. 2019. BytePS: A High Performance and General Framework for Distributed Training. https://github.com/bytedance/byteps/. 2019. BytePS: A High Performance and General Framework for Distributed Training. https://github.com/bytedance/byteps/.

Cited by 27 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Efficient Inter-Datacenter AllReduce With Multiple Trees;IEEE Transactions on Network Science and Engineering;2024-09

2. SqueezeNIC: Low-Latency In-NIC Compression for Distributed Deep Learning;Proceedings of the 2024 SIGCOMM Workshop on Networks for AI Computing;2024-08-04

3. Crux: GPU-Efficient Communication Scheduling for Deep Learning Training;Proceedings of the ACM SIGCOMM 2024 Conference;2024-08-04

4. SDCC: software-defined collective communication for distributed training;Science China Information Sciences;2024-07-31

5. PPS: Fair and efficient black-box scheduling for multi-tenant GPU clusters;Parallel Computing;2024-06