ElasticDL: A Kubernetes-native Deep Learning Framework with Fault-tolerance and Elastic Scheduling-Reference-Cited by-同舟云学术

ElasticDL: A Kubernetes-native Deep Learning Framework with Fault-tolerance and Elastic Scheduling

Published:2023-02-27 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining
language:
Short-container-title:

Author:

Zhou Jun¹^ORCID,Zhang Ke²^ORCID,Zhu Feng²^ORCID,Shi Qitao²^ORCID,Fang Wenjing²^ORCID,Wang Lin²^ORCID,Wang Yi²^ORCID

Affiliation:

1. Zhejiang University & Ant Group, Hangzhou, China

2. Ant Group, Hangzhou, China

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3539597.3573037

Reference18 articles.

1. Luiz F Bittencourt , Alfredo Goldman , Edmundo RM Madeira , Nelson LS da Fonseca, and Rizos Sakellariou. 2018 . Scheduling in distributed systems: A cloud computing perspective. Computer science review, Vol. 30 (2018), 31--54. Luiz F Bittencourt, Alfredo Goldman, Edmundo RM Madeira, Nelson LS da Fonseca, and Rizos Sakellariou. 2018. Scheduling in distributed systems: A cloud computing perspective. Computer science review, Vol. 30 (2018), 31--54.

2. Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell etal 2020. Language models are few-shot learners. Advances in neural information processing systems Vol. 33 (2020) 1877--1901. Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language models are few-shot learners. Advances in neural information processing systems Vol. 33 (2020) 1877--1901.

3. Heng-Tze Cheng Levent Koc Jeremiah Harmsen Tal Shaked Tushar Chandra Hrishi Aradhye Glen Anderson Greg Corrado Wei Chai Mustafa Ispir etal 2016. Wide & deep learning for recommender systems. In DLRS. 7--10. Heng-Tze Cheng Levent Koc Jeremiah Harmsen Tal Shaked Tushar Chandra Hrishi Aradhye Glen Anderson Greg Corrado Wei Chai Mustafa Ispir et al. 2016. Wide & deep learning for recommender systems. In DLRS. 7--10.

4. The Horovod Contributors. 2022a. Horovod Elastic. https://horovod.readthedocs.io/en/stable/elastic_include.html/ Last accessed on 2022-06--25. The Horovod Contributors. 2022a. Horovod Elastic. https://horovod.readthedocs.io/en/stable/elastic_include.html/ Last accessed on 2022-06--25.

5. The PyTorch Contributors. 2022b. PyTorch Elastic. https://pytorch.org/docs/stable/distributed.elastic.html/ Last accessed on 2022-06--26. The PyTorch Contributors. 2022b. PyTorch Elastic. https://pytorch.org/docs/stable/distributed.elastic.html/ Last accessed on 2022-06--26.

Cited by 2 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. LubeRDMA: A Fail-safe Mechanism of RDMA;Proceedings of the 8th Asia-Pacific Workshop on Networking;2024-08-03

2. Elastic deep learning through resilient collective operations;Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis;2023-11-12