Online evolutionary batch size orchestration for scheduling deep learning workloads in GPU clusters-Reference-Cited by-同舟云学术

Online evolutionary batch size orchestration for scheduling deep learning workloads in GPU clusters

Published:2021-11-13 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
language:
Short-container-title:

Author:

Bian Zhengda¹,Li Shenggui¹,Wang Wei²,You Yang¹

Affiliation:

1. National University of Singapore, Singapore

2. ByteDance, Singapore

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3458817.3480859

Reference38 articles.

1. Texas Advanced Computing Center. 2021. LONGHORN - TEXAS ADVANCED COMPUTING CENTER. https://www.tacc.utexas.edu/systems/longhorn. Texas Advanced Computing Center. 2021. LONGHORN - TEXAS ADVANCED COMPUTING CENTER. https://www.tacc.utexas.edu/systems/longhorn.

2. Jeffrey Dean Greg Corrado Rajat Monga Kai Chen Matthieu Devin Mark Mao Marc'aurelio Ranzato Andrew Senior Paul Tucker Ke Yang etal 2012. Large scale distributed deep networks. In Advances in neural information processing systems. 1223--1231. Jeffrey Dean Greg Corrado Rajat Monga Kai Chen Matthieu Devin Mark Mao Marc'aurelio Ranzato Andrew Senior Paul Tucker Ke Yang et al. 2012. Large scale distributed deep networks. In Advances in neural information processing systems. 1223--1231.

Cited by 13 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Harnessing AI for solar energy: Emergence of transformer models;Applied Energy;2024-09

2. AutoSched: An Adaptive Self-configured Framework for Scheduling Deep Learning Training Workloads;Proceedings of the 38th ACM International Conference on Supercomputing;2024-05-30

3. Ymir: A Scheduler for Foundation Model Fine-tuning Workloads in Datacenters;Proceedings of the 38th ACM International Conference on Supercomputing;2024-05-30

4. Locality-Aware and Fault-Tolerant Batching for Machine Learning on Distributed Datasets;IEEE Transactions on Cloud Computing;2024-04

5. Deep Learning Workload Scheduling in GPU Datacenters: A Survey;ACM Computing Surveys;2024-01-22