Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Training-Reference-Cited by-同舟云学术

Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Training

Published:2024-04-27 Issue: Volume:1 Page:1095-1111
ISSN:
Container-title:Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2
language:
Short-container-title:

Author:

Chen Hongzheng¹^ORCID,Yu Cody Hao²^ORCID,Zheng Shuai²^ORCID,Zhang Zhen³^ORCID,Zhang Zhiru¹^ORCID,Wang Yida³^ORCID

Affiliation:

1. Cornell University, Ithaca, United States of America

2. Boson AI, Inc, Santa Clara, USA

3. Amazon Web Services, Santa Clara, United States of America

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3620665.3640399

Reference71 articles.

1. Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. Tensor-flow: A system for large-scale machine learning. In Proceedings of the USENIX Conference on Operating Systems Design and Implementation (OSDI), 2016.

2. Tiramisu: A Polyhedral Compiler for Expressing Fast and Portable Code

3. Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258, 2021.

4. James Bradbury Roy Frostig Peter Hawkins Matthew James Johnson Chris Leary Dougal Maclaurin George Necula Adam Paszke Jake VanderPlas Skye Wanderman-Milne and Qiao Zhang. JAX: composable transformations of Python+NumPy programs. http://github.com/google/jax 2018.

5. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. In Proceedings of the International Conference on Neural Information Processing Systems (NeurIPS), 2020.