Clairvoyant prefetching for distributed machine learning I/O-Reference-Cited by-同舟云学术

Clairvoyant prefetching for distributed machine learning I/O

Published:2021-11-13 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
language:
Short-container-title:

Author:

Dryden Nikoli¹,Böhringer Roman¹,Ben-Nun Tal¹,Hoefler Torsten¹

Affiliation:

1. ETH Zürich, Switzerland

Funder

European Research Council

Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3458817.3476181

Reference78 articles.

1. Martín Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia Rafal Jozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dandelion Mané Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Viégas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https://www.tensorflow.org/ Martín Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia Rafal Jozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dandelion Mané Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Viégas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https://www.tensorflow.org/

Cited by 31 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Efficient distributed continual learning for steering experiments in real-time;Future Generation Computer Systems;2025-01

2. A Data-Loader Tunable Knob to Shorten GPU Idleness for Distributed Deep Learning;ACM Transactions on Architecture and Code Optimization;2024-08-22

3. A Selective Preprocessing Offloading Framework for Reducing Data Traffic in DL Training;Proceedings of the 16th ACM Workshop on Hot Topics in Storage and File Systems;2024-07-08

4. Formal Definitions and Performance Comparison of Consistency Models for Parallel File Systems;IEEE Transactions on Parallel and Distributed Systems;2024-06

5. Capturing Periodic I/O Using Frequency Techniques;2024 IEEE International Parallel and Distributed Processing Symposium (IPDPS);2024-05-27