Large Scale Caching and Streaming of Training Data for Online Deep Learning-Reference-Cited by-同舟云学术

Large Scale Caching and Streaming of Training Data for Online Deep Learning

Published:2022-06-27 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 12th Workshop on AI and Scientific Computing at Scale using Flexible Computing Infrastructures
language:
Short-container-title:

Author:

Liu Jie¹,Nicolae Bogdan²,Li Dong¹,Wozniak Justin M.²,Bicer Tekin²,Liu Zhengchun²,Foster Ian²

Affiliation:

1. University of California, Merced, Merced, CA, USA

2. Argonne National Laboratory, Lemont, IL, USA

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3526058.3535453

Reference26 articles.

1. NVIDIA Data Loading Library. https://developer.nvidia.com/DALI NVIDIA Data Loading Library. https://developer.nvidia.com/DALI

2. I/O Characterization and Performance Evaluation of BeeGFS for Deep Learning

3. NV-group

4. Dean , J. , Corrado , G.S. , Monga , R. , Chen , K. , Devin , M. , Le , Q.V. , Mao , M.Z. , Ranzato , M. , Senior , A. , Tucker , P. , Yang , K. , Ng , A.Y. : Large scale distributed deep networks . In: 25th International Conference on Neural Information Processing Systems. p. 1223 -- 1231 . Lake Tahoe, USA ( 2012 ) Dean, J., Corrado, G.S., Monga, R., Chen, K., Devin, M., Le, Q.V., Mao, M.Z., Ranzato, M., Senior, A., Tucker, P., Yang, K., Ng, A.Y.: Large scale distributed deep networks. In: 25th International Conference on Neural Information Processing Systems. p. 1223--1231. Lake Tahoe, USA (2012)

5. Clairvoyant prefetching for distributed machine learning I/O

Cited by 6 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Efficient distributed continual learning for steering experiments in real-time;Future Generation Computer Systems;2025-01

2. Caching, transcoding, delivery and learning for advanced video streaming services;ICT Express;2024-08

3. Optimizing the Training of Co-Located Deep Learning Models Using Cache-Aware Staggering;2023 IEEE 30th International Conference on High Performance Computing, Data, and Analytics (HiPC);2023-12-18

4. APAM: Adaptive Pre-Training and Adaptive Meta Learning in Language Model for Noisy Labels and Long-Tailed Learning;2023 International Conference on Machine Learning and Applications (ICMLA);2023-12-15

5. HPC-GPT: Integrating Large Language Model for High-Performance Computing;Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis;2023-11-12