An Oracle for Guiding Large-Scale Model/Hybrid Parallel Training of Convolutional Neural Networks-Reference-Cited by-同舟云学术

An Oracle for Guiding Large-Scale Model/Hybrid Parallel Training of Convolutional Neural Networks

Published:2021-06-21 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 30th International Symposium on High-Performance Parallel and Distributed Computing
language:
Short-container-title:

Author:

Kahira Albert Njoroge¹,Nguyen Truong Thao²,Gomez Leonardo Bautista³,Takano Ryousei²,Badia Rosa M.¹,Wahib Mohamed⁴

Affiliation:

1. Barcelona Supercomputing Center & Universitat Politècnica de Catalunya, Barcelona, Spain

2. National Institute of Advanced Industrial Science and Technology, Tokyo, Japan

3. Barcelona Supercomputing Center, Barcelona, Spain

4. National Institute of Advanced Industrial Science and Technology & RIKEN-CCS, Tokyo, Japan

Funder

Horizon 2020 Framework Programme

la Caixa Foundation

JST

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3431379.3460644

Reference56 articles.

1. Tal Ben-Nun etal 2018. Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis. CoRR abs/1802.09941 (2018). arXiv:1802.09941 Tal Ben-Nun et al. 2018. Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis. CoRR abs/1802.09941 (2018). arXiv:1802.09941

Cited by 5 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Dissecting Convolutional Neural Networks for Runtime and Scalability Prediction;Proceedings of the 53rd International Conference on Parallel Processing;2024-08-12

2. Extra-Deep: Automated Empirical Performance Modeling for Distributed Deep Learning;Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis;2023-11-12

3. Comparative Study on Distributed Lightweight Deep Learning Models for Road Pothole Detection;Sensors;2023-04-27

4. PROFET: PROFiling-based CNN Training Latency ProphET for GPU Cloud Instances;2022 IEEE International Conference on Big Data (Big Data);2022-12-17

5. Monitoring Collective Communication Among GPUs;Euro-Par 2021: Parallel Processing Workshops;2022