Synthesizing optimal collective algorithms-Reference-Cited by-同舟云学术

Synthesizing optimal collective algorithms

Published:2021-02-17 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming
language:
Short-container-title:

Author:

Cai Zixian¹,Liu Zhengyang²,Maleki Saeed³,Musuvathi Madanlal³,Mytkowicz Todd³,Nelson Jacob³,Saarikivi Olli³

Affiliation:

1. Australian National University, Canberra, ACT, Australia

2. University of Utah

3. Microsoft Research

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3437801.3441620

Reference30 articles.

1. AMD Radeon Instinct MI50 2020. AMD Radeon Instinct MI50 Accelerator. https://www.amd.com/system/files/documents/radeon-instinctmi50-datasheet.pdf. AMD Radeon Instinct MI50 2020. AMD Radeon Instinct MI50 Accelerator. https://www.amd.com/system/files/documents/radeon-instinctmi50-datasheet.pdf.

2. AMD RCCL Library 2020. ROCm Communication Collectives Library. https://github.com/ROCmSoftwarePlatform/rccl. AMD RCCL Library 2020. ROCm Communication Collectives Library. https://github.com/ROCmSoftwarePlatform/rccl.

3. Complete exchange on a circuit switched mesh

Cited by 18 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Network Load Balancing with Parallel Flowlets for AI Training Clusters;Proceedings of the 2024 SIGCOMM Workshop on Networks for AI Computing;2024-08-04

2. Rethinking Machine Learning Collective Communication as a Multi-Commodity Flow Problem;Proceedings of the ACM SIGCOMM 2024 Conference;2024-08-04

3. SDCC: software-defined collective communication for distributed training;Science China Information Sciences;2024-07-31

4. AdapCC: Making Collective Communication in Distributed Machine Learning Adaptive;2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS);2024-07-23

5. PID-Comm: A Fast and Flexible Collective Communication Framework for Commodity Processing-in-DIMM Devices;2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA);2024-06-29