MSCCLang: Microsoft Collective Communication Language-Reference-Cited by-同舟云学术

MSCCLang: Microsoft Collective Communication Language

Published:2023-01-27 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2
language:
Short-container-title:

Author:

Cowan Meghan¹,Maleki Saeed¹,Musuvathi Madanlal¹,Saarikivi Olli¹,Xiong Yifan²

Affiliation:

1. Microsoft Research, USA

2. Microsoft Research, China

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3575693.3575724

Reference46 articles.

1. 2022. AI and Compute. https://openai.com/blog/ai-and-compute/ 2022. AI and Compute. https://openai.com/blog/ai-and-compute/

2. Michael Barnett Rick Littlefield David G Payne and Robert van de Geijn. 1993. Global combine on mesh architectures with wormhole routing. In [1993] Proceedings Seventh International Parallel Processing Symposium. 156–162. Michael Barnett Rick Littlefield David G Payne and Robert van de Geijn. 1993. Global combine on mesh architectures with wormhole routing. In [1993] Proceedings Seventh International Parallel Processing Symposium. 156–162.

3. Complete exchange on a circuit switched mesh

4. Synthesizing optimal collective algorithms

Cited by 7 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Logical Synchrony and the Bittide Mechanism;IEEE Transactions on Parallel and Distributed Systems;2024-11

2. Towards a Standardized Representation for Deep Learning Collective Algorithms;2024 IEEE Symposium on High-Performance Interconnects (HOTI);2024-08-21

3. TCCL: Co-optimizing Collective Communication and Traffic Routing for GPU-centric Clusters;Proceedings of the 2024 SIGCOMM Workshop on Networks for AI Computing;2024-08-04

4. Rethinking Machine Learning Collective Communication as a Multi-Commodity Flow Problem;Proceedings of the ACM SIGCOMM 2024 Conference;2024-08-04

5. RDMA over Ethernet for Distributed Training at Meta Scale;Proceedings of the ACM SIGCOMM 2024 Conference;2024-08-04