Optimizing the Bruck Algorithm for Non-uniform All-to-all Communication-Reference-Cited by-同舟云学术

Optimizing the Bruck Algorithm for Non-uniform All-to-all Communication

Published:2022-06-27 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing
language:
Short-container-title:

Author:

Fan Ke¹,Gilray Thomas¹,Pascucci Valerio²,Huang Xuan²,Micinski Kristopher³,Kumar Sidharth¹

Affiliation:

1. University of Alabama at Birmingham, Birmingham, AL, USA

2. University of Utah, Salt Lake City, UT, USA

3. Syracuse University, Syracuse, NY, USA

Funder

NSF

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3502181.3531468

Reference44 articles.

1. MPI on Theta. MPI on Theta. https://www.alcf.anl.gov/support-center/theta/mpi- theta. MPI on Theta. MPI on Theta. https://www.alcf.anl.gov/support-center/theta/mpi- theta.

2. MPICH Home Page. https://www.mpich.org. MPICH Home Page. https://www.mpich.org.

3. OpenMPI Home Page. https://www.open-mpi.org. OpenMPI Home Page. https://www.open-mpi.org.

4. Theta ALCF Home Page. https://www.alcf.anl.gov/theta. Theta ALCF Home Page. https://www.alcf.anl.gov/theta.

5. Uniform distribution. https://mathworld.wolfram.com/UniformDistribution. html Uniform distribution. https://mathworld.wolfram.com/UniformDistribution. html

Cited by 10 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. OHIO: Improving RDMA Network Scalability in MPI_Alltoall Through Optimized Hierarchical and Intra/Inter-Node Communication Overlap Design;2024 IEEE Symposium on High-Performance Interconnects (HOTI);2024-08-21

2. MPMoE: Memory Efficient MoE for Pre-Trained Models With Adaptive Pipeline Parallelism;IEEE Transactions on Parallel and Distributed Systems;2024-06

3. Configurable Algorithms for All-to-All Collectives;ISC High Performance 2024 Research Paper Proceedings (39th International Conference);2024-05

4. Bruck Algorithm Performance Analysis for Multi-GPU All-to-All Communication;Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region;2024-01-18

5. SCoOL - Scalable Common Optimization Library;2023 IEEE 30th International Conference on High Performance Computing, Data, and Analytics (HiPC);2023-12-18