Affiliation:
1. Universität Münster, Münster, Germany
Abstract
During the software crisis of the 1960s, Dijkstra's famous thesis
"goto considered harmful"
paved the way for structured programming. This short communication suggests that many current difficulties of parallel programming based on message passing are caused by poorly structured communication, which is a consequence of using low-level
send-receive
primitives. We argue that, like
goto
in sequential programs,
send-receive
should be avoided as far as possible and replaced by
collective operations
in the setting of message passing. We dispute some widely held opinions about the apparent superiority of pairwise communication over collective communication and present substantial theoretical and empirical evidence to the contrary in the context of MPI (Message Passing Interface).
Publisher
Association for Computing Machinery (ACM)
Cited by
46 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. FMI: Fast and Cheap Message Passing for Serverless Functions;Proceedings of the 37th International Conference on Supercomputing;2023-06-21
2. Enforcing Deadlines for Skeleton-based Parallel Programming;2020 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS);2020-04
3. Compiling first-order functions to session-typed parallel code;Proceedings of the 29th International Conference on Compiler Construction;2020-02-22
4. Axiomatization and characterization of BSP algorithms;Journal of Logical and Algebraic Methods in Programming;2019-12
5. Toward Structured Parallel Programming: Send-Receive Considered Harmful;Lecture Notes in Computer Science;2019