Author:
Culler David,Karp Richard,Patterson David,Sahay Abhijit,Schauser Klaus Erik,Santos Eunice,Subramonian Ramesh,von Eicken Thorsten
Abstract
A vast body of theoretical research has focused either on overly simplistic models of parallel computation, notably the PRAM, or overly specific models that have few representatives in the real world. Both kinds of models encourage exploitation of formal loopholes, rather than rewarding development of techniques that yield performance across a range of current and future parallel machines. This paper offers a new parallel machine model, called LogP, that reflects the critical technology trends underlying parallel computers. it is intended to serve as a basis for developing fast, portable parallel algorithms and to offer guidelines to machine designers. Such a model must strike a balance between detail and simplicity in order to reveal important bottlenecks without making analysis of interesting problems intractable. The model is based on four parameters that specify abstractly the computing bandwidth, the communication bandwidth, the communication delay, and the efficiency of coupling communication and computation. Portable parallel algorithms typically adapt to the machine configuration, in terms of these parameters. The utility of the model is demonstrated through examples that are implemented on the CM-5.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Graphics and Computer-Aided Design,Software
Cited by
316 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Taking the MPI standard and the open MPI library to exascale;The International Journal of High Performance Computing Applications;2024-07-23
2. Efficient Multi-Processor Scheduling in Increasingly Realistic Models;Proceedings of the 36th ACM Symposium on Parallelism in Algorithms and Architectures;2024-06-17
3. Software Resource Disaggregation for HPC with Serverless Computing;2024 IEEE International Parallel and Distributed Processing Symposium (IPDPS);2024-05-27
4. Network states-aware collective communication optimization;Cluster Computing;2024-03-10
5. Distributed computing with the cloud;Distributed Computing;2024-02-01