Affiliation:
1. Innovative Computing Laboratory, University of Tennessee, Knoxville, TN, USA
Abstract
As supercomputers are entering an era of massive parallelism where the frequency of faults is increasing, the MPI Standard remains distressingly vague on the consequence of failures on MPI communications. Advanced fault-tolerance techniques have the potential to prevent full-scale application restart and therefore lower the cost incurred for each failure, but they demand from MPI the capability to detect failures and resume communications afterward. In this paper, we present a set of extensions to MPI that allow communication capabilities to be restored, while maintaining the extreme level of performance to which MPI users have become accustomed. The motivation behind the design choices are weighted against alternatives, a task that requires simultaneously considering MPI from the viewpoint of both the user and the implementor. The usability of the interfaces for expressing advanced recovery techniques is then discussed, including the difficult issue of enabling separate software layers to coordinate their recovery.
Subject
Hardware and Architecture,Theoretical Computer Science,Software
Cited by
126 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Implementation-Oblivious Transparent Checkpoint-Restart for MPI;Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis;2023-11-12
2. Towards elastic in situ analysis for high-performance computing simulations;Journal of Parallel and Distributed Computing;2023-07
3. Exploit Approximation to Support Fault Resiliency in MPI-based Applications;2023 53rd Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W);2023-06
4. Dynamic spawning of MPI processes applied to malleability;The International Journal of High Performance Computing Applications;2023-05-29
5. Fault Awareness in the MPI 4.0 Session Model;Proceedings of the 20th ACM International Conference on Computing Frontiers;2023-05-09