Distributed computing in a NUMP (Non-Uniform Message-Passing) environment

Abstract

In this paper we propose a general framework of distributed computing in a NUMP environment. A NUMP (Non-Uniform Message-Passing) distributed environment is a computing environment in which both tightly-coupled, shared-memory systems and loosely-coupled, distributed computers are co-existent, and the time for message-passing is non-uniform between various systems. An environment with such hybrid components has become a common phenomenon in most academic and industrial communities. The issue of how to develop and execute programs that take advantage of all the resources available in a hybrid environment is an open issue in the research that carries both theoretic and pragmatic significance. The main topics involved include the development of new computational models for NUMP environment, operating system and language support for NUMP computing, methodologies in NUMP programming, principles of algorithm design for NUMP system, and so on. We deem that the research in NUMP computing will contribute in providing a unified framework for parallel and distributed computing, and in accomplishing better utilization of computing resources at large scale.