An autonomous blockchain‐based computational broker for e‐science

Abstract

AbstractBlockchain infrastructures have emerged as a disruptive technology and have led to the realization of cryptocurrencies (peer‐to‐peer payment systems) and smart contracts. They can have a wide range of application areas in e‐Science due to their open, public nature and global accessability in a trustless manner. We propose and implement a smart contract called eBlocBroker, which is an autonomous blockchain‐based middleware system for volunteer computing and providing data resources for e‐Science. The eBlocBroker infrastructure connects requesters who need to combine applications (jobs) with datasets and run them via an Ethereum‐based private blockchain network (Bloxberg) on providers that utilize computational and data resources on clouds or home servers. It uses cloud storage, such as B2DROP, IPFS, or Google Drive, to store and transfer data between requesters and providers. Each provider utilizes the Slurm workload manager to execute jobs submitted through eBlocBroker. In this paper, we demonstrate how an autonomous organization programmed as a smart contract can be used to deploy a marketplace that supports data and computation‐intensive research projects. We propose a cost model implemented as a function in the smart contract which calculates and records computation and dataset usage costs. We develop a Python‐based system to communicate with eBlocBroker and orchestrate jobs' execution on the provider's end. We present eBlocBroker's features, infrastructure, implementation, algorithms and experimental results.