Provisioning Input and Output Data Rates in Data Processing Frameworks-Reference-Cited by-同舟云学术

Provisioning Input and Output Data Rates in Data Processing Frameworks

Published:2020-03-03 Issue:3 Volume:18 Page:491-506
ISSN:1570-7873
Container-title:Journal of Grid Computing
language:en
Short-container-title:J Grid Computing

Author:

Do Nam H.,Van Do Tien,Farkas Lóránt,Rotter Csaba

Abstract

AbstractThis paper is motivated by the need of deadline-bounded applications in live mobile network environments to obtain the guarantee and the appropriate share of an input and output (I/O) data rate. However, data processing frameworks only support the request of memory and the computing capacity at present. In this paper, we propose a solution that allows the control of disk I/O and network I/O for data processing applications in YARN and Mesos frameworks. Experimental results show that our tool can provision the I/O data rate sharing of competing data processing applications.

Publisher

Springer Science and Business Media LLC

Subject

Computer Networks and Communications,Hardware and Architecture,Information Systems,Software

Link

http://link.springer.com/content/pdf/10.1007/s10723-020-09508-0.pdf

Reference28 articles.

1. Apache Hadoop. http://hadoop.apache.org. Accessed: 2017-06-05

2. Apache Mesos. http://mesos.apache.org/. Accessed: 2017-12-17

3. Apache Spark. http://spark.apache.org/. Accessed: 2017-12-17

4. CGroups Blkio Controller. https://www.kernel.org/doc/Documentation/cgroup-v1/blkio-controller.txt. Accessed: 2019-12-18

5. Fio - an I/O tool for benchmark and stress/hardware verification. https://linux.die.net/man/1/fio. Accessed: 2015-03-4

Cited by 3 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. A Review of Monitoring Probes for Cloud Computing Continuum;Advanced Information Networking and Applications;2023

2. A Caching-Based Pipelining Model for Improving the Input/Output Performance of Distributed Data Storage Systems;Journal of Nanoelectronics and Optoelectronics;2022-06-01

3. JP-DAP: An Intelligent Data Analytics Platform for Metro Rail Transport Systems;IEEE Transactions on Intelligent Transportation Systems;2021